2024-09-16T03:13:05.796 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T03:13:05.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T03:13:05.888 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905859 branch: main description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd-backfill} email: ceph-qa@ceph.com first_in_suite: false job_id: '7905859' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: fc3e0bff7468fd55478adbae7f75508b749124b6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: fc3e0bff7468fd55478adbae7f75508b749124b6 workunit: branch: main sha1: 7498493279982dfe87f00616198a5967475f6169 owner: scheduled_teuthology@teuthology priority: 101 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 2855 sha1: fc3e0bff7468fd55478adbae7f75508b749124b6 sleep_before_teardown: 0 subset: 17936/100000 suite: rados suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_7498493279982dfe87f00616198a5967475f6169/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7498493279982dfe87f00616198a5967475f6169 targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQvOk2HDNhAnW9Ih/axar9PDdUfKonN8YDisQNMvzxM85E3cnZb30G7IkZY2AV2XCAnCRJuvWiDATxCRa7aSNM= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd-backfill teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_20:00:16 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T03:13:05.888 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7498493279982dfe87f00616198a5967475f6169/qa; will attempt to use it 2024-09-16T03:13:05.889 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7498493279982dfe87f00616198a5967475f6169/qa/tasks 2024-09-16T03:13:05.889 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T03:13:05.891 INFO:teuthology.task.internal:Checking packages... 2024-09-16T03:13:05.914 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'fc3e0bff7468fd55478adbae7f75508b749124b6' 2024-09-16T03:13:05.914 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T03:13:05.914 INFO:teuthology.packaging:ref: None 2024-09-16T03:13:05.914 INFO:teuthology.packaging:tag: None 2024-09-16T03:13:05.914 INFO:teuthology.packaging:branch: main 2024-09-16T03:13:05.914 INFO:teuthology.packaging:sha1: fc3e0bff7468fd55478adbae7f75508b749124b6 2024-09-16T03:13:05.914 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-16T03:13:06.166 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4937.g74984932 2024-09-16T03:13:06.168 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T03:13:06.177 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T03:13:06.177 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T03:13:06.251 INFO:teuthology.task.internal:Saving configuration 2024-09-16T03:13:06.259 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T03:13:06.271 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T03:13:06.295 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905859', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 03:08:41.887178', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQvOk2HDNhAnW9Ih/axar9PDdUfKonN8YDisQNMvzxM85E3cnZb30G7IkZY2AV2XCAnCRJuvWiDATxCRa7aSNM='} 2024-09-16T03:13:06.296 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T03:13:06.307 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2024-09-16T03:13:06.307 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T03:13:06.440 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f97e439bbe0>, signals=[15]) 2024-09-16T03:13:06.440 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T03:13:06.451 INFO:teuthology.task.internal:Opening connections... 2024-09-16T03:13:06.451 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2024-09-16T03:13:06.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:13:06.570 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T03:13:06.581 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-09-16T03:13:06.654 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-09-16T03:13:06.654 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-09-16T03:13:06.711 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2024-09-16T03:13:06.711 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9" 2024-09-16T03:13:06.712 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2024-09-16T03:13:06.712 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2024-09-16T03:13:06.712 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9" 2024-09-16T03:13:06.712 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9" 2024-09-16T03:13:06.712 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T03:13:06.712 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2024-09-16T03:13:06.712 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon" 2024-09-16T03:13:06.712 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T03:13:06.712 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2024-09-16T03:13:06.712 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T03:13:06.712 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T03:13:06.712 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T03:13:06.713 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-09-16T03:13:06.736 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T03:13:06.747 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T03:13:06.761 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T03:13:06.761 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2024-09-16T03:13:06.778 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T03:13:06.787 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T03:13:06.787 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2024-09-16T03:13:06.844 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T03:13:06.879 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T03:13:06.900 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T03:13:06.900 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T03:13:06.901 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T03:13:06.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:13:06.918 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-09-16T03:13:06.976 INFO:teuthology.orchestra.run.smithi026.stdout:5.14.0-503.el9.x86_64 2024-09-16T03:13:06.976 INFO:teuthology.task.kernel:Running kernel on smithi026: 5.14.0-503.el9.x86_64 2024-09-16T03:13:06.976 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum install -y kernel 2024-09-16T03:13:09.571 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.2 MB 00:00 2024-09-16T03:13:11.531 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-16T03:13:16.440 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - CRB 6.8 MB/s | 6.5 MB 00:00 2024-09-16T03:13:17.890 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - Extras packages 103 kB/s | 19 kB 00:00 2024-09-16T03:13:19.011 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-16T03:13:24.742 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-16T03:13:26.790 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T03:13:26.790 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T03:13:26.890 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:13:26.895 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:13:26.895 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-09-16T03:13:26.895 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:13:26.895 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:13:26.895 INFO:teuthology.orchestra.run.smithi026.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T03:13:26.895 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-09-16T03:13:26.895 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T03:13:26.895 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T03:13:26.895 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T03:13:26.895 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:13:26.896 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:13:26.896 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:13:26.896 INFO:teuthology.orchestra.run.smithi026.stdout:Install 4 Packages 2024-09-16T03:13:26.896 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:13:26.896 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 79 M 2024-09-16T03:13:26.896 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 126 M 2024-09-16T03:13:26.897 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:13:27.068 INFO:teuthology.orchestra.run.smithi026.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 313 kB/s | 23 kB 00:00 2024-09-16T03:13:28.076 INFO:teuthology.orchestra.run.smithi026.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-09-16T03:13:28.677 INFO:teuthology.orchestra.run.smithi026.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 21 MB/s | 35 MB 00:01 2024-09-16T03:13:29.111 INFO:teuthology.orchestra.run.smithi026.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 14 MB/s | 29 MB 00:02 2024-09-16T03:13:29.111 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:13:29.111 INFO:teuthology.orchestra.run.smithi026.stdout:Total 36 MB/s | 79 MB 00:02 2024-09-16T03:13:29.833 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:13:30.219 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:13:30.219 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:13:31.209 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:13:31.210 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:13:33.794 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:13:34.445 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T03:13:34.527 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T03:13:37.323 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T03:13:37.445 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T03:13:42.572 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T03:13:42.658 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T03:13:47.805 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T03:14:26.782 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T03:14:26.823 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T03:14:27.155 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T03:14:27.155 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T03:14:27.155 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T03:14:27.155 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T03:14:27.987 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T03:14:27.987 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:14:27.987 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:14:27.987 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T03:14:27.987 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T03:14:27.987 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T03:14:27.988 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T03:14:27.988 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:14:27.988 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:14:28.342 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T03:14:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T03:14:28.432 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T03:14:28.432 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T03:14:28.432 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T03:14:28.432 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T03:14:28.432 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T03:14:28.432 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi026.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T03:14:28.432 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T03:14:28.490 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T03:14:28.491 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T03:14:28.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo rpm -qi grub2-tools 2024-09-16T03:14:28.528 INFO:teuthology.orchestra.run.smithi026.stdout:Name : grub2-tools 2024-09-16T03:14:28.528 INFO:teuthology.orchestra.run.smithi026.stdout:Epoch : 1 2024-09-16T03:14:28.528 INFO:teuthology.orchestra.run.smithi026.stdout:Version : 2.06 2024-09-16T03:14:28.528 INFO:teuthology.orchestra.run.smithi026.stdout:Release : 82.el9 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:Architecture: x86_64 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:Group : Unspecified 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:Size : 8274670 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:License : GPLv3+ 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:Packager : builder@centos.org 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:Vendor : CentOS 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:Summary : Support tools for GRUB. 2024-09-16T03:14:28.529 INFO:teuthology.orchestra.run.smithi026.stdout:Description : 2024-09-16T03:14:28.530 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:14:28.530 INFO:teuthology.orchestra.run.smithi026.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T03:14:28.530 INFO:teuthology.orchestra.run.smithi026.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T03:14:28.530 INFO:teuthology.orchestra.run.smithi026.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T03:14:28.530 INFO:teuthology.orchestra.run.smithi026.stdout:hardware devices. 2024-09-16T03:14:28.530 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:14:28.530 INFO:teuthology.orchestra.run.smithi026.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T03:14:28.531 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T03:14:28.531 INFO:teuthology.task.kernel:Updating grub on smithi026 to boot 5.14.0-505.el9.x86_64 2024-09-16T03:14:28.531 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T03:14:29.167 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2024-09-16T03:14:30.581 INFO:teuthology.orchestra.run.smithi026.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T03:14:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:done 2024-09-16T03:14:30.621 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-09-16T03:14:30.636 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.Wh1N6seych 2024-09-16T03:14:30.636 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Wh1N6seych 2024-09-16T03:14:30.702 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.Wh1N6seych 2024-09-16T03:14:30.844 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.Wh1N6seych is 6KB 2024-09-16T03:14:30.894 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.Wh1N6seych 2024-09-16T03:14:30.909 DEBUG:teuthology.orchestra.run.smithi026:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T03:14:30.970 INFO:teuthology.orchestra.run.smithi026.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T03:14:30.970 INFO:teuthology.orchestra.run.smithi026.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T03:14:30.971 INFO:teuthology.orchestra.run.smithi026.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T03:14:30.971 INFO:teuthology.orchestra.run.smithi026.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T03:14:30.972 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T03:14:31.122 DEBUG:teuthology.orchestra.run.smithi026:> sudo shutdown -r now 2024-09-16T03:15:01.153 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T03:15:01.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-09-16T03:15:01.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:15:19.489 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-09-16T03:15:28.497 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-09-16T03:15:28.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:15:46.881 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-09-16T03:15:58.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-09-16T03:15:58.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:16:00.391 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-09-16T03:16:00.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-09-16T03:16:00.779 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T03:16:00.779 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-09-16T03:16:00.794 INFO:teuthology.orchestra.run.smithi026.stdout:5.14.0-505.el9.x86_64 2024-09-16T03:16:00.794 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T03:16:00.795 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T03:16:00.795 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T03:16:01.795 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T03:16:01.796 DEBUG:teuthology.orchestra.run.smithi026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T03:16:01.881 INFO:teuthology.orchestra.run.smithi026.stdout:ttyS1 2024-09-16T03:16:01.899 DEBUG:teuthology.parallel:result is None 2024-09-16T03:16:01.900 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T03:16:02.195 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T03:16:02.195 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T03:16:02.212 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T03:16:02.222 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T03:16:02.251 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T03:16:02.251 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T03:16:02.279 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T03:16:02.287 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T03:16:02.287 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T03:16:02.344 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:16:02.355 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:16:02.357 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T03:16:02.365 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T03:16:02.366 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T03:16:02.424 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T03:16:02.437 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T03:16:02.437 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T03:16:02.481 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T03:16:02.561 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T03:16:02.607 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T03:16:02.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T03:16:02.731 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-16T03:16:02.731 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T03:16:02.798 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2024-09-16T03:16:02.898 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T03:16:03.213 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T03:16:03.220 INFO:teuthology.task.internal:Starting timer... 2024-09-16T03:16:03.220 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T03:16:03.233 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T03:16:03.244 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2024-09-16T03:16:03.298 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: 2024-09-16T03:16:03.300 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T03:16:03.300 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2024-09-16T03:16:03.324 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2024-09-16T03:16:03.324 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi026.front.sepia.ceph.com': 'permissive'} 2024-09-16T03:16:03.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-16T03:16:03.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:16:03.392 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T03:16:03.392 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2024-09-16T03:16:03.466 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T03:16:03.477 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T03:16:03.492 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T03:16:03.493 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T03:19:54.623 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com')] 2024-09-16T03:19:54.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-09-16T03:19:54.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T03:19:54.703 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-09-16T03:19:54.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-09-16T03:19:54.788 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T03:19:54.801 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T03:19:54.801 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T03:19:54.802 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T03:19:54.857 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T03:19:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T03:19:54.897 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2024-09-16T03:19:54.909 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2024-09-16T03:19:54.924 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T03:19:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T03:19:54.993 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: ntpq: command not found 2024-09-16T03:19:54.997 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T03:19:54.998 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-09-16T03:19:54.998 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T03:19:54.998 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T03:19:54.998 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T03:19:54.998 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T03:19:54.998 INFO:teuthology.run_tasks:Running task install... 2024-09-16T03:19:55.006 DEBUG:teuthology.task.install:project ceph 2024-09-16T03:19:55.007 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'fc3e0bff7468fd55478adbae7f75508b749124b6'}} 2024-09-16T03:19:55.007 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'fc3e0bff7468fd55478adbae7f75508b749124b6'} 2024-09-16T03:19:55.007 INFO:teuthology.task.install:Using flavor: default 2024-09-16T03:19:55.013 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T03:19:55.013 INFO:teuthology.task.install:extra packages: [] 2024-09-16T03:19:55.014 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'fc3e0bff7468fd55478adbae7f75508b749124b6', 'tag': None, 'wait_for_package': False} 2024-09-16T03:19:55.015 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fc3e0bff7468fd55478adbae7f75508b749124b6 2024-09-16T03:19:55.157 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/centos/9/flavors/default/ 2024-09-16T03:19:55.157 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4930.gfc3e0bff 2024-09-16T03:19:55.268 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T03:19:55.269 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-16T03:19:55.269 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T03:19:55.296 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T03:19:55.297 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/fc3e0bff7468fd55478adbae7f75508b749124b6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T03:19:55.365 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T03:19:55.441 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T03:19:55.506 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2024-09-16T03:19:55.508 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2024-09-16T03:19:55.760 INFO:teuthology.orchestra.run.smithi026.stdout:45 files removed 2024-09-16T03:19:55.787 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw 2024-09-16T03:19:56.368 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-16T03:19:56.660 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-16T03:19:56.927 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-16T03:19:57.544 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-16T03:19:59.404 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-16T03:20:03.796 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-16T03:20:05.388 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-16T03:20:06.326 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-16T03:20:11.999 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-16T03:20:14.520 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:20:14.538 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:20:14.538 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 11 M 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 3.5 M 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 3.2 M 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 5.5 M 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 22 M 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 25 k 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T03:20:14.539 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 755 k 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 508 k 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 5.5 M 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T03:20:14.540 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 45 k 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 143 k 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 161 k 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 320 k 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 305 k 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 99 k 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout:Installing weak dependencies: 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:14.541 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:20:14.542 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:20:14.542 INFO:teuthology.orchestra.run.smithi026.stdout:Install 31 Packages 2024-09-16T03:20:14.542 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 2 Packages 2024-09-16T03:20:14.542 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:14.542 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 62 M 2024-09-16T03:20:14.543 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:20:15.441 INFO:teuthology.orchestra.run.smithi026.stdout:(1/33): ceph-base-19.3.0-4930.gfc3e0bff.el9.x86 9.4 MB/s | 5.5 MB 00:00 2024-09-16T03:20:15.500 INFO:teuthology.orchestra.run.smithi026.stdout:(2/33): ceph-selinux-19.3.0-4930.gfc3e0bff.el9. 432 kB/s | 25 kB 00:00 2024-09-16T03:20:15.634 INFO:teuthology.orchestra.run.smithi026.stdout:(3/33): ceph-radosgw-19.3.0-4930.gfc3e0bff.el9. 14 MB/s | 11 MB 00:00 2024-09-16T03:20:15.667 INFO:teuthology.orchestra.run.smithi026.stdout:(4/33): libcephfs2-19.3.0-4930.gfc3e0bff.el9.x8 4.4 MB/s | 755 kB 00:00 2024-09-16T03:20:15.709 INFO:teuthology.orchestra.run.smithi026.stdout:(5/33): libradosstriper1-19.3.0-4930.gfc3e0bff. 6.6 MB/s | 508 kB 00:00 2024-09-16T03:20:15.768 INFO:teuthology.orchestra.run.smithi026.stdout:(6/33): python3-ceph-argparse-19.3.0-4930.gfc3e 773 kB/s | 45 kB 00:00 2024-09-16T03:20:15.843 INFO:teuthology.orchestra.run.smithi026.stdout:(7/33): python3-ceph-common-19.3.0-4930.gfc3e0b 1.9 MB/s | 143 kB 00:00 2024-09-16T03:20:15.952 INFO:teuthology.orchestra.run.smithi026.stdout:(8/33): librgw2-19.3.0-4930.gfc3e0bff.el9.x86_6 19 MB/s | 5.5 MB 00:00 2024-09-16T03:20:15.977 INFO:teuthology.orchestra.run.smithi026.stdout:(9/33): python3-cephfs-19.3.0-4930.gfc3e0bff.el 1.2 MB/s | 161 kB 00:00 2024-09-16T03:20:16.011 INFO:teuthology.orchestra.run.smithi026.stdout:(10/33): python3-rados-19.3.0-4930.gfc3e0bff.el 5.3 MB/s | 320 kB 00:00 2024-09-16T03:20:16.036 INFO:teuthology.orchestra.run.smithi026.stdout:(11/33): python3-rbd-19.3.0-4930.gfc3e0bff.el9. 5.1 MB/s | 305 kB 00:00 2024-09-16T03:20:16.061 INFO:teuthology.orchestra.run.smithi026.stdout:(12/33): python3-rgw-19.3.0-4930.gfc3e0bff.el9. 1.9 MB/s | 99 kB 00:00 2024-09-16T03:20:16.295 INFO:teuthology.orchestra.run.smithi026.stdout:(13/33): ceph-common-19.3.0-4930.gfc3e0bff.el9. 15 MB/s | 22 MB 00:01 2024-09-16T03:20:16.355 INFO:teuthology.orchestra.run.smithi026.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 335 kB/s | 107 kB 00:00 2024-09-16T03:20:16.406 INFO:teuthology.orchestra.run.smithi026.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 906 kB/s | 45 kB 00:00 2024-09-16T03:20:16.431 INFO:teuthology.orchestra.run.smithi026.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 461 kB/s | 171 kB 00:00 2024-09-16T03:20:16.456 INFO:teuthology.orchestra.run.smithi026.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 995 kB/s | 160 kB 00:00 2024-09-16T03:20:16.498 INFO:teuthology.orchestra.run.smithi026.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-16T03:20:16.524 INFO:teuthology.orchestra.run.smithi026.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-16T03:20:16.540 INFO:teuthology.orchestra.run.smithi026.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 505 kB/s | 42 kB 00:00 2024-09-16T03:20:16.557 INFO:teuthology.orchestra.run.smithi026.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 1.1 MB/s | 36 kB 00:00 2024-09-16T03:20:16.583 INFO:teuthology.orchestra.run.smithi026.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-16T03:20:16.599 INFO:teuthology.orchestra.run.smithi026.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-09-16T03:20:16.658 INFO:teuthology.orchestra.run.smithi026.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-16T03:20:16.675 INFO:teuthology.orchestra.run.smithi026.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 3.3 MB/s | 49 kB 00:00 2024-09-16T03:20:16.692 INFO:teuthology.orchestra.run.smithi026.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 340 kB/s | 26 kB 00:00 2024-09-16T03:20:16.717 INFO:teuthology.orchestra.run.smithi026.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-16T03:20:16.751 INFO:teuthology.orchestra.run.smithi026.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-16T03:20:16.801 INFO:teuthology.orchestra.run.smithi026.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-16T03:20:16.852 INFO:teuthology.orchestra.run.smithi026.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-16T03:20:16.943 INFO:teuthology.orchestra.run.smithi026.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-16T03:20:17.052 INFO:teuthology.orchestra.run.smithi026.stdout:(32/33): librados2-19.3.0-4930.gfc3e0bff.el9.x8 14 MB/s | 3.5 MB 00:00 2024-09-16T03:20:17.127 INFO:teuthology.orchestra.run.smithi026.stdout:(33/33): librbd1-19.3.0-4930.gfc3e0bff.el9.x86_ 12 MB/s | 3.2 MB 00:00 2024-09-16T03:20:17.133 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:20:17.133 INFO:teuthology.orchestra.run.smithi026.stdout:Total 24 MB/s | 62 MB 00:02 2024-09-16T03:20:17.255 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:20:17.297 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:20:17.297 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:20:17.988 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:20:17.988 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:20:19.527 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:20:19.617 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-16T03:20:19.649 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-16T03:20:19.674 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-16T03:20:19.697 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-16T03:20:19.726 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-16T03:20:19.917 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-16T03:20:19.978 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-16T03:20:20.390 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-16T03:20:20.459 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 7/35 2024-09-16T03:20:20.552 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 7/35 2024-09-16T03:20:20.642 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:19.3.0-4930.gfc3e0bff.el9.x86_64 8/35 2024-09-16T03:20:20.677 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 9/35 2024-09-16T03:20:20.740 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 9/35 2024-09-16T03:20:20.777 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-16T03:20:20.832 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:19.3.0-4930.gfc3e0bff.el9. 11/35 2024-09-16T03:20:20.909 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:19.3.0-4930.gfc3e0bff.el9.x86_64 12/35 2024-09-16T03:20:20.938 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:19.3.0-4930.gfc3e0bff.el9.x86_6 13/35 2024-09-16T03:20:21.002 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4930.gfc3e0bff.el9.x86_6 13/35 2024-09-16T03:20:21.036 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-16T03:20:21.148 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-16T03:20:21.179 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-16T03:20:21.229 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-16T03:20:21.261 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-16T03:20:21.290 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-16T03:20:21.323 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T03:20:21.369 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-16T03:20:21.713 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-16T03:20:21.753 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:19.3.0-4930.gfc3e0bff.el9.x86_64 23/35 2024-09-16T03:20:21.845 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:19.3.0-4930.gfc3e0bff.el9.x86_64 23/35 2024-09-16T03:20:21.878 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:19.3.0-4930.gfc3e0bff.el9.x86_64 24/35 2024-09-16T03:20:21.919 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-16T03:20:22.446 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-16T03:20:22.480 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 27/35 2024-09-16T03:20:22.560 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 27/35 2024-09-16T03:20:22.641 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:19.3.0-4930.gfc3e0bff.el9.x86_64 28/35 2024-09-16T03:20:22.683 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:19.3.0-4930.gfc3e0bff.el9.x8 29/35 2024-09-16T03:20:25.076 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:19.3.0-4930.gfc3e0bff.el9.x86_64 30/35 2024-09-16T03:20:25.112 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:19.3.0-4930.gfc3e0bff.el9.x86_64 30/35 2024-09-16T03:20:25.722 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:19.3.0-4930.gfc3e0bff.el9.x86_64 30/35 2024-09-16T03:20:25.766 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:19.3.0-4930.gfc3e0bff.el9.x86_64 31/35 2024-09-16T03:20:25.860 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:19.3.0-4930.gfc3e0bff.el9.x86_64 31/35 2024-09-16T03:20:25.860 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T03:20:25.860 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T03:20:25.860 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:25.901 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:19.3.0-4930.gfc3e0bff.el9.x86_64 32/35 2024-09-16T03:20:36.575 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4930.gfc3e0bff.el9.x86_64 32/35 2024-09-16T03:20:36.576 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2024-09-16T03:20:36.576 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2024-09-16T03:20:36.576 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2024-09-16T03:20:36.576 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2024-09-16T03:20:36.577 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2024-09-16T03:20:36.577 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /root 2024-09-16T03:20:36.577 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2024-09-16T03:20:36.577 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:37.617 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:19.3.0-4930.gfc3e0bff.el9.x86_64 33/35 2024-09-16T03:20:37.652 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4930.gfc3e0bff.el9.x86_64 33/35 2024-09-16T03:20:37.652 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T03:20:37.652 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T03:20:37.652 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T03:20:37.652 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T03:20:37.653 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:37.654 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T03:20:37.728 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-16T03:20:37.728 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T03:20:39.066 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T03:20:39.066 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/35 2024-09-16T03:20:39.066 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2/35 2024-09-16T03:20:39.067 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:19.3.0-4930.gfc3e0bff.el9.x86_64 3/35 2024-09-16T03:20:39.067 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:19.3.0-4930.gfc3e0bff.el9.x86_64 4/35 2024-09-16T03:20:39.067 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 5/35 2024-09-16T03:20:39.067 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:19.3.0-4930.gfc3e0bff.el9.x86_6 6/35 2024-09-16T03:20:39.067 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 7/35 2024-09-16T03:20:39.067 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4930.gfc3e0bff.el9. 8/35 2024-09-16T03:20:39.068 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:19.3.0-4930.gfc3e0bff.el9.x8 9/35 2024-09-16T03:20:39.068 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:19.3.0-4930.gfc3e0bff.el9.x86_64 10/35 2024-09-16T03:20:39.068 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:19.3.0-4930.gfc3e0bff.el9.x86_64 11/35 2024-09-16T03:20:39.068 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:19.3.0-4930.gfc3e0bff.el9.x86_64 12/35 2024-09-16T03:20:39.068 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:19.3.0-4930.gfc3e0bff.el9.x86_64 13/35 2024-09-16T03:20:39.068 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-16T03:20:39.069 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-16T03:20:39.069 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-16T03:20:39.069 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-16T03:20:39.069 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-16T03:20:39.069 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-16T03:20:39.069 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-16T03:20:39.070 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-16T03:20:39.070 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-16T03:20:39.070 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-16T03:20:39.070 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-16T03:20:39.070 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-16T03:20:39.071 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-16T03:20:39.071 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-16T03:20:39.071 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-16T03:20:39.071 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-16T03:20:39.071 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-16T03:20:39.071 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-16T03:20:39.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 32/35 2024-09-16T03:20:39.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-16T03:20:39.072 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:19.3.0-4930.gfc3e0bff.el9.x86_64 34/35 2024-09-16T03:20:40.019 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-16T03:20:40.019 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:40.019 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2024-09-16T03:20:40.019 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.019 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.019 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:20:40.019 INFO:teuthology.orchestra.run.smithi026.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T03:20:40.019 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.019 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.019 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.019 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T03:20:40.020 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T03:20:40.021 INFO:teuthology.orchestra.run.smithi026.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T03:20:40.022 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:40.022 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:20:40.390 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-test 2024-09-16T03:20:40.977 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:29 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:20:41.114 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:20:41.115 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:20:41.115 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-09-16T03:20:41.115 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:20:41.115 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:20:41.115 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 46 M 2024-09-16T03:20:41.115 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-09-16T03:20:41.115 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 161 k 2024-09-16T03:20:41.115 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T03:20:41.116 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T03:20:41.116 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:41.116 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:20:41.116 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:20:41.116 INFO:teuthology.orchestra.run.smithi026.stdout:Install 4 Packages 2024-09-16T03:20:41.116 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:41.116 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 46 M 2024-09-16T03:20:41.117 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 201 M 2024-09-16T03:20:41.117 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:20:41.384 INFO:teuthology.orchestra.run.smithi026.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.1 MB/s | 304 kB 00:00 2024-09-16T03:20:41.425 INFO:teuthology.orchestra.run.smithi026.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-16T03:20:41.476 INFO:teuthology.orchestra.run.smithi026.stdout:(3/4): libcephsqlite-19.3.0-4930.gfc3e0bff.el9. 681 kB/s | 161 kB 00:00 2024-09-16T03:20:42.693 INFO:teuthology.orchestra.run.smithi026.stdout:(4/4): ceph-test-19.3.0-4930.gfc3e0bff.el9.x86_ 31 MB/s | 46 MB 00:01 2024-09-16T03:20:42.695 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:20:42.695 INFO:teuthology.orchestra.run.smithi026.stdout:Total 29 MB/s | 46 MB 00:01 2024-09-16T03:20:42.724 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:20:42.746 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:20:42.747 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:20:43.142 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:20:43.142 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:20:43.686 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:20:43.777 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-16T03:20:43.826 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-16T03:20:43.853 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:19.3.0-4930.gfc3e0bff.el9.x86_64 3/4 2024-09-16T03:20:48.441 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4930.gfc3e0bff.el9.x86_64 3/4 2024-09-16T03:20:48.530 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:19.3.0-4930.gfc3e0bff.el9.x86_64 4/4 2024-09-16T03:20:50.935 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-test-2:19.3.0-4930.gfc3e0bff.el9.x86_64 4/4 2024-09-16T03:20:50.935 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/4 2024-09-16T03:20:50.935 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2/4 2024-09-16T03:20:50.935 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-16T03:20:51.245 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-16T03:20:51.245 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:51.245 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:20:51.245 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:51.245 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:20:51.245 INFO:teuthology.orchestra.run.smithi026.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T03:20:51.245 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T03:20:51.245 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:51.246 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:20:51.517 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph 2024-09-16T03:20:52.122 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:41 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:20:52.276 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:20:52.278 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:20:52.278 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-09-16T03:20:52.279 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:20:52.279 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:20:52.279 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 6.6 k 2024-09-16T03:20:52.279 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-09-16T03:20:52.279 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 2.4 M 2024-09-16T03:20:52.279 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 1.5 M 2024-09-16T03:20:52.279 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4930.gfc3e0bff.el9 ceph-noarch 291 k 2024-09-16T03:20:52.279 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 4.8 M 2024-09-16T03:20:52.279 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 17 M 2024-09-16T03:20:52.279 INFO:teuthology.orchestra.run.smithi026.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T03:20:52.279 INFO:teuthology.orchestra.run.smithi026.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T03:20:52.279 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T03:20:52.280 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T03:20:52.280 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T03:20:52.280 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T03:20:52.280 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T03:20:52.280 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T03:20:52.280 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T03:20:52.280 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T03:20:52.280 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-collections 2024-09-16T03:20:52.280 INFO:teuthology.orchestra.run.smithi026.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-16T03:20:52.280 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T03:20:52.280 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T03:20:52.280 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T03:20:52.281 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T03:20:52.282 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T03:20:52.282 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T03:20:52.282 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T03:20:52.282 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T03:20:52.282 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:52.282 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:20:52.282 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:20:52.282 INFO:teuthology.orchestra.run.smithi026.stdout:Install 37 Packages 2024-09-16T03:20:52.282 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:20:52.283 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 31 M 2024-09-16T03:20:52.283 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 109 M 2024-09-16T03:20:52.283 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:20:52.940 INFO:teuthology.orchestra.run.smithi026.stdout:(1/37): ceph-19.3.0-4930.gfc3e0bff.el9.x86_64.r 54 kB/s | 6.6 kB 00:00 2024-09-16T03:20:53.132 INFO:teuthology.orchestra.run.smithi026.stdout:(2/37): ceph-mgr-19.3.0-4930.gfc3e0bff.el9.x86_ 4.9 MB/s | 1.5 MB 00:00 2024-09-16T03:20:53.182 INFO:teuthology.orchestra.run.smithi026.stdout:(3/37): ceph-mds-19.3.0-4930.gfc3e0bff.el9.x86_ 6.5 MB/s | 2.4 MB 00:00 2024-09-16T03:20:53.274 INFO:teuthology.orchestra.run.smithi026.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4930.gfc3e 3.1 MB/s | 291 kB 00:00 2024-09-16T03:20:53.341 INFO:teuthology.orchestra.run.smithi026.stdout:(5/37): ceph-mon-19.3.0-4930.gfc3e0bff.el9.x86_ 12 MB/s | 4.8 MB 00:00 2024-09-16T03:20:53.692 INFO:teuthology.orchestra.run.smithi026.stdout:(6/37): ceph-osd-19.3.0-4930.gfc3e0bff.el9.x86_ 31 MB/s | 17 MB 00:00 2024-09-16T03:20:53.725 INFO:teuthology.orchestra.run.smithi026.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 562 kB/s | 253 kB 00:00 2024-09-16T03:20:53.875 INFO:teuthology.orchestra.run.smithi026.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 902 kB/s | 135 kB 00:00 2024-09-16T03:20:54.025 INFO:teuthology.orchestra.run.smithi026.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 832 kB/s | 125 kB 00:00 2024-09-16T03:20:54.051 INFO:teuthology.orchestra.run.smithi026.stdout:(10/37): python3-ply-3.11-14.el9.noarch.rpm 297 kB/s | 106 kB 00:00 2024-09-16T03:20:54.193 INFO:teuthology.orchestra.run.smithi026.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.3 MB/s | 215 kB 00:00 2024-09-16T03:20:54.251 INFO:teuthology.orchestra.run.smithi026.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 941 kB/s | 188 kB 00:00 2024-09-16T03:20:54.285 INFO:teuthology.orchestra.run.smithi026.stdout:(13/37): python3-cryptography-36.0.1-4.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2024-09-16T03:20:54.301 INFO:teuthology.orchestra.run.smithi026.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 694 kB/s | 35 kB 00:00 2024-09-16T03:20:54.344 INFO:teuthology.orchestra.run.smithi026.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-16T03:20:54.386 INFO:teuthology.orchestra.run.smithi026.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 893 kB/s | 172 kB 00:00 2024-09-16T03:20:54.402 INFO:teuthology.orchestra.run.smithi026.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 715 kB/s | 42 kB 00:00 2024-09-16T03:20:54.453 INFO:teuthology.orchestra.run.smithi026.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-16T03:20:54.478 INFO:teuthology.orchestra.run.smithi026.stdout:(19/37): python3-packaging-20.9-5.el9.noarch.rp 400 kB/s | 77 kB 00:00 2024-09-16T03:20:54.495 INFO:teuthology.orchestra.run.smithi026.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-09-16T03:20:54.545 INFO:teuthology.orchestra.run.smithi026.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 8.3 MB/s | 358 kB 00:00 2024-09-16T03:20:54.562 INFO:teuthology.orchestra.run.smithi026.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 645 kB/s | 11 kB 00:00 2024-09-16T03:20:54.588 INFO:teuthology.orchestra.run.smithi026.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-16T03:20:54.605 INFO:teuthology.orchestra.run.smithi026.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 422 kB/s | 18 kB 00:00 2024-09-16T03:20:54.622 INFO:teuthology.orchestra.run.smithi026.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 696 kB/s | 23 kB 00:00 2024-09-16T03:20:54.647 INFO:teuthology.orchestra.run.smithi026.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 465 kB/s | 19 kB 00:00 2024-09-16T03:20:54.664 INFO:teuthology.orchestra.run.smithi026.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 469 kB/s | 20 kB 00:00 2024-09-16T03:20:54.681 INFO:teuthology.orchestra.run.smithi026.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.3 MB/s | 46 kB 00:00 2024-09-16T03:20:54.706 INFO:teuthology.orchestra.run.smithi026.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-16T03:20:54.731 INFO:teuthology.orchestra.run.smithi026.stdout:(30/37): lua-devel-5.4.4-4.el9.x86_64.rpm 64 kB/s | 22 kB 00:00 2024-09-16T03:20:54.757 INFO:teuthology.orchestra.run.smithi026.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-16T03:20:54.790 INFO:teuthology.orchestra.run.smithi026.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-16T03:20:54.816 INFO:teuthology.orchestra.run.smithi026.stdout:(33/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-16T03:20:54.841 INFO:teuthology.orchestra.run.smithi026.stdout:(34/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 824 kB/s | 90 kB 00:00 2024-09-16T03:20:54.866 INFO:teuthology.orchestra.run.smithi026.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.1 MB/s | 230 kB 00:00 2024-09-16T03:20:54.891 INFO:teuthology.orchestra.run.smithi026.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2024-09-16T03:20:54.917 INFO:teuthology.orchestra.run.smithi026.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-16T03:20:54.921 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:20:54.921 INFO:teuthology.orchestra.run.smithi026.stdout:Total 12 MB/s | 31 MB 00:02 2024-09-16T03:20:55.083 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:20:55.126 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:20:55.126 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:20:55.643 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:20:55.644 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:20:57.017 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:20:57.078 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T03:20:57.111 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T03:20:57.139 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T03:20:57.214 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T03:20:57.264 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T03:20:57.296 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T03:20:57.393 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T03:20:57.469 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T03:20:57.525 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T03:20:57.560 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T03:20:57.589 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T03:20:57.623 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T03:20:57.657 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T03:20:57.697 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T03:20:57.741 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T03:20:57.775 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T03:20:57.825 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T03:20:57.864 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T03:20:57.957 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T03:20:58.118 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T03:20:58.201 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T03:20:58.260 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T03:20:58.297 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T03:20:58.356 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T03:20:58.420 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T03:20:58.640 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T03:20:58.693 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T03:20:58.774 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T03:20:58.864 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T03:20:58.918 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T03:20:59.064 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T03:20:59.254 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4930.gfc3e0bff.el9. 32/37 2024-09-16T03:20:59.285 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:19.3.0-4930.gfc3e0bff.el9.x86_64 33/37 2024-09-16T03:20:59.314 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4930.gfc3e0bff.el9.x86_64 33/37 2024-09-16T03:20:59.314 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T03:20:59.314 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T03:20:59.314 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T03:20:59.315 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T03:20:59.315 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:00.861 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:19.3.0-4930.gfc3e0bff.el9.x86_64 34/37 2024-09-16T03:21:00.890 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:19.3.0-4930.gfc3e0bff.el9.x86_64 34/37 2024-09-16T03:21:00.891 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T03:21:00.891 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T03:21:00.891 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T03:21:00.891 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T03:21:00.891 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:19.3.0-4930.gfc3e0bff.el9.x86_64 35/37 2024-09-16T03:21:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:19.3.0-4930.gfc3e0bff.el9.x86_64 35/37 2024-09-16T03:21:01.396 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T03:21:01.396 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T03:21:01.396 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T03:21:01.397 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T03:21:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:01.629 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:19.3.0-4930.gfc3e0bff.el9.x86_64 36/37 2024-09-16T03:21:01.655 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:19.3.0-4930.gfc3e0bff.el9.x86_64 36/37 2024-09-16T03:21:01.655 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T03:21:01.655 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T03:21:01.655 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T03:21:01.655 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T03:21:01.655 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:19.3.0-4930.gfc3e0bff.el9.x86_64 37/37 2024-09-16T03:21:03.654 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-2:19.3.0-4930.gfc3e0bff.el9.x86_64 37/37 2024-09-16T03:21:03.654 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/37 2024-09-16T03:21:03.654 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2/37 2024-09-16T03:21:03.654 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:19.3.0-4930.gfc3e0bff.el9.x86_64 3/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:19.3.0-4930.gfc3e0bff.el9.x86_64 4/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:19.3.0-4930.gfc3e0bff.el9.x86_64 5/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4930.gfc3e0bff.el9. 6/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T03:21:03.655 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T03:21:03.656 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T03:21:03.657 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T03:21:03.657 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T03:21:03.657 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T03:21:03.657 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T03:21:03.657 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T03:21:03.657 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T03:21:03.657 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T03:21:04.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T03:21:04.583 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:04.583 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:21:04.583 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:19.3.0-4930.gfc3e0bff.el9.noarch 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T03:21:04.584 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T03:21:04.585 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T03:21:04.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T03:21:04.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T03:21:04.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T03:21:04.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T03:21:04.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T03:21:04.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T03:21:04.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T03:21:04.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T03:21:04.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T03:21:04.586 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T03:21:04.586 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:04.586 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:04.971 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-base 2024-09-16T03:21:05.560 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:54 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:05.654 INFO:teuthology.orchestra.run.smithi026.stdout:Package ceph-base-2:19.3.0-4930.gfc3e0bff.el9.x86_64 is already installed. 2024-09-16T03:21:05.698 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:05.699 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-09-16T03:21:05.699 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:05.763 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install cephadm 2024-09-16T03:21:06.352 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:55 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:06.491 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:06.492 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:06.492 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-09-16T03:21:06.492 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:06.492 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:21:06.492 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm noarch 2:19.3.0-4930.gfc3e0bff.el9 ceph-noarch 784 k 2024-09-16T03:21:06.492 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:06.493 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:21:06.493 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:06.493 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-09-16T03:21:06.493 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:06.493 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 784 k 2024-09-16T03:21:06.493 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 791 k 2024-09-16T03:21:06.493 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:21:06.769 INFO:teuthology.orchestra.run.smithi026.stdout:cephadm-19.3.0-4930.gfc3e0bff.el9.noarch.rpm 2.8 MB/s | 784 kB 00:00 2024-09-16T03:21:06.769 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:21:06.769 INFO:teuthology.orchestra.run.smithi026.stdout:Total 2.8 MB/s | 784 kB 00:00 2024-09-16T03:21:06.770 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:21:06.775 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:21:06.775 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:21:06.782 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:21:06.782 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:21:06.857 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:21:07.284 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:19.3.0-4930.gfc3e0bff.el9.noarch 1/1 2024-09-16T03:21:07.384 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:19.3.0-4930.gfc3e0bff.el9.noarch 1/1 2024-09-16T03:21:07.746 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:19.3.0-4930.gfc3e0bff.el9.noarch 1/1 2024-09-16T03:21:08.010 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:19.3.0-4930.gfc3e0bff.el9.noarch 1/1 2024-09-16T03:21:08.011 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:08.011 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:21:08.011 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:19.3.0-4930.gfc3e0bff.el9.noarch 2024-09-16T03:21:08.011 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:08.011 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:08.241 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T03:21:08.834 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:57 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:08.972 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:08.973 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:08.973 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2024-09-16T03:21:08.973 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:08.973 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:21:08.974 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 145 k 2024-09-16T03:21:08.974 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:08.974 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:21:08.974 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:08.974 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-09-16T03:21:08.974 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:08.974 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 145 k 2024-09-16T03:21:08.974 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 432 k 2024-09-16T03:21:08.974 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:21:09.174 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-immutable-object-cache-19.3.0-4930.gfc3e0b 725 kB/s | 145 kB 00:00 2024-09-16T03:21:09.175 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:21:09.175 INFO:teuthology.orchestra.run.smithi026.stdout:Total 720 kB/s | 145 kB 00:00 2024-09-16T03:21:09.175 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:21:09.183 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:21:09.183 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:21:09.244 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:21:09.245 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:21:09.396 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:21:09.500 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4930.gfc3e0bff. 1/1 2024-09-16T03:21:09.526 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4930.gfc3e0bff. 1/1 2024-09-16T03:21:09.526 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T03:21:09.526 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T03:21:09.527 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:10.484 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4930.gfc3e0bff. 1/1 2024-09-16T03:21:10.485 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:10.485 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:21:10.485 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:21:10.485 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:10.485 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:10.696 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr 2024-09-16T03:21:11.285 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:00 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:11.379 INFO:teuthology.orchestra.run.smithi026.stdout:Package ceph-mgr-2:19.3.0-4930.gfc3e0bff.el9.x86_64 is already installed. 2024-09-16T03:21:11.424 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:11.425 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-09-16T03:21:11.425 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:11.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T03:21:12.072 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:01 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:12.212 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:12.213 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:12.213 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-09-16T03:21:12.213 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:12.213 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:21:12.213 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4930.gfc3e0bff.el9 ceph-noarch 14 M 2024-09-16T03:21:12.213 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-09-16T03:21:12.213 INFO:teuthology.orchestra.run.smithi026.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T03:21:12.213 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4930.gfc3e0bff.el9 ceph-noarch 34 k 2024-09-16T03:21:12.213 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4930.gfc3e0bff.el9 ceph-noarch 16 k 2024-09-16T03:21:12.214 INFO:teuthology.orchestra.run.smithi026.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T03:21:12.214 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T03:21:12.214 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T03:21:12.214 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T03:21:12.214 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T03:21:12.214 INFO:teuthology.orchestra.run.smithi026.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T03:21:12.214 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T03:21:12.214 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T03:21:12.214 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:12.214 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:21:12.214 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:12.215 INFO:teuthology.orchestra.run.smithi026.stdout:Install 12 Packages 2024-09-16T03:21:12.215 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:12.215 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 19 M 2024-09-16T03:21:12.215 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 159 M 2024-09-16T03:21:12.215 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:21:12.772 INFO:teuthology.orchestra.run.smithi026.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4930.gfc 213 kB/s | 34 kB 00:00 2024-09-16T03:21:12.797 INFO:teuthology.orchestra.run.smithi026.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4930.gfc3 88 kB/s | 16 kB 00:00 2024-09-16T03:21:13.272 INFO:teuthology.orchestra.run.smithi026.stdout:(3/12): ceph-mgr-dashboard-19.3.0-4930.gfc3e0bf 21 MB/s | 14 MB 00:00 2024-09-16T03:21:13.339 INFO:teuthology.orchestra.run.smithi026.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 497 kB/s | 269 kB 00:00 2024-09-16T03:21:13.398 INFO:teuthology.orchestra.run.smithi026.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-16T03:21:13.432 INFO:teuthology.orchestra.run.smithi026.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 578 kB/s | 19 kB 00:00 2024-09-16T03:21:13.499 INFO:teuthology.orchestra.run.smithi026.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-16T03:21:13.524 INFO:teuthology.orchestra.run.smithi026.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.4 MB/s | 863 kB 00:00 2024-09-16T03:21:13.566 INFO:teuthology.orchestra.run.smithi026.stdout:(9/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.3 MB/s | 1.0 MB 00:00 2024-09-16T03:21:13.591 INFO:teuthology.orchestra.run.smithi026.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.5 MB/s | 144 kB 00:00 2024-09-16T03:21:13.608 INFO:teuthology.orchestra.run.smithi026.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 368 kB/s | 31 kB 00:00 2024-09-16T03:21:13.633 INFO:teuthology.orchestra.run.smithi026.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-09-16T03:21:13.637 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:21:13.637 INFO:teuthology.orchestra.run.smithi026.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-16T03:21:13.688 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:21:13.708 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:21:13.708 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:21:13.997 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:21:13.997 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:21:14.600 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:21:14.693 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-16T03:21:14.736 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-16T03:21:14.792 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-16T03:21:14.829 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-16T03:21:14.918 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-16T03:21:15.061 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-16T03:21:15.169 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-16T03:21:15.219 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-16T03:21:15.246 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-16T03:21:15.279 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4930.gfc3e0bff.el9 10/12 2024-09-16T03:21:18.654 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4930.gfc3e0bff.el 11/12 2024-09-16T03:21:18.707 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4930.gfc3e0bff.el9.noa 12/12 2024-09-16T03:21:20.673 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4930.gfc3e0bff.el9.noa 12/12 2024-09-16T03:21:20.673 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4930.gfc3e0bff.el 1/12 2024-09-16T03:21:20.673 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4930.gfc3e0bff.el9.noa 2/12 2024-09-16T03:21:20.673 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4930.gfc3e0bff.el9 3/12 2024-09-16T03:21:20.673 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-16T03:21:20.674 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-16T03:21:20.674 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-16T03:21:20.674 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-16T03:21:20.674 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-16T03:21:20.674 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-16T03:21:20.674 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-16T03:21:20.674 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-16T03:21:21.008 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-16T03:21:21.009 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:21.009 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:21:21.009 INFO:teuthology.orchestra.run.smithi026.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T03:21:21.009 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:19.3.0-4930.gfc3e0bff.el9.noarch 2024-09-16T03:21:21.009 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:19.3.0-4930.gfc3e0bff.el9.noarch 2024-09-16T03:21:21.009 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:19.3.0-4930.gfc3e0bff.el9.noarch 2024-09-16T03:21:21.009 INFO:teuthology.orchestra.run.smithi026.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T03:21:21.009 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T03:21:21.009 INFO:teuthology.orchestra.run.smithi026.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T03:21:21.009 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T03:21:21.009 INFO:teuthology.orchestra.run.smithi026.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T03:21:21.009 INFO:teuthology.orchestra.run.smithi026.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T03:21:21.010 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T03:21:21.010 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T03:21:21.010 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:21.010 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:21.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T03:21:21.882 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:10 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:22.024 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:22.025 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-09-16T03:21:22.025 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-09-16T03:21:22.025 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-09-16T03:21:22.026 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:21:22.026 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4930.gfc3e0bff.el9 ceph-noarch 7.4 M 2024-09-16T03:21:22.026 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-09-16T03:21:22.026 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T03:21:22.026 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T03:21:22.026 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T03:21:22.026 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T03:21:22.026 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T03:21:22.026 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T03:21:22.026 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T03:21:22.027 INFO:teuthology.orchestra.run.smithi026.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T03:21:22.027 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T03:21:22.027 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T03:21:22.027 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T03:21:22.027 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:22.027 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:21:22.027 INFO:teuthology.orchestra.run.smithi026.stdout:======================================================================================= 2024-09-16T03:21:22.027 INFO:teuthology.orchestra.run.smithi026.stdout:Install 12 Packages 2024-09-16T03:21:22.027 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:22.028 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 38 M 2024-09-16T03:21:22.028 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 212 M 2024-09-16T03:21:22.028 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:21:22.840 INFO:teuthology.orchestra.run.smithi026.stdout:(1/12): ceph-mgr-diskprediction-local-19.3.0-49 17 MB/s | 7.4 MB 00:00 2024-09-16T03:21:22.957 INFO:teuthology.orchestra.run.smithi026.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-09-16T03:21:23.223 INFO:teuthology.orchestra.run.smithi026.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-09-16T03:21:23.249 INFO:teuthology.orchestra.run.smithi026.stdout:(4/12): libquadmath-11.5.0-2.el9.x86_64.rpm 227 kB/s | 191 kB 00:00 2024-09-16T03:21:23.274 INFO:teuthology.orchestra.run.smithi026.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 362 kB/s | 18 kB 00:00 2024-09-16T03:21:23.374 INFO:teuthology.orchestra.run.smithi026.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 829 kB/s | 801 kB 00:00 2024-09-16T03:21:23.399 INFO:teuthology.orchestra.run.smithi026.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 256 kB/s | 38 kB 00:00 2024-09-16T03:21:23.475 INFO:teuthology.orchestra.run.smithi026.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 25 MB/s | 4.9 MB 00:00 2024-09-16T03:21:23.534 INFO:teuthology.orchestra.run.smithi026.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-16T03:21:23.701 INFO:teuthology.orchestra.run.smithi026.stdout:(10/12): python3-devel-3.9.19-8.el9.x86_64.rpm 752 kB/s | 245 kB 00:00 2024-09-16T03:21:23.784 INFO:teuthology.orchestra.run.smithi026.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-16T03:21:23.976 INFO:teuthology.orchestra.run.smithi026.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-16T03:21:23.977 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:21:23.977 INFO:teuthology.orchestra.run.smithi026.stdout:Total 20 MB/s | 38 MB 00:01 2024-09-16T03:21:24.343 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:21:24.371 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:21:24.371 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:21:24.829 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:21:24.829 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:21:25.752 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:21:25.830 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T03:21:25.883 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T03:21:25.996 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T03:21:26.042 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T03:21:26.233 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T03:21:26.257 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T03:21:26.336 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T03:21:27.031 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T03:21:27.151 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T03:21:28.476 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T03:21:29.560 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T03:21:29.582 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4930.gfc3e0 12/12 2024-09-16T03:21:32.261 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4930.gfc3e0 12/12 2024-09-16T03:21:32.261 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4930.gfc3e0 1/12 2024-09-16T03:21:32.261 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T03:21:32.261 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T03:21:32.261 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T03:21:32.261 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T03:21:32.261 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T03:21:32.261 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T03:21:32.261 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T03:21:32.261 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T03:21:32.262 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T03:21:32.262 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T03:21:32.677 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T03:21:32.677 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:32.677 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:21:32.677 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4930.gfc3e0bff.el9.noarch 2024-09-16T03:21:32.677 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T03:21:32.677 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T03:21:32.677 INFO:teuthology.orchestra.run.smithi026.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T03:21:32.677 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T03:21:32.677 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T03:21:32.677 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T03:21:32.678 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T03:21:32.678 INFO:teuthology.orchestra.run.smithi026.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T03:21:32.678 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T03:21:32.678 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T03:21:32.678 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T03:21:32.678 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:32.678 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:33.066 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-rook 2024-09-16T03:21:33.655 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:22 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:33.794 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:33.796 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:33.796 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-09-16T03:21:33.796 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:33.796 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:21:33.796 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:19.3.0-4930.gfc3e0bff.el9 ceph-noarch 49 k 2024-09-16T03:21:33.796 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-09-16T03:21:33.796 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T03:21:33.796 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T03:21:33.796 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T03:21:33.796 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout:Install 13 Packages 2024-09-16T03:21:33.797 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:33.798 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 2.2 M 2024-09-16T03:21:33.798 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 26 M 2024-09-16T03:21:33.798 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:21:34.141 INFO:teuthology.orchestra.run.smithi026.stdout:(1/13): ceph-mgr-rook-19.3.0-4930.gfc3e0bff.el9 314 kB/s | 49 kB 00:00 2024-09-16T03:21:34.516 INFO:teuthology.orchestra.run.smithi026.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 36 kB/s | 19 kB 00:00 2024-09-16T03:21:34.541 INFO:teuthology.orchestra.run.smithi026.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 46 kB/s | 26 kB 00:00 2024-09-16T03:21:34.958 INFO:teuthology.orchestra.run.smithi026.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 272 kB/s | 222 kB 00:00 2024-09-16T03:21:35.233 INFO:teuthology.orchestra.run.smithi026.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 222 kB/s | 159 kB 00:00 2024-09-16T03:21:35.284 INFO:teuthology.orchestra.run.smithi026.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 651 kB/s | 32 kB 00:00 2024-09-16T03:21:35.330 INFO:teuthology.orchestra.run.smithi026.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 305 kB/s | 14 kB 00:00 2024-09-16T03:21:35.359 INFO:teuthology.orchestra.run.smithi026.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 341 kB/s | 279 kB 00:00 2024-09-16T03:21:35.393 INFO:teuthology.orchestra.run.smithi026.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 3.5 MB/s | 220 kB 00:00 2024-09-16T03:21:35.418 INFO:teuthology.orchestra.run.smithi026.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-16T03:21:35.443 INFO:teuthology.orchestra.run.smithi026.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-16T03:21:35.477 INFO:teuthology.orchestra.run.smithi026.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.7 MB/s | 1.0 MB 00:00 2024-09-16T03:21:35.569 INFO:teuthology.orchestra.run.smithi026.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 88 kB/s | 54 kB 00:00 2024-09-16T03:21:35.573 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:21:35.573 INFO:teuthology.orchestra.run.smithi026.stdout:Total 1.2 MB/s | 2.2 MB 00:01 2024-09-16T03:21:35.645 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:21:35.663 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:21:35.663 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:21:35.761 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:21:35.763 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:21:36.277 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:21:36.466 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T03:21:36.522 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T03:21:36.586 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T03:21:36.621 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T03:21:36.664 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T03:21:36.778 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T03:21:36.888 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T03:21:36.949 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T03:21:37.709 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T03:21:37.753 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T03:21:37.788 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T03:21:37.837 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T03:21:37.873 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:19.3.0-4930.gfc3e0bff.el9.noarch 13/13 2024-09-16T03:21:38.609 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4930.gfc3e0bff.el9.noarch 13/13 2024-09-16T03:21:38.609 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4930.gfc3e0bff.el9.noarch 1/13 2024-09-16T03:21:38.609 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T03:21:38.609 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T03:21:38.609 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T03:21:38.609 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T03:21:38.609 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T03:21:38.609 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T03:21:38.610 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T03:21:38.610 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T03:21:38.610 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T03:21:38.610 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T03:21:38.610 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T03:21:38.965 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T03:21:38.965 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:38.965 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:21:38.965 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:19.3.0-4930.gfc3e0bff.el9.noarch 2024-09-16T03:21:38.965 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T03:21:38.965 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T03:21:38.966 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T03:21:38.966 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T03:21:38.966 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T03:21:38.966 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T03:21:38.966 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T03:21:38.966 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T03:21:38.966 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T03:21:38.966 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T03:21:38.966 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T03:21:38.966 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T03:21:38.966 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:38.966 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:39.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T03:21:39.819 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:28 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:39.958 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:39.959 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:39.959 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-09-16T03:21:39.959 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:39.959 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:21:39.959 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4930.gfc3e0bff.el9 ceph-noarch 154 k 2024-09-16T03:21:39.959 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-09-16T03:21:39.960 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T03:21:39.960 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T03:21:39.960 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T03:21:39.960 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T03:21:39.960 INFO:teuthology.orchestra.run.smithi026.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T03:21:39.960 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:39.960 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:21:39.960 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:39.960 INFO:teuthology.orchestra.run.smithi026.stdout:Install 6 Packages 2024-09-16T03:21:39.960 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:39.961 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 7.0 M 2024-09-16T03:21:39.961 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 33 M 2024-09-16T03:21:39.961 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:21:40.287 INFO:teuthology.orchestra.run.smithi026.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-16T03:21:40.337 INFO:teuthology.orchestra.run.smithi026.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-16T03:21:40.363 INFO:teuthology.orchestra.run.smithi026.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-16T03:21:40.388 INFO:teuthology.orchestra.run.smithi026.stdout:(4/6): ceph-mgr-cephadm-19.3.0-4930.gfc3e0bff.e 658 kB/s | 154 kB 00:00 2024-09-16T03:21:40.422 INFO:teuthology.orchestra.run.smithi026.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-16T03:21:40.547 INFO:teuthology.orchestra.run.smithi026.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-16T03:21:40.549 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:21:40.549 INFO:teuthology.orchestra.run.smithi026.stdout:Total 12 MB/s | 7.0 MB 00:00 2024-09-16T03:21:40.622 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:21:40.634 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:21:40.634 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:21:40.739 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:21:40.740 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:21:41.056 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:21:41.236 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T03:21:41.285 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T03:21:41.839 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T03:21:41.929 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T03:21:42.005 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T03:21:42.044 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4930.gfc3e0bff.el9.noarch 6/6 2024-09-16T03:21:42.804 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4930.gfc3e0bff.el9.noarch 6/6 2024-09-16T03:21:42.804 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4930.gfc3e0bff.el9.noarch 1/6 2024-09-16T03:21:42.804 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T03:21:42.804 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T03:21:42.805 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T03:21:42.805 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T03:21:43.090 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T03:21:43.090 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:43.090 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:21:43.090 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:19.3.0-4930.gfc3e0bff.el9.noarch 2024-09-16T03:21:43.090 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T03:21:43.090 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T03:21:43.091 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T03:21:43.091 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T03:21:43.091 INFO:teuthology.orchestra.run.smithi026.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T03:21:43.091 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:43.091 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:43.337 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-fuse 2024-09-16T03:21:43.927 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:32 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:44.066 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:44.066 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:44.067 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-09-16T03:21:44.067 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:44.067 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:21:44.067 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 900 k 2024-09-16T03:21:44.067 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2024-09-16T03:21:44.067 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T03:21:44.067 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:44.067 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:21:44.067 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:44.067 INFO:teuthology.orchestra.run.smithi026.stdout:Install 2 Packages 2024-09-16T03:21:44.067 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:44.068 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 980 k 2024-09-16T03:21:44.068 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 2.9 M 2024-09-16T03:21:44.068 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:21:44.466 INFO:teuthology.orchestra.run.smithi026.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-09-16T03:21:44.599 INFO:teuthology.orchestra.run.smithi026.stdout:(2/2): ceph-fuse-19.3.0-4930.gfc3e0bff.el9.x86_ 3.1 MB/s | 900 kB 00:00 2024-09-16T03:21:44.599 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:21:44.599 INFO:teuthology.orchestra.run.smithi026.stdout:Total 1.8 MB/s | 980 kB 00:00 2024-09-16T03:21:44.611 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:21:44.635 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:21:44.635 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:21:44.722 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:21:44.722 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:21:45.038 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:21:45.191 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T03:21:45.267 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2/2 2024-09-16T03:21:46.005 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2/2 2024-09-16T03:21:46.006 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/2 2024-09-16T03:21:46.297 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T03:21:46.297 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:46.297 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:21:46.297 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:19.3.0-4930.gfc3e0bff.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T03:21:46.297 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:46.297 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:46.605 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-volume 2024-09-16T03:21:47.204 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:36 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:47.344 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:47.345 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:47.345 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2024-09-16T03:21:47.345 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:47.346 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:21:47.346 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume noarch 2:19.3.0-4930.gfc3e0bff.el9 ceph-noarch 285 k 2024-09-16T03:21:47.346 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:47.346 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:21:47.346 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:47.346 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-09-16T03:21:47.346 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:47.346 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 285 k 2024-09-16T03:21:47.346 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 1.3 M 2024-09-16T03:21:47.346 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:21:47.578 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-volume-19.3.0-4930.gfc3e0bff.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-16T03:21:47.579 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:21:47.579 INFO:teuthology.orchestra.run.smithi026.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-16T03:21:47.579 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:21:47.589 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:21:47.589 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:21:47.618 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:21:47.619 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:21:47.850 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:21:47.914 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-volume-2:19.3.0-4930.gfc3e0bff.el9.noarch 1/1 2024-09-16T03:21:47.931 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-volume-2:19.3.0-4930.gfc3e0bff.el9.noarch 1/1 2024-09-16T03:21:47.931 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T03:21:47.931 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T03:21:47.932 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:48.955 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-volume-2:19.3.0-4930.gfc3e0bff.el9.noarch 1/1 2024-09-16T03:21:48.955 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:48.955 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:21:48.955 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume-2:19.3.0-4930.gfc3e0bff.el9.noarch 2024-09-16T03:21:48.955 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:48.955 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:49.295 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install librados-devel 2024-09-16T03:21:49.900 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:38 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:50.040 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:50.041 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:50.041 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2024-09-16T03:21:50.041 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:50.041 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:21:50.041 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 127 k 2024-09-16T03:21:50.041 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:50.042 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:21:50.042 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:50.042 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-09-16T03:21:50.042 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:50.042 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 127 k 2024-09-16T03:21:50.042 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 456 k 2024-09-16T03:21:50.042 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:21:50.258 INFO:teuthology.orchestra.run.smithi026.stdout:librados-devel-19.3.0-4930.gfc3e0bff.el9.x86_64 586 kB/s | 127 kB 00:00 2024-09-16T03:21:50.259 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:21:50.259 INFO:teuthology.orchestra.run.smithi026.stdout:Total 582 kB/s | 127 kB 00:00 2024-09-16T03:21:50.259 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:21:50.265 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:21:50.265 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:21:50.333 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:21:50.333 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:21:50.492 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:21:50.600 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:21:51.026 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados-devel-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:21:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:21:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:51.446 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:21:51.446 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:21:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:51.447 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:51.703 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install libcephfs2 2024-09-16T03:21:52.307 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:41 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:52.401 INFO:teuthology.orchestra.run.smithi026.stdout:Package libcephfs2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 is already installed. 2024-09-16T03:21:52.446 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:52.447 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-09-16T03:21:52.447 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:52.514 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install libcephfs-devel 2024-09-16T03:21:53.111 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:42 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:53.252 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:53.252 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:53.252 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2024-09-16T03:21:53.252 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:53.252 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:21:53.252 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 32 k 2024-09-16T03:21:53.252 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:53.253 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:21:53.253 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:21:53.253 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-09-16T03:21:53.253 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:53.253 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 32 k 2024-09-16T03:21:53.253 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 142 k 2024-09-16T03:21:53.254 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:21:53.405 INFO:teuthology.orchestra.run.smithi026.stdout:libcephfs-devel-19.3.0-4930.gfc3e0bff.el9.x86_6 210 kB/s | 32 kB 00:00 2024-09-16T03:21:53.406 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:21:53.406 INFO:teuthology.orchestra.run.smithi026.stdout:Total 208 kB/s | 32 kB 00:00 2024-09-16T03:21:53.406 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:21:53.410 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:21:53.410 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:21:53.429 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:21:53.430 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:21:53.519 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:21:53.647 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:21:54.080 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:21:54.319 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:21:54.319 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:54.319 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:21:54.319 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:21:54.319 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:21:54.319 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:54.527 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install librados2 2024-09-16T03:21:55.117 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:44 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:55.210 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-2:19.3.0-4930.gfc3e0bff.el9.x86_64 is already installed. 2024-09-16T03:21:55.256 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:55.257 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-09-16T03:21:55.257 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:55.321 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install librbd1 2024-09-16T03:21:55.908 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:44 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:56.001 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-2:19.3.0-4930.gfc3e0bff.el9.x86_64 is already installed. 2024-09-16T03:21:56.047 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:56.048 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-09-16T03:21:56.048 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:56.121 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rados 2024-09-16T03:21:56.716 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:45 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:56.810 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rados-2:19.3.0-4930.gfc3e0bff.el9.x86_64 is already installed. 2024-09-16T03:21:56.857 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:56.858 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-09-16T03:21:56.858 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:56.930 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rgw 2024-09-16T03:21:57.516 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:46 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:57.611 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rgw-2:19.3.0-4930.gfc3e0bff.el9.x86_64 is already installed. 2024-09-16T03:21:57.657 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:57.658 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-09-16T03:21:57.658 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:57.734 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-cephfs 2024-09-16T03:21:58.332 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:47 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:58.426 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-cephfs-2:19.3.0-4930.gfc3e0bff.el9.x86_64 is already installed. 2024-09-16T03:21:58.472 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:58.473 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-09-16T03:21:58.473 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:58.550 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rbd 2024-09-16T03:21:59.142 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:48 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:21:59.236 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rbd-2:19.3.0-4930.gfc3e0bff.el9.x86_64 is already installed. 2024-09-16T03:21:59.283 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:21:59.284 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2024-09-16T03:21:59.284 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:21:59.358 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-fuse 2024-09-16T03:21:59.949 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:48 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:22:00.088 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:22:00.089 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:22:00.089 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-09-16T03:22:00.089 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:22:00.089 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:22:00.089 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 85 k 2024-09-16T03:22:00.089 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:00.090 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:22:00.090 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:22:00.090 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-09-16T03:22:00.090 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:00.090 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 85 k 2024-09-16T03:22:00.090 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 231 k 2024-09-16T03:22:00.090 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:22:00.283 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-fuse-19.3.0-4930.gfc3e0bff.el9.x86_64.rpm 442 kB/s | 85 kB 00:00 2024-09-16T03:22:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:22:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:Total 439 kB/s | 85 kB 00:00 2024-09-16T03:22:00.284 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:22:00.291 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:22:00.292 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:22:00.359 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:22:00.359 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:22:00.536 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:22:00.642 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:22:01.051 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:22:01.327 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:22:01.328 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:01.328 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:22:01.328 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:22:01.328 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:01.328 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:22:01.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-mirror 2024-09-16T03:22:02.276 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:51 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:22:02.425 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:22:02.426 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:22:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2024-09-16T03:22:02.426 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:22:02.426 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:22:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 3.2 M 2024-09-16T03:22:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:02.427 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:22:02.427 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:22:02.427 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-09-16T03:22:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:02.427 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 3.2 M 2024-09-16T03:22:02.427 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 14 M 2024-09-16T03:22:02.427 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:22:02.779 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-mirror-19.3.0-4930.gfc3e0bff.el9.x86_64.rpm 9.1 MB/s | 3.2 MB 00:00 2024-09-16T03:22:02.779 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:22:02.780 INFO:teuthology.orchestra.run.smithi026.stdout:Total 9.0 MB/s | 3.2 MB 00:00 2024-09-16T03:22:02.780 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:22:02.790 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:22:02.790 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:22:02.877 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:22:02.877 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:22:03.341 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:22:03.396 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:22:03.423 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:22:03.423 INFO:teuthology.orchestra.run.smithi026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T03:22:03.423 INFO:teuthology.orchestra.run.smithi026.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T03:22:03.423 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T03:22:03.423 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T03:22:03.424 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:04.511 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:22:04.511 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:04.511 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:22:04.511 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:22:04.511 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:04.511 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:22:04.778 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-nbd 2024-09-16T03:22:05.379 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:54 ago on Mon 16 Sep 2024 03:20:11 AM UTC. 2024-09-16T03:22:05.520 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2024-09-16T03:22:05.521 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:22:05.521 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2024-09-16T03:22:05.521 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:22:05.521 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2024-09-16T03:22:05.521 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:19.3.0-4930.gfc3e0bff.el9 ceph 170 k 2024-09-16T03:22:05.521 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:05.521 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2024-09-16T03:22:05.521 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2024-09-16T03:22:05.521 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2024-09-16T03:22:05.521 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:05.521 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 170 k 2024-09-16T03:22:05.521 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 490 k 2024-09-16T03:22:05.522 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2024-09-16T03:22:05.732 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-nbd-19.3.0-4930.gfc3e0bff.el9.x86_64.rpm 810 kB/s | 170 kB 00:00 2024-09-16T03:22:05.733 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2024-09-16T03:22:05.733 INFO:teuthology.orchestra.run.smithi026.stdout:Total 804 kB/s | 170 kB 00:00 2024-09-16T03:22:05.733 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2024-09-16T03:22:05.742 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2024-09-16T03:22:05.742 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2024-09-16T03:22:05.810 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2024-09-16T03:22:05.811 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2024-09-16T03:22:05.970 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2024-09-16T03:22:06.084 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:22:06.511 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:22:06.785 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:19.3.0-4930.gfc3e0bff.el9.x86_64 1/1 2024-09-16T03:22:06.785 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:06.785 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2024-09-16T03:22:06.785 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:19.3.0-4930.gfc3e0bff.el9.x86_64 2024-09-16T03:22:06.785 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-09-16T03:22:06.785 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2024-09-16T03:22:07.038 DEBUG:teuthology.parallel:result is None 2024-09-16T03:22:07.039 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fc3e0bff7468fd55478adbae7f75508b749124b6 2024-09-16T03:22:07.183 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T03:22:07.205 INFO:teuthology.orchestra.run.smithi026.stdout:19.3.0-4930.gfc3e0bff.el9 2024-09-16T03:22:07.206 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4930.gfc3e0bff.el9 2024-09-16T03:22:07.206 INFO:teuthology.task.install:The correct ceph version 19.3.0-4930.gfc3e0bff is installed. 2024-09-16T03:22:07.208 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T03:22:07.208 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-16T03:22:07.208 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T03:22:07.272 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T03:22:07.272 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-16T03:22:07.273 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T03:22:07.339 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T03:22:07.405 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T03:22:07.405 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-16T03:22:07.406 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T03:22:07.471 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T03:22:07.536 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T03:22:07.536 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-16T03:22:07.536 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T03:22:07.601 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T03:22:07.667 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T03:22:07.686 INFO:tasks.workunit:Pulling workunits from ref 7498493279982dfe87f00616198a5967475f6169 2024-09-16T03:22:07.687 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T03:22:07.687 INFO:tasks.workunit:timeout=3h 2024-09-16T03:22:07.687 INFO:tasks.workunit:cleanup=True 2024-09-16T03:22:07.687 DEBUG:teuthology.orchestra.run.smithi026:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T03:22:07.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T03:22:07.724 INFO:teuthology.orchestra.run.smithi026.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-16T03:22:07.724 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T03:22:07.779 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-16T03:22:07.779 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-16T03:22:07.835 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7498493279982dfe87f00616198a5967475f6169 2024-09-16T03:22:07.891 INFO:tasks.workunit.client.0.smithi026.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T03:23:03.427 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 93% (12115/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-16T03:23:03.855 INFO:tasks.workunit.client.0.smithi026.stderr:Note: switching to '7498493279982dfe87f00616198a5967475f6169'. 2024-09-16T03:23:03.855 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-09-16T03:23:03.855 INFO:tasks.workunit.client.0.smithi026.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T03:23:03.855 INFO:tasks.workunit.client.0.smithi026.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T03:23:03.855 INFO:tasks.workunit.client.0.smithi026.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T03:23:03.855 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-09-16T03:23:03.855 INFO:tasks.workunit.client.0.smithi026.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T03:23:03.856 INFO:tasks.workunit.client.0.smithi026.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T03:23:03.856 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-09-16T03:23:03.856 INFO:tasks.workunit.client.0.smithi026.stderr: git switch -c 2024-09-16T03:23:03.856 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-09-16T03:23:03.856 INFO:tasks.workunit.client.0.smithi026.stderr:Or undo this operation with: 2024-09-16T03:23:03.856 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-09-16T03:23:03.856 INFO:tasks.workunit.client.0.smithi026.stderr: git switch - 2024-09-16T03:23:03.856 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-09-16T03:23:03.856 INFO:tasks.workunit.client.0.smithi026.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T03:23:03.856 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-09-16T03:23:03.856 INFO:tasks.workunit.client.0.smithi026.stderr:HEAD is now at 74984932799 Merge pull request #59797 from zdover23/wip-doc-2024-09-15-install-install-storage-cluster 2024-09-16T03:23:03.858 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T03:23:03.914 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-09-16T03:23:03.914 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T03:23:03.971 INFO:tasks.workunit:Running workunits matching osd-backfill on client.0... 2024-09-16T03:23:03.972 INFO:tasks.workunit:Running workunit osd-backfill/osd-backfill-prio.sh... 2024-09-16T03:23:03.972 DEBUG:teuthology.orchestra.run.smithi026:workunit test osd-backfill/osd-backfill-prio.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh 2024-09-16T03:23:04.069 INFO:tasks.workunit.client.0.smithi026.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:23:04.075 INFO:tasks.workunit.client.0.smithi026.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:23:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-16T03:23:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-16T03:23:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:23:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:23:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:23:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:23:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:23:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:23:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/osd-backfill-prio 2024-09-16T03:23:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:21: run: local dir=td/osd-backfill-prio 2024-09-16T03:23:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:22: run: shift 2024-09-16T03:23:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:25: run: export CEPH_MON=127.0.0.1:7114 2024-09-16T03:23:04.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:25: run: CEPH_MON=127.0.0.1:7114 2024-09-16T03:23:04.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:26: run: export CEPH_ARGS 2024-09-16T03:23:04.077 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:27: run: uuidgen 2024-09-16T03:23:04.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:27: run: CEPH_ARGS+='--fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none ' 2024-09-16T03:23:04.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 ' 2024-09-16T03:23:04.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:29: run: CEPH_ARGS+='--osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T03:23:04.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:32: run: CEPH_ARGS+='--osd-op-queue=wpq ' 2024-09-16T03:23:04.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:33: run: export objects=50 2024-09-16T03:23:04.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:33: run: objects=50 2024-09-16T03:23:04.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:34: run: export poolprefix=test 2024-09-16T03:23:04.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:34: run: poolprefix=test 2024-09-16T03:23:04.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:35: run: export FORCE_PRIO=254 2024-09-16T03:23:04.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:35: run: FORCE_PRIO=254 2024-09-16T03:23:04.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:36: run: export DEGRADED_PRIO=150 2024-09-16T03:23:04.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:36: run: DEGRADED_PRIO=150 2024-09-16T03:23:04.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:37: run: export NORMAL_PRIO=110 2024-09-16T03:23:04.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:37: run: NORMAL_PRIO=110 2024-09-16T03:23:04.088 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:39: run: set 2024-09-16T03:23:04.088 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:39: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:23:04.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:39: run: local 'funcs=TEST_backfill_pool_priority 2024-09-16T03:23:04.090 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_priority' 2024-09-16T03:23:04.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:40: run: for func in $funcs 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:41: run: setup td/osd-backfill-prio 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-prio 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-prio 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-prio 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-prio KILL 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:23:04.091 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:23:04.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:23:04.092 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:23:04.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:23:04.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:23:04.093 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:23:04.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:23:04.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:23:04.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:23:04.094 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:23:04.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:23:04.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:23:04.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-prio 2024-09-16T03:23:04.097 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:23:04.097 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:23:04.097 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:23:04.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.27283 2024-09-16T03:23:04.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:23:04.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:23:04.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-prio 2024-09-16T03:23:04.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:23:04.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:23:04.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:23:04.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.27283 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-prio 1' TERM HUP INT 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:42: run: TEST_backfill_pool_priority td/osd-backfill-prio 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:329: TEST_backfill_pool_priority: local dir=td/osd-backfill-prio 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:330: TEST_backfill_pool_priority: local pools=3 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:331: TEST_backfill_pool_priority: local OSDS=2 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:333: TEST_backfill_pool_priority: run_mon td/osd-backfill-prio a 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-prio 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:23:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:23:04.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:23:04.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-prio/a 2024-09-16T03:23:04.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-prio/a --run-dir=td/osd-backfill-prio 2024-09-16T03:23:04.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:23:04.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:23:04.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:23:04.563 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:23:04.564 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:23:04.564 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:23:04.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:23:04.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-prio/a '--log-file=td/osd-backfill-prio/$name.log' '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-prio/log --run-dir=td/osd-backfill-prio '--pid-file=td/osd-backfill-prio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:23:04.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:23:04.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:23:04.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:23:04.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:23:04.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:23:04.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:23:04.767 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:23:04.767 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:23:04.767 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:23:04.767 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:23:04.767 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:23:04.767 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:23:04.767 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-mon.a.asok 2024-09-16T03:23:04.768 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:23:04.768 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.27283/ceph-mon.a.asok config get fsid 2024-09-16T03:23:04.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:23:04.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:23:04.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:23:04.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:23:04.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:23:04.855 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:23:04.855 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:23:04.855 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:23:04.855 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:23:04.855 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:23:04.855 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:23:04.855 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-mon.a.asok 2024-09-16T03:23:04.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:23:04.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.27283/ceph-mon.a.asok config get mon_host 2024-09-16T03:23:04.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:334: TEST_backfill_pool_priority: run_mgr td/osd-backfill-prio x 2024-09-16T03:23:04.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-prio 2024-09-16T03:23:04.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:23:04.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:23:04.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:23:04.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-prio/x 2024-09-16T03:23:04.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:23:05.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:23:05.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:23:05.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:23:05.807 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:23:05.807 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:23:05.807 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:23:05.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:23:05.808 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:23:05.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-prio/x '--log-file=td/osd-backfill-prio/$name.log' '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --run-dir=td/osd-backfill-prio '--pid-file=td/osd-backfill-prio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:23:05.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:335: TEST_backfill_pool_priority: export CEPH_ARGS 2024-09-16T03:23:05.841 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:337: TEST_backfill_pool_priority: expr 2 - 1 2024-09-16T03:23:05.842 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:337: TEST_backfill_pool_priority: seq 0 1 2024-09-16T03:23:05.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:337: TEST_backfill_pool_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:339: TEST_backfill_pool_priority: run_osd td/osd-backfill-prio 0 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-prio 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-prio/0 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/0' 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/0/journal' 2024-09-16T03:23:05.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:23:05.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:23:05.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-09-16T03:23:05.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-09-16T03:23:05.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:23:05.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:23:05.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:23:05.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:23:05.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:23:05.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:23:05.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-prio/0 2024-09-16T03:23:05.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:23:05.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b4b1a78b-1982-4407-8e86-58348b14438b 2024-09-16T03:23:05.886 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 b4b1a78b-1982-4407-8e86-58348b14438b 2024-09-16T03:23:05.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b4b1a78b-1982-4407-8e86-58348b14438b' 2024-09-16T03:23:05.887 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:23:05.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCZpOdm6MvyNRAAnAbusds8ccmogt1cix1Taw== 2024-09-16T03:23:05.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCZpOdm6MvyNRAAnAbusds8ccmogt1cix1Taw=="}' 2024-09-16T03:23:05.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b4b1a78b-1982-4407-8e86-58348b14438b -i td/osd-backfill-prio/0/new.json 2024-09-16T03:23:06.175 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:23:06.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-prio/0/new.json 2024-09-16T03:23:06.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/0 --osd-journal=td/osd-backfill-prio/0/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCZpOdm6MvyNRAAnAbusds8ccmogt1cix1Taw== --osd-uuid b4b1a78b-1982-4407-8e86-58348b14438b 2024-09-16T03:23:06.285 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:06.283+0000 7f771974f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:06.294 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:06.292+0000 7f771974f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:06.295 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:06.293+0000 7f771974f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:06.296 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:06.294+0000 7f771974f640 -1 bdev(0x555ad518fc00 td/osd-backfill-prio/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:23:06.296 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:06.294+0000 7f771974f640 -1 bluestore(td/osd-backfill-prio/0) _read_fsid unparsable uuid 2024-09-16T03:23:12.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-prio/0/keyring 2024-09-16T03:23:12.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:23:12.026 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T03:23:12.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:23:12.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-prio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:23:12.594 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T03:23:12.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:23:12.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/0 --osd-journal=td/osd-backfill-prio/0/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:23:12.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:23:12.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:23:12.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:23:12.629 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:12.627+0000 7fa99200d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:12.630 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:12.629+0000 7fa99200d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:12.631 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:12.630+0000 7fa99200d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:13.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:23:13.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:23:13.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:23:13.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:23:13.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:23:13.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:13.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:23:13.051 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:23:13.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:13.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:13.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:13.983 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:13.981+0000 7fa99200d640 -1 Falling back to public interface 2024-09-16T03:23:14.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:14.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:14.486 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:23:14.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:23:14.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:14.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:14.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:15.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:15.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:15.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:23:15.930 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:23:15.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:15.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:16.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:17.000 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:16.998+0000 7fa99200d640 -1 osd.0 0 log_to_monitors true 2024-09-16T03:23:17.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:17.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:17.389 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:23:17.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:23:17.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:17.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:23:17.836 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3960009541,v1:127.0.0.1:6803/3960009541] [v2:127.0.0.1:6804/3960009541,v1:127.0.0.1:6805/3960009541] exists,up b4b1a78b-1982-4407-8e86-58348b14438b 2024-09-16T03:23:17.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:23:17.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:23:17.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:23:17.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:337: TEST_backfill_pool_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:23:17.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:339: TEST_backfill_pool_priority: run_osd td/osd-backfill-prio 1 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-prio 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-prio/1 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/1' 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/1/journal' 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:23:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:23:17.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-09-16T03:23:17.842 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:23:17.842 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:23:17.842 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:23:17.842 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:23:17.842 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:23:17.842 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:23:17.842 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:23:17.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:23:17.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:23:17.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:23:17.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:23:17.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-09-16T03:23:17.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-09-16T03:23:17.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:23:17.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:23:17.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:23:17.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:23:17.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:23:17.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:23:17.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-prio/1 2024-09-16T03:23:17.844 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:23:17.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c73eddce-5e81-42a5-aa28-48faa502d8a3 2024-09-16T03:23:17.844 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 c73eddce-5e81-42a5-aa28-48faa502d8a3 2024-09-16T03:23:17.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 c73eddce-5e81-42a5-aa28-48faa502d8a3' 2024-09-16T03:23:17.845 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:23:17.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQClpOdmAVpZMxAA+Lem10SiX5fOMsxw6tZxtA== 2024-09-16T03:23:17.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQClpOdmAVpZMxAA+Lem10SiX5fOMsxw6tZxtA=="}' 2024-09-16T03:23:17.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c73eddce-5e81-42a5-aa28-48faa502d8a3 -i td/osd-backfill-prio/1/new.json 2024-09-16T03:23:18.418 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:23:18.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-prio/1/new.json 2024-09-16T03:23:18.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/1 --osd-journal=td/osd-backfill-prio/1/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQClpOdmAVpZMxAA+Lem10SiX5fOMsxw6tZxtA== --osd-uuid c73eddce-5e81-42a5-aa28-48faa502d8a3 2024-09-16T03:23:18.466 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:18.464+0000 7f4145c10640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:18.477 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:18.475+0000 7f4145c10640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:18.478 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:18.476+0000 7f4145c10640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:18.479 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:18.477+0000 7f4145c10640 -1 bdev(0x5564a9a9bc00 td/osd-backfill-prio/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:23:18.479 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:18.477+0000 7f4145c10640 -1 bluestore(td/osd-backfill-prio/1) _read_fsid unparsable uuid 2024-09-16T03:23:24.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-prio/1/keyring 2024-09-16T03:23:24.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:23:24.392 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T03:23:24.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:23:24.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-prio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:23:24.961 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T03:23:24.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:23:24.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/1 --osd-journal=td/osd-backfill-prio/1/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:23:24.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:23:24.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:23:24.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:23:24.995 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:24.993+0000 7f61e16fe640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:24.997 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:24.995+0000 7f61e16fe640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:24.998 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:24.996+0000 7f61e16fe640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:23:25.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:23:25.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:23:25.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:23:25.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:23:25.405 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:23:25.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:23:25.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:25.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:23:25.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:25.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:25.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:26.338 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:26.336+0000 7f61e16fe640 -1 Falling back to public interface 2024-09-16T03:23:26.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:26.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:26.863 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:23:26.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:23:26.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:26.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:27.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:28.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:28.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:28.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:23:28.317 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:23:28.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:28.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:28.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:23:29.296 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:23:29.294+0000 7f61e16fe640 -1 osd.1 0 log_to_monitors true 2024-09-16T03:23:29.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:23:29.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:23:29.738 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:23:29.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:23:29.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:23:29.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:23:30.237 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/519880910,v1:127.0.0.1:6811/519880910] [v2:127.0.0.1:6812/519880910,v1:127.0.0.1:6813/519880910] exists,up c73eddce-5e81-42a5-aa28-48faa502d8a3 2024-09-16T03:23:30.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:23:30.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:23:30.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:23:30.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:342: TEST_backfill_pool_priority: seq 1 3 2024-09-16T03:23:30.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:342: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-09-16T03:23:30.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:344: TEST_backfill_pool_priority: create_pool test1 1 1 2024-09-16T03:23:30.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test1 1 1 2024-09-16T03:23:30.856 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' already exists 2024-09-16T03:23:30.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:23:31.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:345: TEST_backfill_pool_priority: ceph osd pool set test1 size 2 2024-09-16T03:23:32.639 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 2 2024-09-16T03:23:32.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:342: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-09-16T03:23:32.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:344: TEST_backfill_pool_priority: create_pool test2 1 1 2024-09-16T03:23:32.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test2 1 1 2024-09-16T03:23:33.657 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' already exists 2024-09-16T03:23:33.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:23:34.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:345: TEST_backfill_pool_priority: ceph osd pool set test2 size 2 2024-09-16T03:23:36.034 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 2 size to 2 2024-09-16T03:23:36.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:342: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-09-16T03:23:36.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:344: TEST_backfill_pool_priority: create_pool test3 1 1 2024-09-16T03:23:36.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test3 1 1 2024-09-16T03:23:36.949 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test3' already exists 2024-09-16T03:23:36.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:23:37.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:345: TEST_backfill_pool_priority: ceph osd pool set test3 size 2 2024-09-16T03:23:38.730 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 3 size to 2 2024-09-16T03:23:38.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:347: TEST_backfill_pool_priority: sleep 5 2024-09-16T03:23:43.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:349: TEST_backfill_pool_priority: wait_for_clean 2024-09-16T03:23:43.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:23:43.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:23:43.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:23:43.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:23:43.745 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:23:43.745 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:23:43.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:23:43.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:23:43.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:23:43.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:23:43.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:23:43.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:23:43.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:23:43.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:23:43.845 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:23:44.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:23:44.291 INFO:tasks.workunit.client.0.smithi026.stderr:1' 2024-09-16T03:23:44.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:23:44.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:23:44.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:23:44.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836488 2024-09-16T03:23:44.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836488 2024-09-16T03:23:44.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836488' 2024-09-16T03:23:44.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:23:44.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:23:44.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672965 2024-09-16T03:23:44.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672965 2024-09-16T03:23:44.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836488 1-42949672965' 2024-09-16T03:23:44.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:23:44.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836488 2024-09-16T03:23:44.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:23:44.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:23:44.539 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836488 2024-09-16T03:23:44.539 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:23:44.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836488 2024-09-16T03:23:44.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2024-09-16T03:23:44.540 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836488 2024-09-16T03:23:44.540 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:23:44.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836486 -lt 21474836488 2024-09-16T03:23:44.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:23:45.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:23:45.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:23:46.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836488 -lt 21474836488 2024-09-16T03:23:46.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:23:46.436 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672965 2024-09-16T03:23:46.436 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:23:46.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:23:46.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672965 2024-09-16T03:23:46.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:23:46.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672965 2024-09-16T03:23:46.439 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672965 2024-09-16T03:23:46.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2024-09-16T03:23:46.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:23:46.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672965 -lt 42949672965 2024-09-16T03:23:46.912 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:23:46.912 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:23:46.912 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:23:47.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 3 == 0 2024-09-16T03:23:47.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:23:47.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:23:47.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:23:47.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:23:47.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:23:47.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:23:47.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:23:47.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=3 2024-09-16T03:23:47.879 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:23:47.879 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:23:47.879 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:23:48.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 3 = 3 2024-09-16T03:23:48.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:23:48.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:23:48.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:351: TEST_backfill_pool_priority: ceph pg dump pgs 2024-09-16T03:23:48.867 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T03:23:48.867 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:23:38.981676+0000 0'0 23:21 [1,0] 1 [1,0] 1 0'0 2024-09-16T03:23:36.427281+0000 0'0 2024-09-16T03:23:36.427281+0000 0 0 periodic scrub scheduled @ 2024-09-17T11:07:56.864752+0000 0 0 2024-09-16T03:23:48.867 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:23:36.385934+0000 0'0 23:22 [0,1] 0 [0,1] 0 0'0 2024-09-16T03:23:33.025695+0000 0'0 2024-09-16T03:23:33.025695+0000 0 0 periodic scrub scheduled @ 2024-09-17T10:52:26.184750+0000 0 0 2024-09-16T03:23:48.867 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:23:32.831191+0000 0'0 23:34 [1,0] 1 [1,0] 1 0'0 2024-09-16T03:23:30.689827+0000 0'0 2024-09-16T03:23:30.689827+0000 0 0 periodic scrub scheduled @ 2024-09-17T06:32:13.726484+0000 0 0 2024-09-16T03:23:48.868 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T03:23:48.868 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T03:23:48.868 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:23:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:355: TEST_backfill_pool_priority: local PG1 2024-09-16T03:23:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:356: TEST_backfill_pool_priority: local POOLNUM1 2024-09-16T03:23:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:357: TEST_backfill_pool_priority: local pool1 2024-09-16T03:23:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:358: TEST_backfill_pool_priority: local chk_osd1_1 2024-09-16T03:23:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:359: TEST_backfill_pool_priority: local chk_osd1_2 2024-09-16T03:23:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:361: TEST_backfill_pool_priority: local PG2 2024-09-16T03:23:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:362: TEST_backfill_pool_priority: local POOLNUM2 2024-09-16T03:23:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:363: TEST_backfill_pool_priority: local pool2 2024-09-16T03:23:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:364: TEST_backfill_pool_priority: local chk_osd2_1 2024-09-16T03:23:48.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:365: TEST_backfill_pool_priority: local chk_osd2_2 2024-09-16T03:23:48.880 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:367: TEST_backfill_pool_priority: seq 1 3 2024-09-16T03:23:48.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:367: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-09-16T03:23:48.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:369: TEST_backfill_pool_priority: ceph pg map 1.0 --format=json 2024-09-16T03:23:48.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:369: TEST_backfill_pool_priority: jq '.acting[]' 2024-09-16T03:23:49.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:370: TEST_backfill_pool_priority: head -1 td/osd-backfill-prio/acting 2024-09-16T03:23:49.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:370: TEST_backfill_pool_priority: local test_osd1=1 2024-09-16T03:23:49.360 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:371: TEST_backfill_pool_priority: tail -1 td/osd-backfill-prio/acting 2024-09-16T03:23:49.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:371: TEST_backfill_pool_priority: local test_osd2=0 2024-09-16T03:23:49.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:372: TEST_backfill_pool_priority: '[' -z '' ']' 2024-09-16T03:23:49.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:374: TEST_backfill_pool_priority: PG1=1.0 2024-09-16T03:23:49.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:375: TEST_backfill_pool_priority: POOLNUM1=1 2024-09-16T03:23:49.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:376: TEST_backfill_pool_priority: pool1=test1 2024-09-16T03:23:49.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:377: TEST_backfill_pool_priority: chk_osd1_1=1 2024-09-16T03:23:49.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:378: TEST_backfill_pool_priority: chk_osd1_2=0 2024-09-16T03:23:49.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:367: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-09-16T03:23:49.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:369: TEST_backfill_pool_priority: ceph pg map 2.0 --format=json 2024-09-16T03:23:49.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:369: TEST_backfill_pool_priority: jq '.acting[]' 2024-09-16T03:23:49.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:370: TEST_backfill_pool_priority: head -1 td/osd-backfill-prio/acting 2024-09-16T03:23:49.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:370: TEST_backfill_pool_priority: local test_osd1=0 2024-09-16T03:23:49.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:371: TEST_backfill_pool_priority: tail -1 td/osd-backfill-prio/acting 2024-09-16T03:23:49.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:371: TEST_backfill_pool_priority: local test_osd2=1 2024-09-16T03:23:49.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:372: TEST_backfill_pool_priority: '[' -z 1.0 ']' 2024-09-16T03:23:49.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:379: TEST_backfill_pool_priority: '[' 1 '!=' 0 ']' 2024-09-16T03:23:49.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:381: TEST_backfill_pool_priority: PG2=2.0 2024-09-16T03:23:49.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:382: TEST_backfill_pool_priority: POOLNUM2=2 2024-09-16T03:23:49.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:383: TEST_backfill_pool_priority: pool2=test2 2024-09-16T03:23:49.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:384: TEST_backfill_pool_priority: chk_osd2_1=0 2024-09-16T03:23:49.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:385: TEST_backfill_pool_priority: chk_osd2_2=1 2024-09-16T03:23:49.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:386: TEST_backfill_pool_priority: break 2024-09-16T03:23:49.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:389: TEST_backfill_pool_priority: rm -f td/osd-backfill-prio/acting 2024-09-16T03:23:49.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:391: TEST_backfill_pool_priority: '[' test2 = '' ']' 2024-09-16T03:23:49.835 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:397: TEST_backfill_pool_priority: seq 1 3 2024-09-16T03:23:49.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:397: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-09-16T03:23:49.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:399: TEST_backfill_pool_priority: '[' 1 '!=' 1 -a 1 '!=' 2 ']' 2024-09-16T03:23:49.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:397: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-09-16T03:23:49.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:399: TEST_backfill_pool_priority: '[' 2 '!=' 1 -a 2 '!=' 2 ']' 2024-09-16T03:23:49.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:397: TEST_backfill_pool_priority: for p in $(seq 1 $pools) 2024-09-16T03:23:49.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:399: TEST_backfill_pool_priority: '[' 3 '!=' 1 -a 3 '!=' 2 ']' 2024-09-16T03:23:49.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:401: TEST_backfill_pool_priority: delete_pool test3 2024-09-16T03:23:49.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test3 2024-09-16T03:23:49.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test3 test3 --yes-i-really-really-mean-it 2024-09-16T03:23:50.416 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test3' does not exist 2024-09-16T03:23:50.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:405: TEST_backfill_pool_priority: pool1_extra_prio=1 2024-09-16T03:23:50.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:406: TEST_backfill_pool_priority: pool2_extra_prio=2 2024-09-16T03:23:50.428 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:408: TEST_backfill_pool_priority: expr 150 + 1 + 1 2024-09-16T03:23:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:408: TEST_backfill_pool_priority: pool1_prio=152 2024-09-16T03:23:50.429 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:409: TEST_backfill_pool_priority: expr 150 + 1 + 2 2024-09-16T03:23:50.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:409: TEST_backfill_pool_priority: pool2_prio=153 2024-09-16T03:23:50.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:411: TEST_backfill_pool_priority: ceph osd pool set test1 size 1 --yes-i-really-mean-it 2024-09-16T03:23:51.191 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 1 2024-09-16T03:23:51.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:412: TEST_backfill_pool_priority: ceph osd pool set test1 recovery_priority 1 2024-09-16T03:23:51.999 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 recovery_priority to 1 2024-09-16T03:23:52.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:413: TEST_backfill_pool_priority: ceph osd pool set test2 size 1 --yes-i-really-mean-it 2024-09-16T03:23:53.046 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 2 size to 1 2024-09-16T03:23:53.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:414: TEST_backfill_pool_priority: ceph osd pool set test2 recovery_priority 2 2024-09-16T03:23:53.758 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 2 recovery_priority to 2 2024-09-16T03:23:53.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:415: TEST_backfill_pool_priority: wait_for_clean 2024-09-16T03:23:53.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:23:53.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:23:53.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:23:53.771 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:23:53.771 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:23:53.771 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:23:53.771 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:23:53.772 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:23:53.772 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:23:53.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:23:53.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:23:53.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:23:53.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:23:53.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:23:53.861 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:23:54.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:23:54.300 INFO:tasks.workunit.client.0.smithi026.stderr:1' 2024-09-16T03:23:54.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:23:54.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:23:54.300 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:23:54.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836492 2024-09-16T03:23:54.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836492 2024-09-16T03:23:54.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836492' 2024-09-16T03:23:54.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:23:54.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:23:54.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672969 2024-09-16T03:23:54.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672969 2024-09-16T03:23:54.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836492 1-42949672969' 2024-09-16T03:23:54.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:23:54.589 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836492 2024-09-16T03:23:54.589 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:23:54.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:23:54.590 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836492 2024-09-16T03:23:54.590 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:23:54.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836492 2024-09-16T03:23:54.592 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836492 2024-09-16T03:23:54.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2024-09-16T03:23:54.592 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:23:55.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836490 -lt 21474836492 2024-09-16T03:23:55.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:23:56.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:23:56.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:23:56.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836492 -lt 21474836492 2024-09-16T03:23:56.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:23:56.494 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672969 2024-09-16T03:23:56.494 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:23:56.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:23:56.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672969 2024-09-16T03:23:56.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:23:56.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672969 2024-09-16T03:23:56.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2024-09-16T03:23:56.497 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672969 2024-09-16T03:23:56.497 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:23:56.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672969 -lt 42949672969 2024-09-16T03:23:56.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:23:56.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:23:56.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:23:57.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 2 == 0 2024-09-16T03:23:57.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:23:57.484 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:23:57.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:23:57.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:23:57.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:23:57.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:23:57.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:23:57.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:23:57.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:23:57.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:23:57.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:23:58.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 2 2024-09-16T03:23:58.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:23:58.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:23:58.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:417: TEST_backfill_pool_priority: dd if=/dev/urandom of=td/osd-backfill-prio/data bs=1M count=10 2024-09-16T03:23:58.498 INFO:tasks.workunit.client.0.smithi026.stderr:10+0 records in 2024-09-16T03:23:58.498 INFO:tasks.workunit.client.0.smithi026.stderr:10+0 records out 2024-09-16T03:23:58.498 INFO:tasks.workunit.client.0.smithi026.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0281387 s, 373 MB/s 2024-09-16T03:23:58.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:418: TEST_backfill_pool_priority: p=1 2024-09-16T03:23:58.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:419: TEST_backfill_pool_priority: for pname in $pool1 $pool2 2024-09-16T03:23:58.498 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: seq 1 50 2024-09-16T03:23:58.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:23:58.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj1-p1 td/osd-backfill-prio/data 2024-09-16T03:23:58.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:23:58.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj2-p1 td/osd-backfill-prio/data 2024-09-16T03:23:59.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:23:59.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj3-p1 td/osd-backfill-prio/data 2024-09-16T03:23:59.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:23:59.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj4-p1 td/osd-backfill-prio/data 2024-09-16T03:24:00.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:00.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj5-p1 td/osd-backfill-prio/data 2024-09-16T03:24:00.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:00.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj6-p1 td/osd-backfill-prio/data 2024-09-16T03:24:00.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:00.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj7-p1 td/osd-backfill-prio/data 2024-09-16T03:24:01.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:01.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj8-p1 td/osd-backfill-prio/data 2024-09-16T03:24:01.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:01.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj9-p1 td/osd-backfill-prio/data 2024-09-16T03:24:02.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:02.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj10-p1 td/osd-backfill-prio/data 2024-09-16T03:24:02.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:02.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj11-p1 td/osd-backfill-prio/data 2024-09-16T03:24:02.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:02.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj12-p1 td/osd-backfill-prio/data 2024-09-16T03:24:03.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:03.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj13-p1 td/osd-backfill-prio/data 2024-09-16T03:24:03.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:03.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj14-p1 td/osd-backfill-prio/data 2024-09-16T03:24:04.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:04.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj15-p1 td/osd-backfill-prio/data 2024-09-16T03:24:04.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:04.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj16-p1 td/osd-backfill-prio/data 2024-09-16T03:24:04.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:04.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj17-p1 td/osd-backfill-prio/data 2024-09-16T03:24:05.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:05.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj18-p1 td/osd-backfill-prio/data 2024-09-16T03:24:05.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:05.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj19-p1 td/osd-backfill-prio/data 2024-09-16T03:24:05.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:05.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj20-p1 td/osd-backfill-prio/data 2024-09-16T03:24:06.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:06.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj21-p1 td/osd-backfill-prio/data 2024-09-16T03:24:06.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:06.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj22-p1 td/osd-backfill-prio/data 2024-09-16T03:24:07.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:07.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj23-p1 td/osd-backfill-prio/data 2024-09-16T03:24:07.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:07.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj24-p1 td/osd-backfill-prio/data 2024-09-16T03:24:07.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:07.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj25-p1 td/osd-backfill-prio/data 2024-09-16T03:24:08.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:08.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj26-p1 td/osd-backfill-prio/data 2024-09-16T03:24:08.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:08.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj27-p1 td/osd-backfill-prio/data 2024-09-16T03:24:08.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:08.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj28-p1 td/osd-backfill-prio/data 2024-09-16T03:24:09.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:09.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj29-p1 td/osd-backfill-prio/data 2024-09-16T03:24:09.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:09.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj30-p1 td/osd-backfill-prio/data 2024-09-16T03:24:10.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:10.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj31-p1 td/osd-backfill-prio/data 2024-09-16T03:24:10.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:10.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj32-p1 td/osd-backfill-prio/data 2024-09-16T03:24:10.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:10.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj33-p1 td/osd-backfill-prio/data 2024-09-16T03:24:11.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:11.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj34-p1 td/osd-backfill-prio/data 2024-09-16T03:24:11.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj35-p1 td/osd-backfill-prio/data 2024-09-16T03:24:12.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:12.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj36-p1 td/osd-backfill-prio/data 2024-09-16T03:24:12.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:12.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj37-p1 td/osd-backfill-prio/data 2024-09-16T03:24:12.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:12.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj38-p1 td/osd-backfill-prio/data 2024-09-16T03:24:13.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:13.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj39-p1 td/osd-backfill-prio/data 2024-09-16T03:24:13.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:13.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj40-p1 td/osd-backfill-prio/data 2024-09-16T03:24:14.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:14.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj41-p1 td/osd-backfill-prio/data 2024-09-16T03:24:14.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:14.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj42-p1 td/osd-backfill-prio/data 2024-09-16T03:24:14.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:14.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj43-p1 td/osd-backfill-prio/data 2024-09-16T03:24:15.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:15.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj44-p1 td/osd-backfill-prio/data 2024-09-16T03:24:15.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:15.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj45-p1 td/osd-backfill-prio/data 2024-09-16T03:24:15.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:15.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj46-p1 td/osd-backfill-prio/data 2024-09-16T03:24:16.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:16.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj47-p1 td/osd-backfill-prio/data 2024-09-16T03:24:16.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:16.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj48-p1 td/osd-backfill-prio/data 2024-09-16T03:24:16.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:16.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj49-p1 td/osd-backfill-prio/data 2024-09-16T03:24:17.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:17.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test1 put obj50-p1 td/osd-backfill-prio/data 2024-09-16T03:24:17.677 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:425: TEST_backfill_pool_priority: expr 1 + 1 2024-09-16T03:24:17.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:425: TEST_backfill_pool_priority: p=2 2024-09-16T03:24:17.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:419: TEST_backfill_pool_priority: for pname in $pool1 $pool2 2024-09-16T03:24:17.679 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: seq 1 50 2024-09-16T03:24:17.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:17.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj1-p2 td/osd-backfill-prio/data 2024-09-16T03:24:18.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:18.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj2-p2 td/osd-backfill-prio/data 2024-09-16T03:24:18.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:18.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj3-p2 td/osd-backfill-prio/data 2024-09-16T03:24:18.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:18.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj4-p2 td/osd-backfill-prio/data 2024-09-16T03:24:19.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:19.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj5-p2 td/osd-backfill-prio/data 2024-09-16T03:24:19.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:19.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj6-p2 td/osd-backfill-prio/data 2024-09-16T03:24:19.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:19.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj7-p2 td/osd-backfill-prio/data 2024-09-16T03:24:20.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:20.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj8-p2 td/osd-backfill-prio/data 2024-09-16T03:24:20.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:20.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj9-p2 td/osd-backfill-prio/data 2024-09-16T03:24:20.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:20.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj10-p2 td/osd-backfill-prio/data 2024-09-16T03:24:21.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:21.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj11-p2 td/osd-backfill-prio/data 2024-09-16T03:24:21.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:21.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj12-p2 td/osd-backfill-prio/data 2024-09-16T03:24:22.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:22.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj13-p2 td/osd-backfill-prio/data 2024-09-16T03:24:22.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:22.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj14-p2 td/osd-backfill-prio/data 2024-09-16T03:24:22.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:22.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj15-p2 td/osd-backfill-prio/data 2024-09-16T03:24:23.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:23.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj16-p2 td/osd-backfill-prio/data 2024-09-16T03:24:23.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:23.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj17-p2 td/osd-backfill-prio/data 2024-09-16T03:24:23.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:23.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj18-p2 td/osd-backfill-prio/data 2024-09-16T03:24:24.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:24.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj19-p2 td/osd-backfill-prio/data 2024-09-16T03:24:24.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:24.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj20-p2 td/osd-backfill-prio/data 2024-09-16T03:24:24.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:24.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj21-p2 td/osd-backfill-prio/data 2024-09-16T03:24:25.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:25.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj22-p2 td/osd-backfill-prio/data 2024-09-16T03:24:25.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:25.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj23-p2 td/osd-backfill-prio/data 2024-09-16T03:24:26.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:26.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj24-p2 td/osd-backfill-prio/data 2024-09-16T03:24:26.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:26.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj25-p2 td/osd-backfill-prio/data 2024-09-16T03:24:26.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:26.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj26-p2 td/osd-backfill-prio/data 2024-09-16T03:24:27.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:27.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj27-p2 td/osd-backfill-prio/data 2024-09-16T03:24:27.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:27.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj28-p2 td/osd-backfill-prio/data 2024-09-16T03:24:27.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:27.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj29-p2 td/osd-backfill-prio/data 2024-09-16T03:24:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj30-p2 td/osd-backfill-prio/data 2024-09-16T03:24:28.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:28.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj31-p2 td/osd-backfill-prio/data 2024-09-16T03:24:29.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:29.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj32-p2 td/osd-backfill-prio/data 2024-09-16T03:24:29.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:29.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj33-p2 td/osd-backfill-prio/data 2024-09-16T03:24:29.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:29.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj34-p2 td/osd-backfill-prio/data 2024-09-16T03:24:30.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:30.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj35-p2 td/osd-backfill-prio/data 2024-09-16T03:24:30.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:30.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj36-p2 td/osd-backfill-prio/data 2024-09-16T03:24:30.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:30.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj37-p2 td/osd-backfill-prio/data 2024-09-16T03:24:31.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:31.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj38-p2 td/osd-backfill-prio/data 2024-09-16T03:24:31.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:31.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj39-p2 td/osd-backfill-prio/data 2024-09-16T03:24:32.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:32.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj40-p2 td/osd-backfill-prio/data 2024-09-16T03:24:32.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:32.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj41-p2 td/osd-backfill-prio/data 2024-09-16T03:24:32.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:32.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj42-p2 td/osd-backfill-prio/data 2024-09-16T03:24:33.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:33.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj43-p2 td/osd-backfill-prio/data 2024-09-16T03:24:33.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:33.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj44-p2 td/osd-backfill-prio/data 2024-09-16T03:24:34.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:34.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj45-p2 td/osd-backfill-prio/data 2024-09-16T03:24:34.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:34.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj46-p2 td/osd-backfill-prio/data 2024-09-16T03:24:34.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:34.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj47-p2 td/osd-backfill-prio/data 2024-09-16T03:24:35.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:35.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj48-p2 td/osd-backfill-prio/data 2024-09-16T03:24:35.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:35.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj49-p2 td/osd-backfill-prio/data 2024-09-16T03:24:36.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:421: TEST_backfill_pool_priority: for i in $(seq 1 $objects) 2024-09-16T03:24:36.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:423: TEST_backfill_pool_priority: rados -p test2 put obj50-p2 td/osd-backfill-prio/data 2024-09-16T03:24:36.380 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:425: TEST_backfill_pool_priority: expr 2 + 1 2024-09-16T03:24:36.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:425: TEST_backfill_pool_priority: p=3 2024-09-16T03:24:36.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:428: TEST_backfill_pool_priority: get_not_primary test1 obj1-p1 2024-09-16T03:24:36.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test1 2024-09-16T03:24:36.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1-p1 2024-09-16T03:24:36.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test1 obj1-p1 2024-09-16T03:24:36.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test1 2024-09-16T03:24:36.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1-p1 2024-09-16T03:24:36.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test1 obj1-p1 2024-09-16T03:24:36.383 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T03:24:36.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2024-09-16T03:24:36.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test1 obj1-p1 2024-09-16T03:24:36.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-09-16T03:24:37.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:428: TEST_backfill_pool_priority: local otherosd=null 2024-09-16T03:24:37.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:430: TEST_backfill_pool_priority: ceph pg dump pgs 2024-09-16T03:24:37.667 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T03:24:37.667 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 42 0 0 0 0 440401920 0 0 26 100 26 active+clean 2024-09-16T03:23:52.966943+0000 33'126 33:172 [0] 0 [0] 0 0'0 2024-09-16T03:23:33.025695+0000 0'0 2024-09-16T03:23:33.025695+0000 0 0 periodic scrub scheduled @ 2024-09-17T14:12:43.443009+0000 0 0 2024-09-16T03:24:37.667 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-09-16T03:23:51.453624+0000 33'150 33:209 [1] 1 [1] 1 0'0 2024-09-16T03:23:30.689827+0000 0'0 2024-09-16T03:23:30.689827+0000 0 0 periodic scrub scheduled @ 2024-09-17T13:13:48.939374+0000 0 0 2024-09-16T03:24:37.667 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T03:24:37.667 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T03:24:37.667 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:24:37.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:431: TEST_backfill_pool_priority: ERRORS=0 2024-09-16T03:24:37.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:433: TEST_backfill_pool_priority: ceph osd pool set test1 size 2 2024-09-16T03:24:38.490 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 2 2024-09-16T03:24:38.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:434: TEST_backfill_pool_priority: ceph osd pool set test2 size 2 2024-09-16T03:24:39.529 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 2 size to 2 2024-09-16T03:24:39.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:435: TEST_backfill_pool_priority: sleep 5 2024-09-16T03:24:44.544 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:436: TEST_backfill_pool_priority: get_asok_path osd.1 2024-09-16T03:24:44.544 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2024-09-16T03:24:44.544 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2024-09-16T03:24:44.544 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:24:44.544 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:24:44.544 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:24:44.544 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-osd.1.asok 2024-09-16T03:24:44.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:436: TEST_backfill_pool_priority: CEPH_ARGS= 2024-09-16T03:24:44.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:436: TEST_backfill_pool_priority: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:24:44.645 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 2024-09-16T03:24:44.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:437: TEST_backfill_pool_priority: echo osd.1 2024-09-16T03:24:44.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:438: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2024-09-16T03:24:44.646 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:24:44.646 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:24:44.646 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:24:44.646 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:24:44.646 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:24:44.646 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 152, 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:24:44.647 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "2.0", 2024-09-16T03:24:44.648 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 153, 2024-09-16T03:24:44.648 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:24:44.648 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:24:44.648 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:24:44.648 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:24:44.648 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:24:44.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:439: TEST_backfill_pool_priority: get_asok_path osd.0 2024-09-16T03:24:44.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2024-09-16T03:24:44.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2024-09-16T03:24:44.649 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:24:44.649 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:24:44.649 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:24:44.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-osd.0.asok 2024-09-16T03:24:44.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:439: TEST_backfill_pool_priority: CEPH_ARGS= 2024-09-16T03:24:44.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:439: TEST_backfill_pool_priority: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.0.asok dump_recovery_reservations 2024-09-16T03:24:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 2024-09-16T03:24:44.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:440: TEST_backfill_pool_priority: echo osd.0 2024-09-16T03:24:44.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:441: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2024-09-16T03:24:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:24:44.739 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:24:44.739 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "2.0", 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 153, 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:24:44.740 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:24:44.741 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:24:44.741 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:24:44.741 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:24:44.741 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 152, 2024-09-16T03:24:44.741 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:24:44.741 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:24:44.741 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:24:44.741 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:24:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:24:44.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:444: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2024-09-16T03:24:44.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:444: TEST_backfill_pool_priority: jq '.local_reservations.in_progress[0].item' 2024-09-16T03:24:44.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:444: TEST_backfill_pool_priority: eval 'ITEM="1.0"' 2024-09-16T03:24:44.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:444: TEST_backfill_pool_priority: ITEM=1.0 2024-09-16T03:24:44.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:445: TEST_backfill_pool_priority: '[' 1.0 '!=' 1.0 ']' 2024-09-16T03:24:44.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:450: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2024-09-16T03:24:44.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:450: TEST_backfill_pool_priority: jq '.local_reservations.in_progress[0].prio' 2024-09-16T03:24:44.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:450: TEST_backfill_pool_priority: PRIO=152 2024-09-16T03:24:44.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:451: TEST_backfill_pool_priority: '[' 152 '!=' 152 ']' 2024-09-16T03:24:44.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:459: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2024-09-16T03:24:44.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:459: TEST_backfill_pool_priority: jq '.remote_reservations.in_progress[0].item' 2024-09-16T03:24:44.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:459: TEST_backfill_pool_priority: eval 'ITEM="1.0"' 2024-09-16T03:24:44.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:459: TEST_backfill_pool_priority: ITEM=1.0 2024-09-16T03:24:44.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:460: TEST_backfill_pool_priority: '[' 1.0 '!=' 1.0 ']' 2024-09-16T03:24:44.750 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:465: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2024-09-16T03:24:44.750 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:465: TEST_backfill_pool_priority: jq '.remote_reservations.in_progress[0].prio' 2024-09-16T03:24:44.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:465: TEST_backfill_pool_priority: PRIO=152 2024-09-16T03:24:44.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:466: TEST_backfill_pool_priority: '[' 152 '!=' 152 ']' 2024-09-16T03:24:44.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:474: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2024-09-16T03:24:44.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:474: TEST_backfill_pool_priority: jq '.local_reservations.in_progress[0].item' 2024-09-16T03:24:44.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:474: TEST_backfill_pool_priority: eval 'ITEM="2.0"' 2024-09-16T03:24:44.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:474: TEST_backfill_pool_priority: ITEM=2.0 2024-09-16T03:24:44.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:475: TEST_backfill_pool_priority: '[' 2.0 '!=' 2.0 ']' 2024-09-16T03:24:44.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:480: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.0.out 2024-09-16T03:24:44.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:480: TEST_backfill_pool_priority: jq '.local_reservations.in_progress[0].prio' 2024-09-16T03:24:44.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:480: TEST_backfill_pool_priority: PRIO=153 2024-09-16T03:24:44.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:481: TEST_backfill_pool_priority: '[' 153 '!=' 153 ']' 2024-09-16T03:24:44.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:489: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2024-09-16T03:24:44.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:489: TEST_backfill_pool_priority: jq '.remote_reservations.in_progress[0].item' 2024-09-16T03:24:44.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:489: TEST_backfill_pool_priority: eval 'ITEM="2.0"' 2024-09-16T03:24:44.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:489: TEST_backfill_pool_priority: ITEM=2.0 2024-09-16T03:24:44.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:490: TEST_backfill_pool_priority: '[' 2.0 '!=' 2.0 ']' 2024-09-16T03:24:44.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:495: TEST_backfill_pool_priority: cat td/osd-backfill-prio/dump.1.out 2024-09-16T03:24:44.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:495: TEST_backfill_pool_priority: jq '.remote_reservations.in_progress[0].prio' 2024-09-16T03:24:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:495: TEST_backfill_pool_priority: PRIO=153 2024-09-16T03:24:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:496: TEST_backfill_pool_priority: '[' 153 '!=' 153 ']' 2024-09-16T03:24:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:503: TEST_backfill_pool_priority: wait_for_clean 2024-09-16T03:24:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:24:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:24:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:24:44.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:24:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:24:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:24:44.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:24:44.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:24:44.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:24:44.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:24:44.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:24:44.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:24:44.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:24:44.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:24:44.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:24:45.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:24:45.320 INFO:tasks.workunit.client.0.smithi026.stderr:1' 2024-09-16T03:24:45.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:24:45.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:24:45.321 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:24:45.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836504 2024-09-16T03:24:45.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836504 2024-09-16T03:24:45.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836504' 2024-09-16T03:24:45.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:24:45.443 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:24:45.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672981 2024-09-16T03:24:45.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672981 2024-09-16T03:24:45.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836504 1-42949672981' 2024-09-16T03:24:45.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:24:45.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836504 2024-09-16T03:24:45.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:24:45.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:24:45.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836504 2024-09-16T03:24:45.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:24:45.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836504 2024-09-16T03:24:45.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836504' 2024-09-16T03:24:45.589 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836504 2024-09-16T03:24:45.589 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:24:46.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836502 -lt 21474836504 2024-09-16T03:24:46.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:24:47.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:24:47.121 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:24:47.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836504 -lt 21474836504 2024-09-16T03:24:47.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:24:47.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672981 2024-09-16T03:24:47.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:24:47.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:24:47.548 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672981 2024-09-16T03:24:47.548 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:24:47.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672981 2024-09-16T03:24:47.549 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672981 2024-09-16T03:24:47.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672981' 2024-09-16T03:24:47.549 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:24:48.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672981 -lt 42949672981 2024-09-16T03:24:48.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:24:48.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:24:48.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:24:48.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 2 == 0 2024-09-16T03:24:48.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:24:48.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:24:48.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:24:48.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:24:48.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:24:48.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:24:48.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:24:49.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:24:49.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:24:49.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:24:49.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T03:24:49.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T03:24:49.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T03:24:49.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:24:49.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:24:49.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:24:49.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:24:49.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:24:49.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:24:49.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:24:49.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:24:49.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:24:49.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:24:50.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:24:50.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:24:50.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:24:50.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:24:51.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:24:51.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:24:51.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:24:51.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:24:51.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:24:51.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:24:51.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:24:51.128 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:24:51.128 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:24:51.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=20385096 2024-09-16T03:24:51.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 20385096 '!=' null 2024-09-16T03:24:51.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:24:51.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:24:51.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:24:51.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:24:51.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:24:51.799 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:24:51.799 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:24:51.799 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:24:51.799 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:24:51.799 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:24:51.799 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:24:52.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:24:52.206 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:24:52.208 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:24:52.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:24:52.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:24:52.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:24:52.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:24:52.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:24:52.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:24:52.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:24:52.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:24:52.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:24:53.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=24552749 2024-09-16T03:24:53.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 24552749 '!=' null 2024-09-16T03:24:53.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:24:53.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:24:53.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:24:53.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:24:53.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:24:53.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:24:53.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:24:53.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:24:53.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:24:53.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:24:53.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:24:54.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:24:54.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:24:54.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:24:54.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:24:54.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:24:54.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:24:54.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:24:54.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:24:54.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:24:54.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:24:54.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:24:54.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:24:54.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:24:55.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=26209332 2024-09-16T03:24:55.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 26209332 '!=' null 2024-09-16T03:24:55.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:24:55.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:24:55.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:24:55.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:24:55.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:24:55.722 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:24:55.722 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:24:55.723 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:24:55.723 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:24:55.723 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:24:55.723 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:24:56.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:24:56.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:24:56.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:24:56.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:24:57.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:24:57.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:24:57.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:24:57.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:24:57.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:24:57.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:24:57.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:24:57.039 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:24:57.039 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:24:57.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=23588719 2024-09-16T03:24:57.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 23588719 '!=' null 2024-09-16T03:24:57.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:24:57.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:24:57.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:24:57.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:24:57.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:24:57.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:24:57.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:24:57.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:24:57.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:24:57.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:24:57.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:24:58.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:24:58.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:24:58.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:24:58.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:24:59.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:24:59.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:24:59.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:24:59.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:24:59.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:24:59.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:24:59.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:24:59.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:24:59.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:24:59.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=21841436 2024-09-16T03:24:59.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 21841436 '!=' null 2024-09-16T03:24:59.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:24:59.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:24:59.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:24:59.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:24:59.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:24:59.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:24:59.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:24:59.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:24:59.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:24:59.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:24:59.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:00.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:25:00.236 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:00.236 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:00.236 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:01.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:25:01.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:25:01.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:25:01.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:25:01.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:25:01.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:25:01.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:25:01.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:25:01.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:25:01.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=27957106 2024-09-16T03:25:01.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 27957106 '!=' null 2024-09-16T03:25:01.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:25:01.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:01.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:02.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:02.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:02.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:02.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:02.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:02.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:02.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:02.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:02.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:25:02.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:02.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:02.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:25:03.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:25:03.414 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:25:04.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=29704135 2024-09-16T03:25:04.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 29704135 '!=' null 2024-09-16T03:25:04.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:25:04.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:04.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:04.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:04.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:04.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:04.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:04.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:04.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:04.214 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:04.214 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:04.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:25:04.655 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:04.655 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:04.655 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:05.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:25:05.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:25:05.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:25:05.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:25:05.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:25:05.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:25:05.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:25:05.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:25:05.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:25:06.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=29704219 2024-09-16T03:25:06.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 29704219 '!=' null 2024-09-16T03:25:06.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:25:06.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:06.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:06.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:06.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:06.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:06.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:06.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:06.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:06.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:06.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:06.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:25:06.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:06.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:06.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:07.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:25:07.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:25:07.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:25:07.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:25:07.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:25:07.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:25:07.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:25:07.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:25:07.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=29704566 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 29704566 '!=' null 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:08.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:08.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:08.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:08.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:08.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:08.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:08.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:08.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:08.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:08.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:25:08.923 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:08.924 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:08.924 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:09.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:25:09.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:25:09.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:25:09.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:25:09.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:25:09.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:25:09.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:25:09.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:25:09.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:25:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=28831127 2024-09-16T03:25:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 28831127 '!=' null 2024-09-16T03:25:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:25:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:10.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:10.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:10.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:10.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:10.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:10.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:10.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:10.418 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:10.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:25:10.926 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:10.927 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:10.927 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:11.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:25:11.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:25:11.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:25:11.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:25:11.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:25:11.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:25:11.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:25:11.554 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:25:11.554 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:25:12.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=28831161 2024-09-16T03:25:12.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 28831161 '!=' null 2024-09-16T03:25:12.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:25:12.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:12.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:12.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:12.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:12.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:12.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:12.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:12.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:12.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:12.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:12.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:25:12.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:12.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:12.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:13.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:25:13.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:25:13.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:25:13.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:25:13.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:25:13.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:25:13.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:25:13.332 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:25:13.332 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:25:13.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=28831161 2024-09-16T03:25:13.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 28831161 '!=' null 2024-09-16T03:25:13.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:25:13.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:13.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:13.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:13.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:13.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:13.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:13.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:13.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:13.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:13.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:14.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:25:14.443 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:14.443 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:14.443 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:15.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:25:15.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:25:15.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:25:15.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:25:15.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:25:15.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:25:15.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:25:15.053 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:25:15.054 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:25:15.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=28831599 2024-09-16T03:25:15.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 28831599 '!=' null 2024-09-16T03:25:15.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:25:15.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:15.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:15.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:15.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:15.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:15.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:15.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:15.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:15.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:15.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:16.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:25:16.161 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:16.161 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:16.161 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:16.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:25:16.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:25:16.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:25:16.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:25:16.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:25:16.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:25:16.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:25:16.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:25:16.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:25:17.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=22715566 2024-09-16T03:25:17.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 22715566 '!=' null 2024-09-16T03:25:17.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:25:17.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:17.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:17.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:17.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:17.677 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:17.677 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:17.677 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:17.677 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:17.677 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:17.677 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:18.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:25:18.089 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:18.089 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:18.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:18.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:25:18.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:25:18.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:25:18.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:25:18.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:25:18.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:25:18.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:25:18.676 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:25:18.676 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:25:19.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=27520550 2024-09-16T03:25:19.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 27520550 '!=' null 2024-09-16T03:25:19.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:25:19.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:19.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:19.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:19.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:19.345 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:19.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:19.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:19.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:19.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:19.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:19.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:25:19.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:19.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:19.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:20.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:25:20.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:25:20.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:25:20.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:25:20.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:25:20.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:25:20.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:25:20.303 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:25:20.304 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:25:20.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=36693785 2024-09-16T03:25:20.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 36693785 '!=' null 2024-09-16T03:25:20.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:25:20.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:20.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:20.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:20.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:20.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:20.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:20.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:20.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:20.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:20.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:21.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:25:21.369 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:21.369 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:21.369 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:21.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 2 2024-09-16T03:25:21.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:25:21.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:25:21.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:25:21.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:25:21.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:25:21.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:25:21.930 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:25:21.931 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:25:22.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=12697175 2024-09-16T03:25:22.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 12697175 '!=' null 2024-09-16T03:25:22.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:25:22.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:22.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:22.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:22.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:22.588 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:22.588 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:22.588 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:22.588 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:22.588 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:22.588 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:22.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:25:22.993 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:22.993 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:22.993 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:23.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 2 2024-09-16T03:25:23.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 0 2024-09-16T03:25:23.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T03:25:23.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=1 2024-09-16T03:25:23.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:25:23.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:25:23.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:25:23.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:25:23.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:25:23.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:25:23.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:25:23.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:25:23.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:25:23.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:25:24.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:25:24.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:25:24.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:25:24.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:25:24.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 2 2024-09-16T03:25:24.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:25:24.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:25:24.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:505: TEST_backfill_pool_priority: '[' 0 '!=' 0 ']' 2024-09-16T03:25:24.610 INFO:tasks.workunit.client.0.smithi026.stdout:TEST PASSED 2024-09-16T03:25:24.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:509: TEST_backfill_pool_priority: echo TEST PASSED 2024-09-16T03:25:24.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:512: TEST_backfill_pool_priority: delete_pool test1 2024-09-16T03:25:24.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test1 2024-09-16T03:25:24.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-09-16T03:25:25.188 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' does not exist 2024-09-16T03:25:25.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:513: TEST_backfill_pool_priority: delete_pool test2 2024-09-16T03:25:25.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test2 2024-09-16T03:25:25.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-09-16T03:25:25.703 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' does not exist 2024-09-16T03:25:25.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:514: TEST_backfill_pool_priority: kill_daemons td/osd-backfill-prio 2024-09-16T03:25:25.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:25:25.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:25:25.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:25:25.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:25:25.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:25:31.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:25:31.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:515: TEST_backfill_pool_priority: return 0 2024-09-16T03:25:31.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:43: run: teardown td/osd-backfill-prio 2024-09-16T03:25:31.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-prio 2024-09-16T03:25:31.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:25:31.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-prio KILL 2024-09-16T03:25:31.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:25:31.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:25:31.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:25:31.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:25:31.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:25:31.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:25:31.035 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:25:31.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:25:31.036 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:25:31.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:25:31.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:25:31.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:25:31.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:25:31.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:25:31.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:25:31.039 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:25:31.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:25:31.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:25:31.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-prio 2024-09-16T03:25:31.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:25:31.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:25:31.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:25:31.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.27283 2024-09-16T03:25:31.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:25:31.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:25:31.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:40: run: for func in $funcs 2024-09-16T03:25:31.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:41: run: setup td/osd-backfill-prio 2024-09-16T03:25:31.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-prio 2024-09-16T03:25:31.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-prio 2024-09-16T03:25:31.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-prio 2024-09-16T03:25:31.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:25:31.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-prio KILL 2024-09-16T03:25:31.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:25:31.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:25:31.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:25:31.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:25:31.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:25:31.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:25:31.062 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:25:31.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:25:31.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:25:31.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:25:31.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:25:31.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:25:31.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:25:31.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:25:31.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:25:31.067 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:25:31.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:25:31.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:25:31.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-prio 2024-09-16T03:25:31.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:25:31.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:25:31.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:25:31.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.27283 2024-09-16T03:25:31.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:25:31.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:25:31.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-prio 2024-09-16T03:25:31.073 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:25:31.073 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:25:31.073 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:25:31.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.27283 2024-09-16T03:25:31.075 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:25:31.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:25:31.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:25:31.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-prio 1' TERM HUP INT 2024-09-16T03:25:31.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:42: run: TEST_backfill_priority td/osd-backfill-prio 2024-09-16T03:25:31.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:49: TEST_backfill_priority: local dir=td/osd-backfill-prio 2024-09-16T03:25:31.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:50: TEST_backfill_priority: local pools=10 2024-09-16T03:25:31.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:51: TEST_backfill_priority: local OSDS=5 2024-09-16T03:25:31.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:53: TEST_backfill_priority: expr 150 + 1 2024-09-16T03:25:31.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:53: TEST_backfill_priority: local degraded_prio=151 2024-09-16T03:25:31.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:54: TEST_backfill_priority: local max_tries=10 2024-09-16T03:25:31.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:56: TEST_backfill_priority: run_mon td/osd-backfill-prio a 2024-09-16T03:25:31.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-prio 2024-09-16T03:25:31.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:25:31.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:25:31.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:25:31.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-prio/a 2024-09-16T03:25:31.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-prio/a --run-dir=td/osd-backfill-prio 2024-09-16T03:25:31.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:25:31.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:25:31.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:25:31.545 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:25:31.545 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:25:31.545 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:25:31.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:25:31.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-prio/a '--log-file=td/osd-backfill-prio/$name.log' '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-prio/log --run-dir=td/osd-backfill-prio '--pid-file=td/osd-backfill-prio/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:25:31.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:25:31.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:25:31.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:25:31.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:25:31.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:25:31.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:25:31.756 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:25:31.757 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:25:31.757 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:25:31.757 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:25:31.757 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:25:31.757 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:25:31.757 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-mon.a.asok 2024-09-16T03:25:31.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:25:31.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.27283/ceph-mon.a.asok config get fsid 2024-09-16T03:25:31.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:25:31.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:25:31.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:25:31.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:25:31.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:25:31.851 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:25:31.851 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:25:31.852 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:25:31.852 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:25:31.852 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:25:31.852 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:25:31.852 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-mon.a.asok 2024-09-16T03:25:31.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:25:31.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.27283/ceph-mon.a.asok config get mon_host 2024-09-16T03:25:31.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:57: TEST_backfill_priority: run_mgr td/osd-backfill-prio x 2024-09-16T03:25:31.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-prio 2024-09-16T03:25:31.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:25:31.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:25:31.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:25:31.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-prio/x 2024-09-16T03:25:31.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:25:32.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:25:32.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:25:32.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:25:32.796 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:25:32.796 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:25:32.796 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:25:32.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:25:32.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:25:32.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-prio/x '--log-file=td/osd-backfill-prio/$name.log' '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --run-dir=td/osd-backfill-prio '--pid-file=td/osd-backfill-prio/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:25:32.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:58: TEST_backfill_priority: export CEPH_ARGS 2024-09-16T03:25:32.830 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: expr 5 - 1 2024-09-16T03:25:32.831 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: seq 0 4 2024-09-16T03:25:32.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:25:32.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:62: TEST_backfill_priority: run_osd td/osd-backfill-prio 0 2024-09-16T03:25:32.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-prio 2024-09-16T03:25:32.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:25:32.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:25:32.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:25:32.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-prio/0 2024-09-16T03:25:32.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/0' 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/0/journal' 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:25:32.836 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:25:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:25:32.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-prio/0 2024-09-16T03:25:32.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:25:32.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=52aa1554-0f67-444b-bd69-705afd20ac88 2024-09-16T03:25:32.838 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 52aa1554-0f67-444b-bd69-705afd20ac88 2024-09-16T03:25:32.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 52aa1554-0f67-444b-bd69-705afd20ac88' 2024-09-16T03:25:32.839 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:25:32.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAspedmMuEYMxAAMeUAu+fzbmvlUK5aYopWBw== 2024-09-16T03:25:32.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAspedmMuEYMxAAMeUAu+fzbmvlUK5aYopWBw=="}' 2024-09-16T03:25:32.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 52aa1554-0f67-444b-bd69-705afd20ac88 -i td/osd-backfill-prio/0/new.json 2024-09-16T03:25:33.128 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:25:33.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-prio/0/new.json 2024-09-16T03:25:33.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/0 --osd-journal=td/osd-backfill-prio/0/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAspedmMuEYMxAAMeUAu+fzbmvlUK5aYopWBw== --osd-uuid 52aa1554-0f67-444b-bd69-705afd20ac88 2024-09-16T03:25:33.174 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:33.172+0000 7f82a37b2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:33.197 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:33.195+0000 7f82a37b2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:33.198 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:33.196+0000 7f82a37b2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:33.198 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:33.196+0000 7f82a37b2640 -1 bdev(0x5580637e5c00 td/osd-backfill-prio/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:25:33.198 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:33.196+0000 7f82a37b2640 -1 bluestore(td/osd-backfill-prio/0) _read_fsid unparsable uuid 2024-09-16T03:25:39.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-prio/0/keyring 2024-09-16T03:25:39.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:25:39.173 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T03:25:39.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:25:39.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-prio/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:25:39.742 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T03:25:39.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:25:39.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/0 --osd-journal=td/osd-backfill-prio/0/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:25:39.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:25:39.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:25:39.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:25:39.777 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:39.775+0000 7f8911e2a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:39.779 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:39.777+0000 7f8911e2a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:39.780 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:39.779+0000 7f8911e2a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:40.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:25:40.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:25:40.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:25:40.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:25:40.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:25:40.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:25:40.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:25:40.201 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:25:40.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:25:40.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:25:40.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:25:40.884 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:40.882+0000 7f8911e2a640 -1 Falling back to public interface 2024-09-16T03:25:41.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:25:41.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:25:41.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:25:41.644 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:25:41.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:25:41.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:25:42.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:25:43.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:25:43.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:25:43.094 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:25:43.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:25:43.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:25:43.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:25:43.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:25:43.603 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:43.601+0000 7f8911e2a640 -1 osd.0 0 log_to_monitors true 2024-09-16T03:25:44.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:25:44.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:25:44.514 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:25:44.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:25:44.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:25:44.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:25:44.930 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3664758020,v1:127.0.0.1:6803/3664758020] [v2:127.0.0.1:6804/3664758020,v1:127.0.0.1:6805/3664758020] exists,up 52aa1554-0f67-444b-bd69-705afd20ac88 2024-09-16T03:25:44.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:25:44.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:25:44.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:25:44.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:25:44.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:62: TEST_backfill_priority: run_osd td/osd-backfill-prio 1 2024-09-16T03:25:44.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-prio 2024-09-16T03:25:44.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:25:44.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-prio/1 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/1' 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/1/journal' 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:25:44.935 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:25:44.936 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:25:44.936 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:25:44.936 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:25:44.936 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:25:44.936 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:25:44.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:25:44.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:25:44.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:25:44.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:25:44.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-09-16T03:25:44.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-09-16T03:25:44.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:25:44.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:25:44.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:25:44.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:25:44.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:25:44.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:25:44.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-prio/1 2024-09-16T03:25:44.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:25:44.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6c5dfc11-b939-4949-9f83-671cb29c953e 2024-09-16T03:25:44.938 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 6c5dfc11-b939-4949-9f83-671cb29c953e 2024-09-16T03:25:44.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 6c5dfc11-b939-4949-9f83-671cb29c953e' 2024-09-16T03:25:44.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:25:44.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA4pedmik8IORAAgEci5Bp/wQ2XVA7I/kFknA== 2024-09-16T03:25:44.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA4pedmik8IORAAgEci5Bp/wQ2XVA7I/kFknA=="}' 2024-09-16T03:25:44.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6c5dfc11-b939-4949-9f83-671cb29c953e -i td/osd-backfill-prio/1/new.json 2024-09-16T03:25:45.509 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:25:45.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-prio/1/new.json 2024-09-16T03:25:45.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/1 --osd-journal=td/osd-backfill-prio/1/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA4pedmik8IORAAgEci5Bp/wQ2XVA7I/kFknA== --osd-uuid 6c5dfc11-b939-4949-9f83-671cb29c953e 2024-09-16T03:25:45.557 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:45.555+0000 7fa1c3e26640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:45.559 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:45.557+0000 7fa1c3e26640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:45.560 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:45.558+0000 7fa1c3e26640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:45.561 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:45.559+0000 7fa1c3e26640 -1 bdev(0x55e3f7649c00 td/osd-backfill-prio/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:25:45.561 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:45.559+0000 7fa1c3e26640 -1 bluestore(td/osd-backfill-prio/1) _read_fsid unparsable uuid 2024-09-16T03:25:51.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-prio/1/keyring 2024-09-16T03:25:51.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:25:51.448 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T03:25:51.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:25:51.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-prio/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:25:52.022 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T03:25:52.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:25:52.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/1 --osd-journal=td/osd-backfill-prio/1/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:25:52.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:25:52.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:25:52.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:25:52.057 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:52.055+0000 7f31af2ef640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:52.058 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:52.057+0000 7f31af2ef640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:52.059 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:52.058+0000 7f31af2ef640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:52.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:25:52.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:25:52.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:25:52.469 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:25:52.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:25:52.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:25:52.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:25:52.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:25:52.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:25:52.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:25:52.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:25:53.164 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:53.162+0000 7f31af2ef640 -1 Falling back to public interface 2024-09-16T03:25:53.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:25:53.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:25:53.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:25:53.913 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:25:53.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:25:53.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:25:54.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:25:55.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:25:55.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:25:55.356 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:25:55.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:25:55.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:25:55.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:25:55.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:25:56.234 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:56.232+0000 7f31af2ef640 -1 osd.1 0 log_to_monitors true 2024-09-16T03:25:56.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:25:56.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:25:56.777 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:25:56.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:25:56.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:25:56.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:25:57.222 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1606491101,v1:127.0.0.1:6811/1606491101] [v2:127.0.0.1:6812/1606491101,v1:127.0.0.1:6813/1606491101] exists,up 6c5dfc11-b939-4949-9f83-671cb29c953e 2024-09-16T03:25:57.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:62: TEST_backfill_priority: run_osd td/osd-backfill-prio 2 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-prio 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-prio/2 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:25:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/2' 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/2/journal' 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:25:57.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:25:57.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:25:57.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:25:57.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-09-16T03:25:57.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-09-16T03:25:57.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:25:57.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:25:57.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:25:57.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:25:57.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:25:57.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:25:57.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-prio/2 2024-09-16T03:25:57.229 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:25:57.230 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 9a972ace-7eae-48ac-9a71-219657f428a6 2024-09-16T03:25:57.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9a972ace-7eae-48ac-9a71-219657f428a6 2024-09-16T03:25:57.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 9a972ace-7eae-48ac-9a71-219657f428a6' 2024-09-16T03:25:57.230 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:25:57.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBFpedmoj3IDhAA9fhdSluQej4E/EA6BMV+Pg== 2024-09-16T03:25:57.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBFpedmoj3IDhAA9fhdSluQej4E/EA6BMV+Pg=="}' 2024-09-16T03:25:57.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9a972ace-7eae-48ac-9a71-219657f428a6 -i td/osd-backfill-prio/2/new.json 2024-09-16T03:25:57.810 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:25:57.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-prio/2/new.json 2024-09-16T03:25:57.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/2 --osd-journal=td/osd-backfill-prio/2/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBFpedmoj3IDhAA9fhdSluQej4E/EA6BMV+Pg== --osd-uuid 9a972ace-7eae-48ac-9a71-219657f428a6 2024-09-16T03:25:57.858 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:57.856+0000 7fceefe0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:57.860 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:57.858+0000 7fceefe0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:57.861 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:57.859+0000 7fceefe0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:25:57.861 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:57.859+0000 7fceefe0f640 -1 bdev(0x5592453f1c00 td/osd-backfill-prio/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:25:57.861 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:25:57.860+0000 7fceefe0f640 -1 bluestore(td/osd-backfill-prio/2) _read_fsid unparsable uuid 2024-09-16T03:26:04.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-prio/2/keyring 2024-09-16T03:26:04.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:26:04.026 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T03:26:04.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:26:04.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-prio/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:26:04.607 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T03:26:04.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:26:04.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/2 --osd-journal=td/osd-backfill-prio/2/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:26:04.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:26:04.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:26:04.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:26:04.645 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:04.640+0000 7f7d6d833640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:04.645 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:04.642+0000 7f7d6d833640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:04.645 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:04.643+0000 7f7d6d833640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:05.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:26:05.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:26:05.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:26:05.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:26:05.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:26:05.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:05.090 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:26:05.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:26:05.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:05.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:26:05.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:06.004 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:06.002+0000 7f7d6d833640 -1 Falling back to public interface 2024-09-16T03:26:06.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:06.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:06.560 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:26:06.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:26:06.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:06.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:26:07.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:08.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:08.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:08.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:26:08.020 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:26:08.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:08.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:26:08.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:09.182 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:09.180+0000 7f7d6d833640 -1 osd.2 0 log_to_monitors true 2024-09-16T03:26:09.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:09.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:09.479 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:26:09.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:26:09.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:09.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:26:09.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:10.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:10.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:10.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:26:10.941 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:26:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:26:11.389 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/743012490,v1:127.0.0.1:6819/743012490] [v2:127.0.0.1:6820/743012490,v1:127.0.0.1:6821/743012490] exists,up 9a972ace-7eae-48ac-9a71-219657f428a6 2024-09-16T03:26:11.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:26:11.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:62: TEST_backfill_priority: run_osd td/osd-backfill-prio 3 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-prio 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-prio/3 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:26:11.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/3' 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/3/journal' 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:26:11.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-prio/3 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:26:11.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=74af56c5-25d5-4698-bdb9-ad6967479212 2024-09-16T03:26:11.397 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 74af56c5-25d5-4698-bdb9-ad6967479212 2024-09-16T03:26:11.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 74af56c5-25d5-4698-bdb9-ad6967479212' 2024-09-16T03:26:11.397 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:26:11.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBTpedmvWS7GBAAR70nFQgC6YGW8riTWRKoeg== 2024-09-16T03:26:11.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBTpedmvWS7GBAAR70nFQgC6YGW8riTWRKoeg=="}' 2024-09-16T03:26:11.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 74af56c5-25d5-4698-bdb9-ad6967479212 -i td/osd-backfill-prio/3/new.json 2024-09-16T03:26:11.935 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:26:11.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-prio/3/new.json 2024-09-16T03:26:11.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/3 --osd-journal=td/osd-backfill-prio/3/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBTpedmvWS7GBAAR70nFQgC6YGW8riTWRKoeg== --osd-uuid 74af56c5-25d5-4698-bdb9-ad6967479212 2024-09-16T03:26:11.983 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:11.981+0000 7fd2a8e64640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:11.984 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:11.982+0000 7fd2a8e64640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:11.985 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:11.984+0000 7fd2a8e64640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:11.986 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:11.984+0000 7fd2a8e64640 -1 bdev(0x561a41d9fc00 td/osd-backfill-prio/3/block) open stat got: (1) Operation not permitted 2024-09-16T03:26:11.986 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:11.984+0000 7fd2a8e64640 -1 bluestore(td/osd-backfill-prio/3) _read_fsid unparsable uuid 2024-09-16T03:26:17.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-prio/3/keyring 2024-09-16T03:26:17.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:26:17.738 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T03:26:17.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T03:26:17.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-prio/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:26:18.309 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T03:26:18.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T03:26:18.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/3 --osd-journal=td/osd-backfill-prio/3/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:26:18.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:26:18.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:26:18.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:26:18.343 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:18.340+0000 7f1c8cc10640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:18.345 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:18.343+0000 7f1c8cc10640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:18.346 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:18.344+0000 7f1c8cc10640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T03:26:18.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:26:18.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:26:18.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:18.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:26:19.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:19.692 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:19.689+0000 7f1c8cc10640 -1 Falling back to public interface 2024-09-16T03:26:20.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:20.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:20.185 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:26:20.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:26:20.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:20.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:26:20.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:21.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:21.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:21.634 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:26:21.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:26:21.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:21.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:26:22.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:22.689 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:22.686+0000 7f1c8cc10640 -1 osd.3 0 log_to_monitors true 2024-09-16T03:26:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:26:23.076 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:26:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:23.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:26:23.621 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2033695292,v1:127.0.0.1:6827/2033695292] [v2:127.0.0.1:6828/2033695292,v1:127.0.0.1:6829/2033695292] exists,up 74af56c5-25d5-4698-bdb9-ad6967479212 2024-09-16T03:26:23.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:26:23.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:26:23.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:26:23.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:60: TEST_backfill_priority: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:62: TEST_backfill_priority: run_osd td/osd-backfill-prio 4 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-prio 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-prio/4 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq ' 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-prio/4' 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-prio/4/journal' 2024-09-16T03:26:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:26:23.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:26:23.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-prio' 2024-09-16T03:26:23.627 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:26:23.627 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:26:23.627 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:26:23.627 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:26:23.627 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:26:23.627 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:26:23.627 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:26:23.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' 2024-09-16T03:26:23.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:26:23.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:26:23.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:26:23.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-prio/$name.log' 2024-09-16T03:26:23.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-prio/$name.pid' 2024-09-16T03:26:23.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:26:23.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:26:23.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:26:23.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:26:23.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:26:23.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:26:23.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-prio/4 2024-09-16T03:26:23.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:26:23.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=40a4858b-f503-40c0-bea4-e0b58127b291 2024-09-16T03:26:23.629 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 40a4858b-f503-40c0-bea4-e0b58127b291 2024-09-16T03:26:23.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 40a4858b-f503-40c0-bea4-e0b58127b291' 2024-09-16T03:26:23.629 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:26:23.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBfpedm/OKLJhAAF7sIGzeRKh8m4uxAvFwdWQ== 2024-09-16T03:26:23.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBfpedm/OKLJhAAF7sIGzeRKh8m4uxAvFwdWQ=="}' 2024-09-16T03:26:23.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 40a4858b-f503-40c0-bea4-e0b58127b291 -i td/osd-backfill-prio/4/new.json 2024-09-16T03:26:24.199 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:26:24.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-prio/4/new.json 2024-09-16T03:26:24.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/4 --osd-journal=td/osd-backfill-prio/4/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBfpedm/OKLJhAAF7sIGzeRKh8m4uxAvFwdWQ== --osd-uuid 40a4858b-f503-40c0-bea4-e0b58127b291 2024-09-16T03:26:24.247 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:24.244+0000 7f5c456d6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:24.270 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:24.267+0000 7f5c456d6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:24.271 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:24.268+0000 7f5c456d6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:24.271 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:24.268+0000 7f5c456d6640 -1 bdev(0x55c45783bc00 td/osd-backfill-prio/4/block) open stat got: (1) Operation not permitted 2024-09-16T03:26:24.271 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:24.269+0000 7f5c456d6640 -1 bluestore(td/osd-backfill-prio/4) _read_fsid unparsable uuid 2024-09-16T03:26:30.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-prio/4/keyring 2024-09-16T03:26:30.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:26:30.480 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T03:26:30.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T03:26:30.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-prio/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:26:31.053 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T03:26:31.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T03:26:31.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=bb03b82b-bce0-4260-8acc-59c0e821fdee --auth-supported=none --mon-host=127.0.0.1:7114 --osd_max_backfills=1 --debug_reserver=20 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-prio/4 --osd-journal=td/osd-backfill-prio/4/journal --chdir= --run-dir=td/osd-backfill-prio '--admin-socket=/tmp/ceph-asok.27283/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-prio/$name.log' '--pid-file=td/osd-backfill-prio/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:26:31.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:26:31.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:26:31.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:26:31.088 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:31.086+0000 7f2b1bc0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:31.090 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:31.089+0000 7f2b1bc0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:31.092 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:31.090+0000 7f2b1bc0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:26:31.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T03:26:31.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:26:31.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T03:26:31.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:26:31.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:26:31.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:31.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:26:31.514 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:26:31.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:31.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:26:31.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:32.443 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:32.441+0000 7f2b1bc0d640 -1 Falling back to public interface 2024-09-16T03:26:32.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:32.949 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:26:32.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:32.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:26:32.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:32.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:26:33.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:34.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:34.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:34.400 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:26:34.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:26:34.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:34.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:26:34.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:35.462 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:26:35.460+0000 7f2b1bc0d640 -1 osd.4 0 log_to_monitors true 2024-09-16T03:26:35.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:35.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:35.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:26:35.823 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:26:35.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:35.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:26:36.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:26:37.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:26:37.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:26:37.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:26:37.245 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:26:37.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:26:37.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:26:37.696 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/421000589,v1:127.0.0.1:6835/421000589] [v2:127.0.0.1:6836/421000589,v1:127.0.0.1:6837/421000589] exists,up 40a4858b-f503-40c0-bea4-e0b58127b291 2024-09-16T03:26:37.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:26:37.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:26:37.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:26:37.697 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: seq 1 10 2024-09-16T03:26:37.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:26:37.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test1 1 1 2024-09-16T03:26:37.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test1 1 1 2024-09-16T03:26:38.319 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' already exists 2024-09-16T03:26:38.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:26:39.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test1 size 2 2024-09-16T03:26:40.522 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 2 2024-09-16T03:26:40.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:26:40.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test2 1 1 2024-09-16T03:26:40.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test2 1 1 2024-09-16T03:26:41.182 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' already exists 2024-09-16T03:26:41.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:26:42.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test2 size 2 2024-09-16T03:26:42.826 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 2 size to 2 2024-09-16T03:26:42.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:26:42.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test3 1 1 2024-09-16T03:26:42.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test3 1 1 2024-09-16T03:26:43.774 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test3' already exists 2024-09-16T03:26:43.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:26:44.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test3 size 2 2024-09-16T03:26:45.710 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 3 size to 2 2024-09-16T03:26:45.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:26:45.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test4 1 1 2024-09-16T03:26:45.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test4 1 1 2024-09-16T03:26:46.461 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test4' already exists 2024-09-16T03:26:46.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:26:47.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test4 size 2 2024-09-16T03:26:48.359 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 4 size to 2 2024-09-16T03:26:48.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:26:48.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test5 1 1 2024-09-16T03:26:48.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test5 1 1 2024-09-16T03:26:48.926 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test5' already exists 2024-09-16T03:26:48.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:26:49.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test5 size 2 2024-09-16T03:26:50.721 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 5 size to 2 2024-09-16T03:26:50.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:26:50.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test6 1 1 2024-09-16T03:26:50.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test6 1 1 2024-09-16T03:26:51.375 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test6' already exists 2024-09-16T03:26:51.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:26:52.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test6 size 2 2024-09-16T03:26:53.186 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 6 size to 2 2024-09-16T03:26:53.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:26:53.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test7 1 1 2024-09-16T03:26:53.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test7 1 1 2024-09-16T03:26:53.872 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test7' already exists 2024-09-16T03:26:53.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:26:54.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test7 size 2 2024-09-16T03:26:55.601 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 7 size to 2 2024-09-16T03:26:55.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:26:55.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test8 1 1 2024-09-16T03:26:55.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test8 1 1 2024-09-16T03:26:56.398 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test8' already exists 2024-09-16T03:26:56.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:26:57.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test8 size 2 2024-09-16T03:26:58.234 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 8 size to 2 2024-09-16T03:26:58.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:26:58.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test9 1 1 2024-09-16T03:26:58.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test9 1 1 2024-09-16T03:26:58.855 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test9' already exists 2024-09-16T03:26:58.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:26:59.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test9 size 2 2024-09-16T03:27:00.715 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 9 size to 2 2024-09-16T03:27:00.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:65: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:00.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:67: TEST_backfill_priority: create_pool test10 1 1 2024-09-16T03:27:00.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test10 1 1 2024-09-16T03:27:01.725 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test10' already exists 2024-09-16T03:27:01.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:27:02.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:68: TEST_backfill_priority: ceph osd pool set test10 size 2 2024-09-16T03:27:03.533 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 10 size to 2 2024-09-16T03:27:03.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:70: TEST_backfill_priority: sleep 5 2024-09-16T03:27:08.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:72: TEST_backfill_priority: wait_for_clean 2024-09-16T03:27:08.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:27:08.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:27:08.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:27:08.549 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:27:08.549 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:27:08.550 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:27:08.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:27:08.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:27:08.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:27:08.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:27:08.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:27:08.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:27:08.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:27:08.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:27:08.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:27:09.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:27:09.112 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:27:09.112 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:27:09.113 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:27:09.113 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T03:27:09.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:27:09.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:27:09.113 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:27:09.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836499 2024-09-16T03:27:09.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836499 2024-09-16T03:27:09.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836499' 2024-09-16T03:27:09.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:27:09.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:27:09.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672977 2024-09-16T03:27:09.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672977 2024-09-16T03:27:09.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836499 1-42949672977' 2024-09-16T03:27:09.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:27:09.388 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:27:09.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509454 2024-09-16T03:27:09.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509454 2024-09-16T03:27:09.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836499 1-42949672977 2-64424509454' 2024-09-16T03:27:09.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:27:09.511 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:27:09.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345932 2024-09-16T03:27:09.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345932 2024-09-16T03:27:09.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836499 1-42949672977 2-64424509454 3-85899345932' 2024-09-16T03:27:09.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:27:09.635 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:27:09.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182409 2024-09-16T03:27:09.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182409 2024-09-16T03:27:09.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836499 1-42949672977 2-64424509454 3-85899345932 4-107374182409' 2024-09-16T03:27:09.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:27:09.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836499 2024-09-16T03:27:09.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:27:09.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:27:09.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836499 2024-09-16T03:27:09.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:27:09.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836499 2024-09-16T03:27:09.760 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836499 2024-09-16T03:27:09.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836499' 2024-09-16T03:27:09.760 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:27:10.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836497 -lt 21474836499 2024-09-16T03:27:10.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:27:11.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:27:11.200 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:27:11.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836500 -lt 21474836499 2024-09-16T03:27:11.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:27:11.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672977 2024-09-16T03:27:11.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:27:11.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:27:11.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672977 2024-09-16T03:27:11.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:27:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672977 2024-09-16T03:27:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672977' 2024-09-16T03:27:11.671 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672977 2024-09-16T03:27:11.671 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:27:12.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672977 -lt 42949672977 2024-09-16T03:27:12.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:27:12.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509454 2024-09-16T03:27:12.120 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:27:12.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:27:12.121 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509454 2024-09-16T03:27:12.121 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:27:12.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509454 2024-09-16T03:27:12.122 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509454 2024-09-16T03:27:12.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509454' 2024-09-16T03:27:12.122 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:27:12.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509455 -lt 64424509454 2024-09-16T03:27:12.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:27:12.562 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345932 2024-09-16T03:27:12.562 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:27:12.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:27:12.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345932 2024-09-16T03:27:12.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:27:12.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345932 2024-09-16T03:27:12.564 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345932 2024-09-16T03:27:12.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345932' 2024-09-16T03:27:12.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:27:13.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345932 -lt 85899345932 2024-09-16T03:27:13.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:27:13.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182409 2024-09-16T03:27:13.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:27:13.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:27:13.007 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182409 2024-09-16T03:27:13.007 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:27:13.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182409 2024-09-16T03:27:13.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182409' 2024-09-16T03:27:13.008 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182409 2024-09-16T03:27:13.008 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:27:13.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182410 -lt 107374182409 2024-09-16T03:27:13.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:27:13.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:27:13.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:27:14.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 10 == 0 2024-09-16T03:27:14.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:27:14.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:27:14.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:27:14.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:27:14.067 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:27:14.067 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:27:14.067 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:27:14.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=10 2024-09-16T03:27:14.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:27:14.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:27:14.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:27:15.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 10 = 10 2024-09-16T03:27:15.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:27:15.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:27:15.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:74: TEST_backfill_priority: ceph pg dump pgs 2024-09-16T03:27:15.513 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T03:27:15.513 INFO:tasks.workunit.client.0.smithi026.stdout:10.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:27:04.571116+0000 0'0 81:25 [2,1] 2 [2,1] 2 0'0 2024-09-16T03:27:01.090888+0000 0'0 2024-09-16T03:27:01.090888+0000 0 0 periodic scrub scheduled @ 2024-09-17T12:40:03.272036+0000 0 0 2024-09-16T03:27:15.513 INFO:tasks.workunit.client.0.smithi026.stdout:9.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:27:01.240243+0000 0'0 81:28 [1,2] 1 [1,2] 1 0'0 2024-09-16T03:26:58.568251+0000 0'0 2024-09-16T03:26:58.568251+0000 0 0 periodic scrub scheduled @ 2024-09-17T11:44:35.433578+0000 0 0 2024-09-16T03:27:15.513 INFO:tasks.workunit.client.0.smithi026.stdout:8.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:26:58.963393+0000 0'0 81:41 [3,4] 3 [3,4] 3 0'0 2024-09-16T03:26:56.103947+0000 0'0 2024-09-16T03:26:56.103947+0000 0 0 periodic scrub scheduled @ 2024-09-17T11:44:59.186473+0000 0 0 2024-09-16T03:27:15.513 INFO:tasks.workunit.client.0.smithi026.stdout:7.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:26:56.783053+0000 0'0 81:55 [1,4] 1 [1,4] 1 0'0 2024-09-16T03:26:53.573934+0000 0'0 2024-09-16T03:26:53.573934+0000 0 0 periodic scrub scheduled @ 2024-09-17T09:41:22.262333+0000 0 0 2024-09-16T03:27:15.513 INFO:tasks.workunit.client.0.smithi026.stdout:6.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:26:54.317314+0000 0'0 81:61 [4,2] 4 [4,2] 4 0'0 2024-09-16T03:26:51.080741+0000 0'0 2024-09-16T03:26:51.080741+0000 0 0 periodic scrub scheduled @ 2024-09-17T14:54:08.945034+0000 0 0 2024-09-16T03:27:15.513 INFO:tasks.workunit.client.0.smithi026.stdout:5.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:26:51.500621+0000 0'0 81:64 [3,4] 3 [3,4] 3 0'0 2024-09-16T03:26:48.762261+0000 0'0 2024-09-16T03:26:48.762261+0000 0 0 periodic scrub scheduled @ 2024-09-17T04:32:33.516163+0000 0 0 2024-09-16T03:27:15.513 INFO:tasks.workunit.client.0.smithi026.stdout:4.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:26:49.113295+0000 0'0 81:80 [4,0] 4 [4,0] 4 0'0 2024-09-16T03:26:46.169359+0000 0'0 2024-09-16T03:26:46.169359+0000 0 0 periodic scrub scheduled @ 2024-09-17T07:11:28.165902+0000 0 0 2024-09-16T03:27:15.513 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:26:46.480567+0000 0'0 81:86 [1,2] 1 [1,2] 1 0'0 2024-09-16T03:26:43.428192+0000 0'0 2024-09-16T03:26:43.428192+0000 0 0 periodic scrub scheduled @ 2024-09-17T03:58:19.782541+0000 0 0 2024-09-16T03:27:15.514 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:26:44.460098+0000 0'0 81:91 [3,1] 3 [3,1] 3 0'0 2024-09-16T03:26:40.959301+0000 0'0 2024-09-16T03:26:40.959301+0000 0 0 periodic scrub scheduled @ 2024-09-17T08:48:02.780353+0000 0 0 2024-09-16T03:27:15.514 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:26:40.885481+0000 0'0 81:110 [1,0] 1 [1,0] 1 0'0 2024-09-16T03:26:38.075611+0000 0'0 2024-09-16T03:26:38.075611+0000 0 0 periodic scrub scheduled @ 2024-09-17T12:09:35.632811+0000 0 0 2024-09-16T03:27:15.514 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T03:27:15.514 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T03:27:15.514 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:78: TEST_backfill_priority: local PG1 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:79: TEST_backfill_priority: local POOLNUM1 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:80: TEST_backfill_priority: local pool1 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:81: TEST_backfill_priority: local chk_osd1_1 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:82: TEST_backfill_priority: local chk_osd1_2 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:84: TEST_backfill_priority: local PG2 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:85: TEST_backfill_priority: local POOLNUM2 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:86: TEST_backfill_priority: local pool2 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:87: TEST_backfill_priority: local chk_osd2 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:89: TEST_backfill_priority: local PG3 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:90: TEST_backfill_priority: local POOLNUM3 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:91: TEST_backfill_priority: local pool3 2024-09-16T03:27:15.525 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: seq 1 10 2024-09-16T03:27:15.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:15.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 1.0 --format=json 2024-09-16T03:27:15.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-09-16T03:27:15.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-09-16T03:27:15.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=1 2024-09-16T03:27:15.962 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-09-16T03:27:15.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=0 2024-09-16T03:27:15.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z '' ']' 2024-09-16T03:27:15.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:100: TEST_backfill_priority: PG1=1.0 2024-09-16T03:27:15.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:101: TEST_backfill_priority: POOLNUM1=1 2024-09-16T03:27:15.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:102: TEST_backfill_priority: pool1=test1 2024-09-16T03:27:15.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:103: TEST_backfill_priority: chk_osd1_1=1 2024-09-16T03:27:15.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:104: TEST_backfill_priority: chk_osd1_2=0 2024-09-16T03:27:15.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:15.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 2.0 --format=json 2024-09-16T03:27:15.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-09-16T03:27:16.364 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-09-16T03:27:16.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=3 2024-09-16T03:27:16.365 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-09-16T03:27:16.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=1 2024-09-16T03:27:16.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z 1.0 ']' 2024-09-16T03:27:16.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:105: TEST_backfill_priority: '[' -z '' -a 1 = 3 -a 0 '!=' 1 ']' 2024-09-16T03:27:16.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:111: TEST_backfill_priority: '[' -n '' -a 1 = 3 -a 0 '!=' 1 -a '' '!=' 1 ']' 2024-09-16T03:27:16.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:16.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 3.0 --format=json 2024-09-16T03:27:16.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-09-16T03:27:16.805 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-09-16T03:27:16.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=1 2024-09-16T03:27:16.806 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-09-16T03:27:16.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=2 2024-09-16T03:27:16.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z 1.0 ']' 2024-09-16T03:27:16.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:105: TEST_backfill_priority: '[' -z '' -a 1 = 1 -a 0 '!=' 2 ']' 2024-09-16T03:27:16.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:107: TEST_backfill_priority: PG2=3.0 2024-09-16T03:27:16.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:108: TEST_backfill_priority: POOLNUM2=3 2024-09-16T03:27:16.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:109: TEST_backfill_priority: pool2=test3 2024-09-16T03:27:16.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:110: TEST_backfill_priority: chk_osd2=2 2024-09-16T03:27:16.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:16.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 4.0 --format=json 2024-09-16T03:27:16.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-09-16T03:27:17.212 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-09-16T03:27:17.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=4 2024-09-16T03:27:17.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-09-16T03:27:17.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=0 2024-09-16T03:27:17.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z 1.0 ']' 2024-09-16T03:27:17.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:105: TEST_backfill_priority: '[' -z 3.0 -a 1 = 4 -a 0 '!=' 0 ']' 2024-09-16T03:27:17.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:111: TEST_backfill_priority: '[' -n 3.0 -a 1 = 4 -a 0 '!=' 0 -a 2 '!=' 0 ']' 2024-09-16T03:27:17.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:17.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 5.0 --format=json 2024-09-16T03:27:17.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-09-16T03:27:17.647 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-09-16T03:27:17.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=3 2024-09-16T03:27:17.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-09-16T03:27:17.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=4 2024-09-16T03:27:17.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z 1.0 ']' 2024-09-16T03:27:17.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:105: TEST_backfill_priority: '[' -z 3.0 -a 1 = 3 -a 0 '!=' 4 ']' 2024-09-16T03:27:17.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:111: TEST_backfill_priority: '[' -n 3.0 -a 1 = 3 -a 0 '!=' 4 -a 2 '!=' 4 ']' 2024-09-16T03:27:17.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:17.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 6.0 --format=json 2024-09-16T03:27:17.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-09-16T03:27:18.102 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-09-16T03:27:18.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=4 2024-09-16T03:27:18.103 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-09-16T03:27:18.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=2 2024-09-16T03:27:18.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z 1.0 ']' 2024-09-16T03:27:18.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:105: TEST_backfill_priority: '[' -z 3.0 -a 1 = 4 -a 0 '!=' 2 ']' 2024-09-16T03:27:18.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:111: TEST_backfill_priority: '[' -n 3.0 -a 1 = 4 -a 0 '!=' 2 -a 2 '!=' 2 ']' 2024-09-16T03:27:18.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:93: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:18.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: ceph pg map 7.0 --format=json 2024-09-16T03:27:18.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:95: TEST_backfill_priority: jq '.acting[]' 2024-09-16T03:27:18.544 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: head -1 td/osd-backfill-prio/acting 2024-09-16T03:27:18.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:96: TEST_backfill_priority: local test_osd1=1 2024-09-16T03:27:18.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: tail -1 td/osd-backfill-prio/acting 2024-09-16T03:27:18.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:97: TEST_backfill_priority: local test_osd2=4 2024-09-16T03:27:18.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:98: TEST_backfill_priority: '[' -z 1.0 ']' 2024-09-16T03:27:18.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:105: TEST_backfill_priority: '[' -z 3.0 -a 1 = 1 -a 0 '!=' 4 ']' 2024-09-16T03:27:18.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:111: TEST_backfill_priority: '[' -n 3.0 -a 1 = 1 -a 0 '!=' 4 -a 2 '!=' 4 ']' 2024-09-16T03:27:18.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:113: TEST_backfill_priority: PG3=7.0 2024-09-16T03:27:18.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:114: TEST_backfill_priority: POOLNUM3=7 2024-09-16T03:27:18.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:115: TEST_backfill_priority: pool3=test7 2024-09-16T03:27:18.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:116: TEST_backfill_priority: break 2024-09-16T03:27:18.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:119: TEST_backfill_priority: rm -f td/osd-backfill-prio/acting 2024-09-16T03:27:18.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:121: TEST_backfill_priority: '[' test3 = '' -o pool3 = '' ']' 2024-09-16T03:27:18.548 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: seq 1 10 2024-09-16T03:27:18.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:18.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 1 '!=' 1 -a 1 '!=' 3 -a 1 '!=' 7 ']' 2024-09-16T03:27:18.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:18.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 2 '!=' 1 -a 2 '!=' 3 -a 2 '!=' 7 ']' 2024-09-16T03:27:18.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test2 2024-09-16T03:27:18.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test2 2024-09-16T03:27:18.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-09-16T03:27:19.095 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' does not exist 2024-09-16T03:27:19.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:19.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 3 '!=' 1 -a 3 '!=' 3 -a 3 '!=' 7 ']' 2024-09-16T03:27:19.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:19.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 4 '!=' 1 -a 4 '!=' 3 -a 4 '!=' 7 ']' 2024-09-16T03:27:19.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test4 2024-09-16T03:27:19.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test4 2024-09-16T03:27:19.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test4 test4 --yes-i-really-really-mean-it 2024-09-16T03:27:19.786 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test4' does not exist 2024-09-16T03:27:19.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:19.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 5 '!=' 1 -a 5 '!=' 3 -a 5 '!=' 7 ']' 2024-09-16T03:27:19.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test5 2024-09-16T03:27:19.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test5 2024-09-16T03:27:19.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test5 test5 --yes-i-really-really-mean-it 2024-09-16T03:27:20.301 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test5' does not exist 2024-09-16T03:27:20.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:20.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 6 '!=' 1 -a 6 '!=' 3 -a 6 '!=' 7 ']' 2024-09-16T03:27:20.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test6 2024-09-16T03:27:20.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test6 2024-09-16T03:27:20.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test6 test6 --yes-i-really-really-mean-it 2024-09-16T03:27:20.889 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test6' does not exist 2024-09-16T03:27:20.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:20.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 7 '!=' 1 -a 7 '!=' 3 -a 7 '!=' 7 ']' 2024-09-16T03:27:20.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:20.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 8 '!=' 1 -a 8 '!=' 3 -a 8 '!=' 7 ']' 2024-09-16T03:27:20.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test8 2024-09-16T03:27:20.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test8 2024-09-16T03:27:20.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test8 test8 --yes-i-really-really-mean-it 2024-09-16T03:27:21.614 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test8' does not exist 2024-09-16T03:27:21.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:21.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 9 '!=' 1 -a 9 '!=' 3 -a 9 '!=' 7 ']' 2024-09-16T03:27:21.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test9 2024-09-16T03:27:21.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test9 2024-09-16T03:27:21.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test9 test9 --yes-i-really-really-mean-it 2024-09-16T03:27:22.135 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test9' does not exist 2024-09-16T03:27:22.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:127: TEST_backfill_priority: for p in $(seq 1 $pools) 2024-09-16T03:27:22.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:129: TEST_backfill_priority: '[' 10 '!=' 1 -a 10 '!=' 3 -a 10 '!=' 7 ']' 2024-09-16T03:27:22.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:131: TEST_backfill_priority: delete_pool test10 2024-09-16T03:27:22.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test10 2024-09-16T03:27:22.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test10 test10 --yes-i-really-really-mean-it 2024-09-16T03:27:22.753 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test10' does not exist 2024-09-16T03:27:22.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:135: TEST_backfill_priority: ceph osd pool set test3 size 1 --yes-i-really-mean-it 2024-09-16T03:27:23.700 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 3 size to 1 2024-09-16T03:27:23.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:136: TEST_backfill_priority: ceph osd pool set test7 size 1 --yes-i-really-mean-it 2024-09-16T03:27:24.732 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 7 size to 1 2024-09-16T03:27:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:137: TEST_backfill_priority: wait_for_clean 2024-09-16T03:27:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:27:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:27:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:27:24.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:27:24.746 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:27:24.746 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:27:24.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:27:24.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:27:24.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:27:24.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:27:24.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:27:24.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:27:24.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:27:24.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:27:24.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:27:25.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:27:25.289 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:27:25.289 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:27:25.289 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:27:25.289 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T03:27:25.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:27:25.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:27:25.290 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:27:25.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836505 2024-09-16T03:27:25.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836505 2024-09-16T03:27:25.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836505' 2024-09-16T03:27:25.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:27:25.433 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:27:25.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672982 2024-09-16T03:27:25.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672982 2024-09-16T03:27:25.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836505 1-42949672982' 2024-09-16T03:27:25.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:27:25.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:27:25.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509460 2024-09-16T03:27:25.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509460 2024-09-16T03:27:25.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836505 1-42949672982 2-64424509460' 2024-09-16T03:27:25.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:27:25.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:27:25.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345937 2024-09-16T03:27:25.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345937 2024-09-16T03:27:25.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836505 1-42949672982 2-64424509460 3-85899345937' 2024-09-16T03:27:25.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:27:25.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:27:26.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182414 2024-09-16T03:27:26.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182414 2024-09-16T03:27:26.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836505 1-42949672982 2-64424509460 3-85899345937 4-107374182414' 2024-09-16T03:27:26.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:27:26.033 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836505 2024-09-16T03:27:26.033 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:27:26.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:27:26.034 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836505 2024-09-16T03:27:26.034 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:27:26.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836505 2024-09-16T03:27:26.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836505' 2024-09-16T03:27:26.035 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836505 2024-09-16T03:27:26.035 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:27:26.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836503 -lt 21474836505 2024-09-16T03:27:26.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:27:27.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:27:27.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:27:27.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836505 -lt 21474836505 2024-09-16T03:27:27.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:27:27.957 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672982 2024-09-16T03:27:27.957 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:27:27.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:27:27.957 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672982 2024-09-16T03:27:27.957 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:27:27.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672982 2024-09-16T03:27:27.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672982' 2024-09-16T03:27:27.958 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672982 2024-09-16T03:27:27.959 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:27:28.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672982 -lt 42949672982 2024-09-16T03:27:28.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:27:28.398 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509460 2024-09-16T03:27:28.398 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:27:28.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:27:28.399 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509460 2024-09-16T03:27:28.399 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:27:28.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509460 2024-09-16T03:27:28.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509460' 2024-09-16T03:27:28.401 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509460 2024-09-16T03:27:28.401 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:27:28.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509460 -lt 64424509460 2024-09-16T03:27:28.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:27:28.841 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345937 2024-09-16T03:27:28.841 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:27:28.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:27:28.842 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345937 2024-09-16T03:27:28.842 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:27:28.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345937 2024-09-16T03:27:28.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345937' 2024-09-16T03:27:28.844 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345937 2024-09-16T03:27:28.844 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:27:29.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345937 -lt 85899345937 2024-09-16T03:27:29.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:27:29.298 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182414 2024-09-16T03:27:29.298 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:27:29.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:27:29.299 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182414 2024-09-16T03:27:29.299 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:27:29.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182414 2024-09-16T03:27:29.301 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182414 2024-09-16T03:27:29.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182414' 2024-09-16T03:27:29.301 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:27:29.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182415 -lt 107374182414 2024-09-16T03:27:29.777 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:27:29.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:27:29.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:27:30.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 3 == 0 2024-09-16T03:27:30.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:27:30.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:27:30.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:27:30.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:27:30.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:27:30.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:27:30.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:27:30.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=3 2024-09-16T03:27:30.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:27:30.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:27:30.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:27:31.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 3 = 3 2024-09-16T03:27:31.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:27:31.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:27:31.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:139: TEST_backfill_priority: dd if=/dev/urandom of=td/osd-backfill-prio/data bs=1M count=10 2024-09-16T03:27:31.352 INFO:tasks.workunit.client.0.smithi026.stderr:10+0 records in 2024-09-16T03:27:31.352 INFO:tasks.workunit.client.0.smithi026.stderr:10+0 records out 2024-09-16T03:27:31.352 INFO:tasks.workunit.client.0.smithi026.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0280522 s, 374 MB/s 2024-09-16T03:27:31.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:140: TEST_backfill_priority: p=1 2024-09-16T03:27:31.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:141: TEST_backfill_priority: for pname in $pool1 $pool2 $pool3 2024-09-16T03:27:31.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: seq 1 50 2024-09-16T03:27:31.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:31.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj1-p1 td/osd-backfill-prio/data 2024-09-16T03:27:32.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:32.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj2-p1 td/osd-backfill-prio/data 2024-09-16T03:27:32.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:32.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj3-p1 td/osd-backfill-prio/data 2024-09-16T03:27:33.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:33.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj4-p1 td/osd-backfill-prio/data 2024-09-16T03:27:34.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:34.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj5-p1 td/osd-backfill-prio/data 2024-09-16T03:27:34.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:34.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj6-p1 td/osd-backfill-prio/data 2024-09-16T03:27:35.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:35.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj7-p1 td/osd-backfill-prio/data 2024-09-16T03:27:36.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:36.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj8-p1 td/osd-backfill-prio/data 2024-09-16T03:27:36.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:36.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj9-p1 td/osd-backfill-prio/data 2024-09-16T03:27:37.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:37.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj10-p1 td/osd-backfill-prio/data 2024-09-16T03:27:38.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:38.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj11-p1 td/osd-backfill-prio/data 2024-09-16T03:27:38.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:38.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj12-p1 td/osd-backfill-prio/data 2024-09-16T03:27:39.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:39.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj13-p1 td/osd-backfill-prio/data 2024-09-16T03:27:40.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:40.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj14-p1 td/osd-backfill-prio/data 2024-09-16T03:27:40.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:40.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj15-p1 td/osd-backfill-prio/data 2024-09-16T03:27:41.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:41.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj16-p1 td/osd-backfill-prio/data 2024-09-16T03:27:42.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:42.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj17-p1 td/osd-backfill-prio/data 2024-09-16T03:27:42.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:42.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj18-p1 td/osd-backfill-prio/data 2024-09-16T03:27:43.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:43.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj19-p1 td/osd-backfill-prio/data 2024-09-16T03:27:44.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:44.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj20-p1 td/osd-backfill-prio/data 2024-09-16T03:27:44.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:44.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj21-p1 td/osd-backfill-prio/data 2024-09-16T03:27:45.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:45.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj22-p1 td/osd-backfill-prio/data 2024-09-16T03:27:46.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:46.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj23-p1 td/osd-backfill-prio/data 2024-09-16T03:27:46.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:46.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj24-p1 td/osd-backfill-prio/data 2024-09-16T03:27:47.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:47.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj25-p1 td/osd-backfill-prio/data 2024-09-16T03:27:48.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:48.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj26-p1 td/osd-backfill-prio/data 2024-09-16T03:27:48.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:48.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj27-p1 td/osd-backfill-prio/data 2024-09-16T03:27:49.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:49.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj28-p1 td/osd-backfill-prio/data 2024-09-16T03:27:50.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:50.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj29-p1 td/osd-backfill-prio/data 2024-09-16T03:27:50.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:50.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj30-p1 td/osd-backfill-prio/data 2024-09-16T03:27:51.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:51.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj31-p1 td/osd-backfill-prio/data 2024-09-16T03:27:52.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:52.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj32-p1 td/osd-backfill-prio/data 2024-09-16T03:27:52.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:52.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj33-p1 td/osd-backfill-prio/data 2024-09-16T03:27:53.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:53.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj34-p1 td/osd-backfill-prio/data 2024-09-16T03:27:54.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:54.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj35-p1 td/osd-backfill-prio/data 2024-09-16T03:27:54.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:54.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj36-p1 td/osd-backfill-prio/data 2024-09-16T03:27:55.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:55.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj37-p1 td/osd-backfill-prio/data 2024-09-16T03:27:56.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:56.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj38-p1 td/osd-backfill-prio/data 2024-09-16T03:27:56.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:56.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj39-p1 td/osd-backfill-prio/data 2024-09-16T03:27:57.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:57.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj40-p1 td/osd-backfill-prio/data 2024-09-16T03:27:58.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:58.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj41-p1 td/osd-backfill-prio/data 2024-09-16T03:27:58.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:58.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj42-p1 td/osd-backfill-prio/data 2024-09-16T03:27:59.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:27:59.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj43-p1 td/osd-backfill-prio/data 2024-09-16T03:28:00.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:00.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj44-p1 td/osd-backfill-prio/data 2024-09-16T03:28:00.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:00.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj45-p1 td/osd-backfill-prio/data 2024-09-16T03:28:01.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:01.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj46-p1 td/osd-backfill-prio/data 2024-09-16T03:28:02.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:02.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj47-p1 td/osd-backfill-prio/data 2024-09-16T03:28:02.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:02.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj48-p1 td/osd-backfill-prio/data 2024-09-16T03:28:03.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:03.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj49-p1 td/osd-backfill-prio/data 2024-09-16T03:28:04.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:04.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test1 put obj50-p1 td/osd-backfill-prio/data 2024-09-16T03:28:05.017 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:147: TEST_backfill_priority: expr 1 + 1 2024-09-16T03:28:05.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:147: TEST_backfill_priority: p=2 2024-09-16T03:28:05.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:141: TEST_backfill_priority: for pname in $pool1 $pool2 $pool3 2024-09-16T03:28:05.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: seq 1 50 2024-09-16T03:28:05.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:05.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj1-p2 td/osd-backfill-prio/data 2024-09-16T03:28:05.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:05.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj2-p2 td/osd-backfill-prio/data 2024-09-16T03:28:05.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:05.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj3-p2 td/osd-backfill-prio/data 2024-09-16T03:28:06.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:06.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj4-p2 td/osd-backfill-prio/data 2024-09-16T03:28:06.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:06.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj5-p2 td/osd-backfill-prio/data 2024-09-16T03:28:06.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:06.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj6-p2 td/osd-backfill-prio/data 2024-09-16T03:28:07.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:07.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj7-p2 td/osd-backfill-prio/data 2024-09-16T03:28:07.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:07.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj8-p2 td/osd-backfill-prio/data 2024-09-16T03:28:08.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:08.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj9-p2 td/osd-backfill-prio/data 2024-09-16T03:28:08.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:08.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj10-p2 td/osd-backfill-prio/data 2024-09-16T03:28:08.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:08.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj11-p2 td/osd-backfill-prio/data 2024-09-16T03:28:09.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:09.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj12-p2 td/osd-backfill-prio/data 2024-09-16T03:28:09.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:09.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj13-p2 td/osd-backfill-prio/data 2024-09-16T03:28:09.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:09.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj14-p2 td/osd-backfill-prio/data 2024-09-16T03:28:10.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:10.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj15-p2 td/osd-backfill-prio/data 2024-09-16T03:28:10.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:10.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj16-p2 td/osd-backfill-prio/data 2024-09-16T03:28:11.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:11.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj17-p2 td/osd-backfill-prio/data 2024-09-16T03:28:11.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:11.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj18-p2 td/osd-backfill-prio/data 2024-09-16T03:28:11.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:11.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj19-p2 td/osd-backfill-prio/data 2024-09-16T03:28:12.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:12.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj20-p2 td/osd-backfill-prio/data 2024-09-16T03:28:12.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:12.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj21-p2 td/osd-backfill-prio/data 2024-09-16T03:28:12.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:12.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj22-p2 td/osd-backfill-prio/data 2024-09-16T03:28:13.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:13.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj23-p2 td/osd-backfill-prio/data 2024-09-16T03:28:13.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:13.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj24-p2 td/osd-backfill-prio/data 2024-09-16T03:28:14.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:14.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj25-p2 td/osd-backfill-prio/data 2024-09-16T03:28:14.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:14.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj26-p2 td/osd-backfill-prio/data 2024-09-16T03:28:14.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:14.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj27-p2 td/osd-backfill-prio/data 2024-09-16T03:28:15.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:15.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj28-p2 td/osd-backfill-prio/data 2024-09-16T03:28:15.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:15.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj29-p2 td/osd-backfill-prio/data 2024-09-16T03:28:15.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:15.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj30-p2 td/osd-backfill-prio/data 2024-09-16T03:28:16.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:16.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj31-p2 td/osd-backfill-prio/data 2024-09-16T03:28:16.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:16.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj32-p2 td/osd-backfill-prio/data 2024-09-16T03:28:17.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:17.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj33-p2 td/osd-backfill-prio/data 2024-09-16T03:28:17.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:17.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj34-p2 td/osd-backfill-prio/data 2024-09-16T03:28:17.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:17.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj35-p2 td/osd-backfill-prio/data 2024-09-16T03:28:18.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:18.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj36-p2 td/osd-backfill-prio/data 2024-09-16T03:28:18.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:18.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj37-p2 td/osd-backfill-prio/data 2024-09-16T03:28:18.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:18.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj38-p2 td/osd-backfill-prio/data 2024-09-16T03:28:19.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:19.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj39-p2 td/osd-backfill-prio/data 2024-09-16T03:28:19.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:19.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj40-p2 td/osd-backfill-prio/data 2024-09-16T03:28:19.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:19.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj41-p2 td/osd-backfill-prio/data 2024-09-16T03:28:20.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:20.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj42-p2 td/osd-backfill-prio/data 2024-09-16T03:28:20.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:20.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj43-p2 td/osd-backfill-prio/data 2024-09-16T03:28:21.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:21.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj44-p2 td/osd-backfill-prio/data 2024-09-16T03:28:21.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:21.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj45-p2 td/osd-backfill-prio/data 2024-09-16T03:28:21.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:21.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj46-p2 td/osd-backfill-prio/data 2024-09-16T03:28:22.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:22.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj47-p2 td/osd-backfill-prio/data 2024-09-16T03:28:22.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:22.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj48-p2 td/osd-backfill-prio/data 2024-09-16T03:28:22.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:22.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj49-p2 td/osd-backfill-prio/data 2024-09-16T03:28:23.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:23.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test3 put obj50-p2 td/osd-backfill-prio/data 2024-09-16T03:28:23.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:147: TEST_backfill_priority: expr 2 + 1 2024-09-16T03:28:23.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:147: TEST_backfill_priority: p=3 2024-09-16T03:28:23.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:141: TEST_backfill_priority: for pname in $pool1 $pool2 $pool3 2024-09-16T03:28:23.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: seq 1 50 2024-09-16T03:28:23.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:23.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj1-p3 td/osd-backfill-prio/data 2024-09-16T03:28:24.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:24.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj2-p3 td/osd-backfill-prio/data 2024-09-16T03:28:24.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:24.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj3-p3 td/osd-backfill-prio/data 2024-09-16T03:28:24.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:24.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj4-p3 td/osd-backfill-prio/data 2024-09-16T03:28:25.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:25.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj5-p3 td/osd-backfill-prio/data 2024-09-16T03:28:25.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:25.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj6-p3 td/osd-backfill-prio/data 2024-09-16T03:28:25.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:25.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj7-p3 td/osd-backfill-prio/data 2024-09-16T03:28:26.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:26.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj8-p3 td/osd-backfill-prio/data 2024-09-16T03:28:26.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:26.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj9-p3 td/osd-backfill-prio/data 2024-09-16T03:28:27.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:27.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj10-p3 td/osd-backfill-prio/data 2024-09-16T03:28:27.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:27.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj11-p3 td/osd-backfill-prio/data 2024-09-16T03:28:27.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:27.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj12-p3 td/osd-backfill-prio/data 2024-09-16T03:28:28.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:28.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj13-p3 td/osd-backfill-prio/data 2024-09-16T03:28:28.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:28.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj14-p3 td/osd-backfill-prio/data 2024-09-16T03:28:28.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:28.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj15-p3 td/osd-backfill-prio/data 2024-09-16T03:28:29.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:29.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj16-p3 td/osd-backfill-prio/data 2024-09-16T03:28:29.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:29.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj17-p3 td/osd-backfill-prio/data 2024-09-16T03:28:30.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:30.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj18-p3 td/osd-backfill-prio/data 2024-09-16T03:28:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj19-p3 td/osd-backfill-prio/data 2024-09-16T03:28:30.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:30.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj20-p3 td/osd-backfill-prio/data 2024-09-16T03:28:31.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:31.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj21-p3 td/osd-backfill-prio/data 2024-09-16T03:28:31.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:31.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj22-p3 td/osd-backfill-prio/data 2024-09-16T03:28:32.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:32.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj23-p3 td/osd-backfill-prio/data 2024-09-16T03:28:32.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:32.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj24-p3 td/osd-backfill-prio/data 2024-09-16T03:28:32.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:32.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj25-p3 td/osd-backfill-prio/data 2024-09-16T03:28:33.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:33.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj26-p3 td/osd-backfill-prio/data 2024-09-16T03:28:33.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:33.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj27-p3 td/osd-backfill-prio/data 2024-09-16T03:28:33.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:33.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj28-p3 td/osd-backfill-prio/data 2024-09-16T03:28:34.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:34.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj29-p3 td/osd-backfill-prio/data 2024-09-16T03:28:34.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:34.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj30-p3 td/osd-backfill-prio/data 2024-09-16T03:28:34.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:34.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj31-p3 td/osd-backfill-prio/data 2024-09-16T03:28:35.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:35.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj32-p3 td/osd-backfill-prio/data 2024-09-16T03:28:35.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:35.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj33-p3 td/osd-backfill-prio/data 2024-09-16T03:28:36.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:36.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj34-p3 td/osd-backfill-prio/data 2024-09-16T03:28:36.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:36.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj35-p3 td/osd-backfill-prio/data 2024-09-16T03:28:36.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:36.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj36-p3 td/osd-backfill-prio/data 2024-09-16T03:28:37.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:37.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj37-p3 td/osd-backfill-prio/data 2024-09-16T03:28:37.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:37.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj38-p3 td/osd-backfill-prio/data 2024-09-16T03:28:38.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:38.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj39-p3 td/osd-backfill-prio/data 2024-09-16T03:28:38.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:38.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj40-p3 td/osd-backfill-prio/data 2024-09-16T03:28:38.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:38.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj41-p3 td/osd-backfill-prio/data 2024-09-16T03:28:39.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:39.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj42-p3 td/osd-backfill-prio/data 2024-09-16T03:28:39.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:39.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj43-p3 td/osd-backfill-prio/data 2024-09-16T03:28:39.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:39.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj44-p3 td/osd-backfill-prio/data 2024-09-16T03:28:40.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:40.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj45-p3 td/osd-backfill-prio/data 2024-09-16T03:28:40.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:40.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj46-p3 td/osd-backfill-prio/data 2024-09-16T03:28:41.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:41.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj47-p3 td/osd-backfill-prio/data 2024-09-16T03:28:41.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:41.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj48-p3 td/osd-backfill-prio/data 2024-09-16T03:28:41.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:41.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj49-p3 td/osd-backfill-prio/data 2024-09-16T03:28:42.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:143: TEST_backfill_priority: for i in $(seq 1 $objects) 2024-09-16T03:28:42.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:145: TEST_backfill_priority: rados -p test7 put obj50-p3 td/osd-backfill-prio/data 2024-09-16T03:28:42.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:147: TEST_backfill_priority: expr 3 + 1 2024-09-16T03:28:42.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:147: TEST_backfill_priority: p=4 2024-09-16T03:28:42.509 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:150: TEST_backfill_priority: get_not_primary test1 obj1-p1 2024-09-16T03:28:42.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test1 2024-09-16T03:28:42.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1-p1 2024-09-16T03:28:42.510 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test1 obj1-p1 2024-09-16T03:28:42.511 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test1 2024-09-16T03:28:42.511 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1-p1 2024-09-16T03:28:42.511 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test1 obj1-p1 2024-09-16T03:28:42.511 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T03:28:42.960 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2024-09-16T03:28:42.960 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test1 obj1-p1 2024-09-16T03:28:42.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-09-16T03:28:43.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:150: TEST_backfill_priority: local otherosd=0 2024-09-16T03:28:43.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:152: TEST_backfill_priority: ceph pg dump pgs 2024-09-16T03:28:43.809 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T03:28:43.809 INFO:tasks.workunit.client.0.smithi026.stdout:7.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-09-16T03:27:24.916062+0000 93'150 93:231 [1] 1 [1] 1 0'0 2024-09-16T03:26:53.573934+0000 0'0 2024-09-16T03:26:53.573934+0000 0 0 periodic scrub scheduled @ 2024-09-17T14:57:16.883248+0000 0 0 2024-09-16T03:28:43.809 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-09-16T03:27:24.228978+0000 93'150 93:261 [1] 1 [1] 1 0'0 2024-09-16T03:26:43.428192+0000 0'0 2024-09-16T03:26:43.428192+0000 0 0 periodic scrub scheduled @ 2024-09-17T08:53:55.820205+0000 0 0 2024-09-16T03:28:43.809 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-09-16T03:26:40.885481+0000 93'150 93:282 [1,0] 1 [1,0] 1 0'0 2024-09-16T03:26:38.075611+0000 0'0 2024-09-16T03:26:38.075611+0000 0 0 periodic scrub scheduled @ 2024-09-17T12:09:35.632811+0000 0 0 2024-09-16T03:28:43.810 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T03:28:43.810 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T03:28:43.810 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:28:43.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:153: TEST_backfill_priority: ERRORS=0 2024-09-16T03:28:43.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:155: TEST_backfill_priority: ceph osd set nobackfill 2024-09-16T03:28:44.429 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is set 2024-09-16T03:28:44.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:156: TEST_backfill_priority: ceph osd set noout 2024-09-16T03:28:45.258 INFO:tasks.workunit.client.0.smithi026.stderr:noout is set 2024-09-16T03:28:45.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:160: TEST_backfill_priority: ceph osd pool set test7 size 2 2024-09-16T03:28:46.000 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 7 size to 2 2024-09-16T03:28:46.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:161: TEST_backfill_priority: sleep 2 2024-09-16T03:28:48.014 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:163: TEST_backfill_priority: get_asok_path osd.1 2024-09-16T03:28:48.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2024-09-16T03:28:48.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2024-09-16T03:28:48.015 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:28:48.015 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:28:48.015 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:28:48.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-osd.1.asok 2024-09-16T03:28:48.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:163: TEST_backfill_priority: CEPH_ARGS= 2024-09-16T03:28:48.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:163: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:28:48.107 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:28:48.108 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:28:48.108 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:28:48.108 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:28:48.108 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:28:48.108 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:28:48.108 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:28:48.108 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:28:48.108 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:28:48.108 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:28:48.108 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:28:48.108 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:28:48.109 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:28:48.109 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:28:48.116 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:166: TEST_backfill_priority: seq 1 10 2024-09-16T03:28:48.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:166: TEST_backfill_priority: for i in $(seq 1 $max_tries) 2024-09-16T03:28:48.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:168: TEST_backfill_priority: ceph pg force-backfill 7.0 2024-09-16T03:28:48.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:168: TEST_backfill_priority: grep -q 'doesn'\''t require backfilling' 2024-09-16T03:28:48.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:171: TEST_backfill_priority: '[' 1 = 10 ']' 2024-09-16T03:28:48.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:175: TEST_backfill_priority: sleep 2 2024-09-16T03:28:50.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:166: TEST_backfill_priority: for i in $(seq 1 $max_tries) 2024-09-16T03:28:50.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:168: TEST_backfill_priority: ceph pg force-backfill 7.0 2024-09-16T03:28:50.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:168: TEST_backfill_priority: grep -q 'doesn'\''t require backfilling' 2024-09-16T03:28:50.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:171: TEST_backfill_priority: '[' 2 = 10 ']' 2024-09-16T03:28:50.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:175: TEST_backfill_priority: sleep 2 2024-09-16T03:28:52.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:166: TEST_backfill_priority: for i in $(seq 1 $max_tries) 2024-09-16T03:28:52.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:168: TEST_backfill_priority: ceph pg force-backfill 7.0 2024-09-16T03:28:52.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:168: TEST_backfill_priority: grep -q 'doesn'\''t require backfilling' 2024-09-16T03:28:53.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:169: TEST_backfill_priority: break 2024-09-16T03:28:53.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:177: TEST_backfill_priority: flush_pg_stats 2024-09-16T03:28:53.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:28:53.373 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:28:53.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:28:53.821 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:28:53.821 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:28:53.821 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:28:53.821 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T03:28:53.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:28:53.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:28:53.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:28:53.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836524 2024-09-16T03:28:53.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836524 2024-09-16T03:28:53.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836524' 2024-09-16T03:28:53.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:28:53.944 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:28:54.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673002 2024-09-16T03:28:54.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673002 2024-09-16T03:28:54.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836524 1-42949673002' 2024-09-16T03:28:54.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:28:54.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:28:54.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509479 2024-09-16T03:28:54.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509479 2024-09-16T03:28:54.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836524 1-42949673002 2-64424509479' 2024-09-16T03:28:54.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:28:54.189 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:28:54.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345957 2024-09-16T03:28:54.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345957 2024-09-16T03:28:54.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836524 1-42949673002 2-64424509479 3-85899345957' 2024-09-16T03:28:54.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:28:54.311 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:28:54.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182434 2024-09-16T03:28:54.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182434 2024-09-16T03:28:54.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836524 1-42949673002 2-64424509479 3-85899345957 4-107374182434' 2024-09-16T03:28:54.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:28:54.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836524 2024-09-16T03:28:54.435 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:28:54.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:28:54.436 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836524 2024-09-16T03:28:54.436 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:28:54.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836524 2024-09-16T03:28:54.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836524' 2024-09-16T03:28:54.437 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836524 2024-09-16T03:28:54.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:28:54.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836522 -lt 21474836524 2024-09-16T03:28:54.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:28:55.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:28:55.874 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:28:56.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836525 -lt 21474836524 2024-09-16T03:28:56.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:28:56.359 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673002 2024-09-16T03:28:56.359 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:28:56.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:28:56.360 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673002 2024-09-16T03:28:56.360 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:28:56.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673002 2024-09-16T03:28:56.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673002' 2024-09-16T03:28:56.361 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673002 2024-09-16T03:28:56.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:28:56.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673002 -lt 42949673002 2024-09-16T03:28:56.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:28:56.802 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509479 2024-09-16T03:28:56.802 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:28:56.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:28:56.803 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509479 2024-09-16T03:28:56.803 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:28:56.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509479 2024-09-16T03:28:56.805 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509479 2024-09-16T03:28:56.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509479' 2024-09-16T03:28:56.805 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:28:57.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509480 -lt 64424509479 2024-09-16T03:28:57.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:28:57.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345957 2024-09-16T03:28:57.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:28:57.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:28:57.214 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345957 2024-09-16T03:28:57.215 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:28:57.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345957 2024-09-16T03:28:57.216 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345957 2024-09-16T03:28:57.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345957' 2024-09-16T03:28:57.216 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:28:57.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345957 -lt 85899345957 2024-09-16T03:28:57.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:28:57.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182434 2024-09-16T03:28:57.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:28:57.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:28:57.664 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182434 2024-09-16T03:28:57.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:28:57.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182434 2024-09-16T03:28:57.666 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182434 2024-09-16T03:28:57.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182434' 2024-09-16T03:28:57.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:28:58.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182435 -lt 107374182434 2024-09-16T03:28:58.097 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:178: TEST_backfill_priority: get_asok_path osd.1 2024-09-16T03:28:58.097 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2024-09-16T03:28:58.097 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2024-09-16T03:28:58.097 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:28:58.097 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:28:58.097 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:28:58.097 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-osd.1.asok 2024-09-16T03:28:58.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:178: TEST_backfill_priority: CEPH_ARGS= 2024-09-16T03:28:58.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:178: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:28:58.179 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:28:58.179 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:28:58.179 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:28:58.179 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:28:58.179 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:28:58.179 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:28:58.179 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:28:58.179 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:28:58.179 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:28:58.179 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:28:58.180 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:28:58.180 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:28:58.180 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:28:58.180 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:28:58.180 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:28:58.180 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:28:58.180 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:28:58.180 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:28:58.180 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:28:58.180 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:28:58.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:180: TEST_backfill_priority: ceph osd out osd.0 2024-09-16T03:28:58.733 INFO:tasks.workunit.client.0.smithi026.stderr:osd.0 is already out. 2024-09-16T03:28:58.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:181: TEST_backfill_priority: sleep 2 2024-09-16T03:29:00.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:182: TEST_backfill_priority: flush_pg_stats 2024-09-16T03:29:00.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:29:00.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:29:01.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:29:01.220 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:29:01.220 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:29:01.220 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:29:01.220 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T03:29:01.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:29:01.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:01.220 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:29:01.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836528 2024-09-16T03:29:01.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836528 2024-09-16T03:29:01.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528' 2024-09-16T03:29:01.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:01.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:29:01.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673005 2024-09-16T03:29:01.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673005 2024-09-16T03:29:01.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949673005' 2024-09-16T03:29:01.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:01.468 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:29:01.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509483 2024-09-16T03:29:01.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509483 2024-09-16T03:29:01.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949673005 2-64424509483' 2024-09-16T03:29:01.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:01.590 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:29:01.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345960 2024-09-16T03:29:01.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345960 2024-09-16T03:29:01.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949673005 2-64424509483 3-85899345960' 2024-09-16T03:29:01.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:01.713 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:29:01.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182437 2024-09-16T03:29:01.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182437 2024-09-16T03:29:01.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949673005 2-64424509483 3-85899345960 4-107374182437' 2024-09-16T03:29:01.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:01.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836528 2024-09-16T03:29:01.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:01.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:29:01.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836528 2024-09-16T03:29:01.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:01.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836528 2024-09-16T03:29:01.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836528' 2024-09-16T03:29:01.855 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836528 2024-09-16T03:29:01.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:29:02.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836526 -lt 21474836528 2024-09-16T03:29:02.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:29:03.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:29:03.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:29:03.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836528 -lt 21474836528 2024-09-16T03:29:03.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:03.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673005 2024-09-16T03:29:03.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:03.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:29:03.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673005 2024-09-16T03:29:03.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:03.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673005 2024-09-16T03:29:03.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673005' 2024-09-16T03:29:03.760 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673005 2024-09-16T03:29:03.760 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:29:04.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673006 -lt 42949673005 2024-09-16T03:29:04.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:04.263 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509483 2024-09-16T03:29:04.263 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:04.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:29:04.265 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509483 2024-09-16T03:29:04.265 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:04.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509483 2024-09-16T03:29:04.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509483' 2024-09-16T03:29:04.266 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509483 2024-09-16T03:29:04.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:29:04.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509483 -lt 64424509483 2024-09-16T03:29:04.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:04.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345960 2024-09-16T03:29:04.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:04.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:29:04.763 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345960 2024-09-16T03:29:04.763 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:04.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345960 2024-09-16T03:29:04.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345960' 2024-09-16T03:29:04.764 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345960 2024-09-16T03:29:04.764 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:29:05.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345961 -lt 85899345960 2024-09-16T03:29:05.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:05.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182437 2024-09-16T03:29:05.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:05.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:29:05.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182437 2024-09-16T03:29:05.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:05.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182437 2024-09-16T03:29:05.223 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182437 2024-09-16T03:29:05.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182437' 2024-09-16T03:29:05.223 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:29:05.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182438 -lt 107374182437 2024-09-16T03:29:05.672 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:183: TEST_backfill_priority: get_asok_path osd.1 2024-09-16T03:29:05.672 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2024-09-16T03:29:05.673 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2024-09-16T03:29:05.673 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:29:05.673 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:29:05.673 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:29:05.673 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-osd.1.asok 2024-09-16T03:29:05.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:183: TEST_backfill_priority: CEPH_ARGS= 2024-09-16T03:29:05.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:183: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:05.754 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:05.754 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:05.754 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:05.754 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:05.754 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:05.754 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:05.754 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:05.754 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:05.754 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:05.755 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:05.756 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:05.756 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:05.756 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:05.756 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:05.756 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:05.756 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:05.756 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:05.756 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:05.756 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:05.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:184: TEST_backfill_priority: ceph pg dump pgs 2024-09-16T03:29:06.148 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T03:29:06.148 INFO:tasks.workunit.client.0.smithi026.stdout:7.0 50 0 50 0 0 524288000 0 0 50 100 50 active+undersized+degraded+remapped+backfilling+forced_backfill 2024-09-16T03:28:53.252081+0000 93'150 105:257 [1,4] 1 [1] 1 0'0 2024-09-16T03:26:53.573934+0000 0'0 2024-09-16T03:26:53.573934+0000 0 0 no scrub is scheduled 0 0 2024-09-16T03:29:06.148 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-09-16T03:27:24.228978+0000 93'150 105:284 [1] 1 [1] 1 0'0 2024-09-16T03:26:43.428192+0000 0'0 2024-09-16T03:26:43.428192+0000 0 0 periodic scrub scheduled @ 2024-09-17T08:53:55.820205+0000 0 0 2024-09-16T03:29:06.148 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 50 0 0 50 0 524288000 0 0 50 100 50 active+remapped+backfill_wait 2024-09-16T03:28:59.919981+0000 93'150 105:307 [1,2] 1 [1,0] 1 0'0 2024-09-16T03:26:38.075611+0000 0'0 2024-09-16T03:26:38.075611+0000 0 0 no scrub is scheduled 0 0 2024-09-16T03:29:06.148 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T03:29:06.148 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T03:29:06.149 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:29:06.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:186: TEST_backfill_priority: ceph osd pool set test3 size 2 2024-09-16T03:29:06.752 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 3 size to 2 2024-09-16T03:29:06.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:187: TEST_backfill_priority: sleep 2 2024-09-16T03:29:08.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:188: TEST_backfill_priority: flush_pg_stats 2024-09-16T03:29:08.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:29:08.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:29:09.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:29:09.221 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:29:09.221 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:29:09.221 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:29:09.221 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T03:29:09.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:29:09.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:09.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:29:09.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836531 2024-09-16T03:29:09.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836531 2024-09-16T03:29:09.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836531' 2024-09-16T03:29:09.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:09.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:29:09.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673009 2024-09-16T03:29:09.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673009 2024-09-16T03:29:09.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836531 1-42949673009' 2024-09-16T03:29:09.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:09.467 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:29:09.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509486 2024-09-16T03:29:09.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509486 2024-09-16T03:29:09.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836531 1-42949673009 2-64424509486' 2024-09-16T03:29:09.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:09.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:29:09.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345964 2024-09-16T03:29:09.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345964 2024-09-16T03:29:09.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836531 1-42949673009 2-64424509486 3-85899345964' 2024-09-16T03:29:09.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:09.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:29:09.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182441 2024-09-16T03:29:09.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182441 2024-09-16T03:29:09.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836531 1-42949673009 2-64424509486 3-85899345964 4-107374182441' 2024-09-16T03:29:09.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:09.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836531 2024-09-16T03:29:09.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:09.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:29:09.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836531 2024-09-16T03:29:09.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:09.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836531 2024-09-16T03:29:09.839 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836531 2024-09-16T03:29:09.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836531' 2024-09-16T03:29:09.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:29:10.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836529 -lt 21474836531 2024-09-16T03:29:10.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:29:11.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:29:11.325 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:29:11.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836532 -lt 21474836531 2024-09-16T03:29:11.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:11.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673009 2024-09-16T03:29:11.785 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:11.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:29:11.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673009 2024-09-16T03:29:11.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:11.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673009 2024-09-16T03:29:11.787 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673009 2024-09-16T03:29:11.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673009' 2024-09-16T03:29:11.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:29:12.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673009 -lt 42949673009 2024-09-16T03:29:12.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:12.245 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509486 2024-09-16T03:29:12.245 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:12.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:29:12.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509486 2024-09-16T03:29:12.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:12.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509486 2024-09-16T03:29:12.247 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509486 2024-09-16T03:29:12.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509486' 2024-09-16T03:29:12.248 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:29:12.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509487 -lt 64424509486 2024-09-16T03:29:12.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:12.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345964 2024-09-16T03:29:12.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:12.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:29:12.689 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345964 2024-09-16T03:29:12.689 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:12.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345964 2024-09-16T03:29:12.690 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345964 2024-09-16T03:29:12.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345964' 2024-09-16T03:29:12.691 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:29:13.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345964 -lt 85899345964 2024-09-16T03:29:13.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:13.154 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182441 2024-09-16T03:29:13.154 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:13.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:29:13.156 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182441 2024-09-16T03:29:13.156 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:13.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182441 2024-09-16T03:29:13.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182441' 2024-09-16T03:29:13.157 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182441 2024-09-16T03:29:13.157 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:29:13.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182442 -lt 107374182441 2024-09-16T03:29:13.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:189: TEST_backfill_priority: get_asok_path osd.1 2024-09-16T03:29:13.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2024-09-16T03:29:13.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2024-09-16T03:29:13.634 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:29:13.634 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:29:13.634 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:29:13.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-osd.1.asok 2024-09-16T03:29:13.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:189: TEST_backfill_priority: CEPH_ARGS= 2024-09-16T03:29:13.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:189: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:13.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:190: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:13.722 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:13.722 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:13.722 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:13.722 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:13.722 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:13.722 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:13.722 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:13.722 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:13.723 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:13.724 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:13.725 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:13.725 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:13.725 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:13.725 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:13.725 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:13.725 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:13.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:191: TEST_backfill_priority: ceph pg dump pgs 2024-09-16T03:29:14.114 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T03:29:14.114 INFO:tasks.workunit.client.0.smithi026.stdout:7.0 50 0 50 0 0 524288000 0 0 50 100 50 active+undersized+degraded+remapped+backfilling+forced_backfill 2024-09-16T03:28:53.252081+0000 93'150 110:266 [1,4] 1 [1] 1 0'0 2024-09-16T03:26:53.573934+0000 0'0 2024-09-16T03:26:53.573934+0000 0 0 no scrub is scheduled 0 0 2024-09-16T03:29:14.114 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 50 0 50 0 0 524288000 0 0 50 100 50 active+undersized+degraded+remapped+backfill_wait 2024-09-16T03:29:08.722101+0000 93'150 110:293 [1,2] 1 [1] 1 0'0 2024-09-16T03:26:43.428192+0000 0'0 2024-09-16T03:26:43.428192+0000 0 0 no scrub is scheduled 0 0 2024-09-16T03:29:14.115 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 50 0 0 50 0 524288000 0 0 50 100 50 active+remapped+backfill_wait 2024-09-16T03:28:59.919981+0000 93'150 110:316 [1,2] 1 [1,0] 1 0'0 2024-09-16T03:26:38.075611+0000 0'0 2024-09-16T03:26:38.075611+0000 0 0 no scrub is scheduled 0 0 2024-09-16T03:29:14.115 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T03:29:14.115 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T03:29:14.115 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:29:14.126 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:193: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:14.126 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:193: TEST_backfill_priority: jq '(.local_reservations.queues[].items[] | select(.item == "1.0")).prio' 2024-09-16T03:29:14.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:193: TEST_backfill_priority: PRIO=110 2024-09-16T03:29:14.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:194: TEST_backfill_priority: '[' 110 '!=' 110 ']' 2024-09-16T03:29:14.129 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:201: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:14.130 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:201: TEST_backfill_priority: jq '.local_reservations.in_progress[0].item' 2024-09-16T03:29:14.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:201: TEST_backfill_priority: eval 'ITEM="7.0"' 2024-09-16T03:29:14.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:201: TEST_backfill_priority: ITEM=7.0 2024-09-16T03:29:14.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:202: TEST_backfill_priority: '[' 7.0 '!=' 7.0 ']' 2024-09-16T03:29:14.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:207: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:14.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:207: TEST_backfill_priority: jq '.local_reservations.in_progress[0].prio' 2024-09-16T03:29:14.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:207: TEST_backfill_priority: PRIO=254 2024-09-16T03:29:14.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:208: TEST_backfill_priority: '[' 254 '!=' 254 ']' 2024-09-16T03:29:14.135 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:216: TEST_backfill_priority: seq 1 10 2024-09-16T03:29:14.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:216: TEST_backfill_priority: for i in $(seq 1 $max_tries) 2024-09-16T03:29:14.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:218: TEST_backfill_priority: ceph pg force-backfill 3.0 2024-09-16T03:29:14.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:218: TEST_backfill_priority: grep -q 'doesn'\''t require backfilling' 2024-09-16T03:29:14.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:219: TEST_backfill_priority: break 2024-09-16T03:29:14.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:227: TEST_backfill_priority: sleep 2 2024-09-16T03:29:16.548 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:228: TEST_backfill_priority: get_asok_path osd.1 2024-09-16T03:29:16.548 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2024-09-16T03:29:16.548 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2024-09-16T03:29:16.548 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:29:16.548 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:29:16.548 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:29:16.548 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-osd.1.asok 2024-09-16T03:29:16.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:228: TEST_backfill_priority: CEPH_ARGS= 2024-09-16T03:29:16.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:228: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:16.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:229: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:16.649 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:16.649 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:16.649 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:16.649 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:16.649 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:16.649 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:16.649 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:16.649 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:16.649 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 254, 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:16.650 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:16.651 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:16.652 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:16.652 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:16.652 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:16.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:230: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:16.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:230: TEST_backfill_priority: jq '(.local_reservations.queues[].items[] | select(.item == "3.0")).prio' 2024-09-16T03:29:16.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:230: TEST_backfill_priority: PRIO=254 2024-09-16T03:29:16.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:231: TEST_backfill_priority: '[' 254 '!=' 254 ']' 2024-09-16T03:29:16.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:236: TEST_backfill_priority: flush_pg_stats 2024-09-16T03:29:16.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:29:16.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:29:17.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:29:17.127 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:29:17.127 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:29:17.127 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:29:17.127 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T03:29:17.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:29:17.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:17.127 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:29:17.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836535 2024-09-16T03:29:17.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836535 2024-09-16T03:29:17.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836535' 2024-09-16T03:29:17.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:17.288 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:29:17.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673012 2024-09-16T03:29:17.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673012 2024-09-16T03:29:17.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836535 1-42949673012' 2024-09-16T03:29:17.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:17.410 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:29:17.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509490 2024-09-16T03:29:17.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509490 2024-09-16T03:29:17.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836535 1-42949673012 2-64424509490' 2024-09-16T03:29:17.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:17.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:29:17.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345967 2024-09-16T03:29:17.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345967 2024-09-16T03:29:17.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836535 1-42949673012 2-64424509490 3-85899345967' 2024-09-16T03:29:17.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:17.686 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:29:17.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182445 2024-09-16T03:29:17.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182445 2024-09-16T03:29:17.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836535 1-42949673012 2-64424509490 3-85899345967 4-107374182445' 2024-09-16T03:29:17.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:17.809 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836535 2024-09-16T03:29:17.809 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:17.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:29:17.810 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836535 2024-09-16T03:29:17.810 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:17.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836535 2024-09-16T03:29:17.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836535' 2024-09-16T03:29:17.811 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836535 2024-09-16T03:29:17.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:29:18.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836533 -lt 21474836535 2024-09-16T03:29:18.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:29:19.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:29:19.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:29:19.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836535 -lt 21474836535 2024-09-16T03:29:19.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:19.709 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673012 2024-09-16T03:29:19.709 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:19.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:29:19.710 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673012 2024-09-16T03:29:19.711 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:19.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673012 2024-09-16T03:29:19.712 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673012 2024-09-16T03:29:19.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673012' 2024-09-16T03:29:19.712 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:29:20.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673013 -lt 42949673012 2024-09-16T03:29:20.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:20.151 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509490 2024-09-16T03:29:20.152 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:20.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:29:20.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509490 2024-09-16T03:29:20.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:20.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509490 2024-09-16T03:29:20.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509490' 2024-09-16T03:29:20.154 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509490 2024-09-16T03:29:20.154 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:29:20.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509490 -lt 64424509490 2024-09-16T03:29:20.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:20.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345967 2024-09-16T03:29:20.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:20.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:29:20.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345967 2024-09-16T03:29:20.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:20.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345967 2024-09-16T03:29:20.598 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345967 2024-09-16T03:29:20.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345967' 2024-09-16T03:29:20.599 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:29:21.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345967 -lt 85899345967 2024-09-16T03:29:21.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:21.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182445 2024-09-16T03:29:21.039 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:21.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:29:21.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182445 2024-09-16T03:29:21.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:21.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182445 2024-09-16T03:29:21.041 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182445 2024-09-16T03:29:21.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182445' 2024-09-16T03:29:21.041 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:29:21.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182445 -lt 107374182445 2024-09-16T03:29:21.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:239: TEST_backfill_priority: ceph pg cancel-force-backfill 7.0 2024-09-16T03:29:21.843 INFO:tasks.workunit.client.0.smithi026.stderr:instructing pg(s) [7.0] on osd.1 to cancel-force-backfill; 2024-09-16T03:29:21.844 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-09-16T03:29:21.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:240: TEST_backfill_priority: sleep 2 2024-09-16T03:29:23.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:241: TEST_backfill_priority: get_asok_path osd.1 2024-09-16T03:29:23.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2024-09-16T03:29:23.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2024-09-16T03:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-osd.1.asok 2024-09-16T03:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:241: TEST_backfill_priority: CEPH_ARGS= 2024-09-16T03:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:241: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:23.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:242: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:23.958 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:23.958 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:23.958 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:23.958 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:23.958 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:23.958 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:23.958 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:23.959 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:23.959 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:23.959 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:23.959 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:23.959 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:23.959 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:23.959 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:23.959 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:23.959 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:23.959 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:23.959 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:23.959 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:23.960 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:23.961 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:23.961 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:23.961 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:23.961 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:23.961 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:23.961 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:23.961 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:23.961 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:23.961 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:23.962 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:243: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:23.962 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:243: TEST_backfill_priority: jq '(.local_reservations.queues[].items[] | select(.item == "7.0")).prio' 2024-09-16T03:29:23.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:243: TEST_backfill_priority: PRIO=151 2024-09-16T03:29:23.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:244: TEST_backfill_priority: '[' 151 '!=' 151 ']' 2024-09-16T03:29:23.963 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:250: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:23.963 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:250: TEST_backfill_priority: jq '.local_reservations.in_progress[0].item' 2024-09-16T03:29:23.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:250: TEST_backfill_priority: eval 'ITEM="3.0"' 2024-09-16T03:29:23.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:250: TEST_backfill_priority: ITEM=3.0 2024-09-16T03:29:23.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:251: TEST_backfill_priority: '[' 3.0 '!=' 3.0 ']' 2024-09-16T03:29:23.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:256: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:23.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:256: TEST_backfill_priority: jq '.local_reservations.in_progress[0].prio' 2024-09-16T03:29:23.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:256: TEST_backfill_priority: PRIO=254 2024-09-16T03:29:23.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:257: TEST_backfill_priority: '[' 254 '!=' 254 ']' 2024-09-16T03:29:23.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:264: TEST_backfill_priority: ceph pg cancel-force-backfill 3.0 2024-09-16T03:29:24.363 INFO:tasks.workunit.client.0.smithi026.stderr:instructing pg(s) [3.0] on osd.1 to cancel-force-backfill; 2024-09-16T03:29:24.364 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-09-16T03:29:24.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:265: TEST_backfill_priority: sleep 5 2024-09-16T03:29:29.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:266: TEST_backfill_priority: get_asok_path osd.1 2024-09-16T03:29:29.378 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2024-09-16T03:29:29.378 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2024-09-16T03:29:29.378 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:29:29.378 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:29:29.378 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:29:29.378 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-osd.1.asok 2024-09-16T03:29:29.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:266: TEST_backfill_priority: CEPH_ARGS= 2024-09-16T03:29:29.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:266: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:29.469 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:29.469 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:29.469 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:29.469 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:29.469 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:29.469 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:29.469 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:29.469 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:29.469 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:29.469 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:29.470 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:29.471 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:29.472 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:29.472 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:29.472 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:29.472 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:29.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:269: TEST_backfill_priority: flush_pg_stats 2024-09-16T03:29:29.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:29:29.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:29:29.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:29:29.921 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:29:29.922 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:29:29.922 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:29:29.922 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T03:29:29.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:29:29.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:29.922 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:29:30.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836540 2024-09-16T03:29:30.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836540 2024-09-16T03:29:30.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836540' 2024-09-16T03:29:30.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:30.044 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:29:30.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673017 2024-09-16T03:29:30.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673017 2024-09-16T03:29:30.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836540 1-42949673017' 2024-09-16T03:29:30.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:30.167 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:29:30.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509494 2024-09-16T03:29:30.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509494 2024-09-16T03:29:30.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836540 1-42949673017 2-64424509494' 2024-09-16T03:29:30.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:30.290 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:29:30.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345972 2024-09-16T03:29:30.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345972 2024-09-16T03:29:30.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836540 1-42949673017 2-64424509494 3-85899345972' 2024-09-16T03:29:30.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:30.414 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:29:30.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182449 2024-09-16T03:29:30.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182449 2024-09-16T03:29:30.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836540 1-42949673017 2-64424509494 3-85899345972 4-107374182449' 2024-09-16T03:29:30.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:30.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836540 2024-09-16T03:29:30.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:30.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:29:30.538 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836540 2024-09-16T03:29:30.538 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:30.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836540 2024-09-16T03:29:30.539 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836540 2024-09-16T03:29:30.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836540' 2024-09-16T03:29:30.540 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:29:30.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836537 -lt 21474836540 2024-09-16T03:29:30.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:29:31.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:29:31.974 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:29:32.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836540 -lt 21474836540 2024-09-16T03:29:32.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:32.433 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673017 2024-09-16T03:29:32.433 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:32.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:29:32.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673017 2024-09-16T03:29:32.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:32.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673017 2024-09-16T03:29:32.435 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673017 2024-09-16T03:29:32.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673017' 2024-09-16T03:29:32.436 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:29:32.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673017 -lt 42949673017 2024-09-16T03:29:32.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:32.884 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509494 2024-09-16T03:29:32.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:32.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:29:32.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509494 2024-09-16T03:29:32.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:32.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509494 2024-09-16T03:29:32.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509494' 2024-09-16T03:29:32.887 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509494 2024-09-16T03:29:32.887 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:29:33.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509495 -lt 64424509494 2024-09-16T03:29:33.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:33.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345972 2024-09-16T03:29:33.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:33.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:29:33.337 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345972 2024-09-16T03:29:33.337 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:33.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345972 2024-09-16T03:29:33.338 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345972 2024-09-16T03:29:33.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345972' 2024-09-16T03:29:33.339 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:29:33.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345972 -lt 85899345972 2024-09-16T03:29:33.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:33.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182449 2024-09-16T03:29:33.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:33.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:29:33.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182449 2024-09-16T03:29:33.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:33.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182449 2024-09-16T03:29:33.781 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182449 2024-09-16T03:29:33.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182449' 2024-09-16T03:29:33.781 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:29:34.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182450 -lt 107374182449 2024-09-16T03:29:34.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:270: TEST_backfill_priority: ceph pg force-backfill 7.0 2024-09-16T03:29:34.589 INFO:tasks.workunit.client.0.smithi026.stderr:instructing pg(s) [7.0] on osd.1 to force-backfill; 2024-09-16T03:29:34.589 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-09-16T03:29:34.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:271: TEST_backfill_priority: sleep 2 2024-09-16T03:29:36.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:273: TEST_backfill_priority: get_asok_path osd.1 2024-09-16T03:29:36.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2024-09-16T03:29:36.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2024-09-16T03:29:36.603 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:29:36.603 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:29:36.603 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:29:36.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-osd.1.asok 2024-09-16T03:29:36.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:273: TEST_backfill_priority: CEPH_ARGS= 2024-09-16T03:29:36.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:273: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:36.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:274: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:36.703 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:36.705 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:36.706 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:36.706 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:36.706 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:36.706 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:36.706 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:36.706 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:36.706 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:36.706 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:36.706 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:36.706 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:36.706 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:36.706 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:36.707 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:275: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:36.707 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:275: TEST_backfill_priority: jq '(.local_reservations.queues[].items[] | select(.item == "3.0")).prio' 2024-09-16T03:29:36.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:275: TEST_backfill_priority: PRIO=151 2024-09-16T03:29:36.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:276: TEST_backfill_priority: '[' 151 '!=' 151 ']' 2024-09-16T03:29:36.708 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:282: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:36.708 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:282: TEST_backfill_priority: jq '.local_reservations.in_progress[0].item' 2024-09-16T03:29:36.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:282: TEST_backfill_priority: eval 'ITEM="7.0"' 2024-09-16T03:29:36.711 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:282: TEST_backfill_priority: ITEM=7.0 2024-09-16T03:29:36.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:283: TEST_backfill_priority: '[' 7.0 '!=' 7.0 ']' 2024-09-16T03:29:36.711 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:288: TEST_backfill_priority: cat td/osd-backfill-prio/out 2024-09-16T03:29:36.711 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:288: TEST_backfill_priority: jq '.local_reservations.in_progress[0].prio' 2024-09-16T03:29:36.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:288: TEST_backfill_priority: PRIO=254 2024-09-16T03:29:36.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:289: TEST_backfill_priority: '[' 254 '!=' 254 ']' 2024-09-16T03:29:36.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:296: TEST_backfill_priority: ceph osd unset noout 2024-09-16T03:29:37.429 INFO:tasks.workunit.client.0.smithi026.stderr:noout is unset 2024-09-16T03:29:37.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:297: TEST_backfill_priority: ceph osd unset nobackfill 2024-09-16T03:29:38.098 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is unset 2024-09-16T03:29:38.111 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:299: TEST_backfill_priority: get_asok_path osd.1 2024-09-16T03:29:38.111 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2024-09-16T03:29:38.112 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2024-09-16T03:29:38.112 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:29:38.112 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:29:38.112 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:29:38.112 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-osd.1.asok 2024-09-16T03:29:38.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:299: TEST_backfill_priority: wait_for_clean 'CEPH_ARGS='\'''\'' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations' 2024-09-16T03:29:38.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local 'cmd=CEPH_ARGS='\'''\'' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations' 2024-09-16T03:29:38.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:29:38.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:29:38.112 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:29:38.113 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:29:38.113 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:29:38.113 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:29:38.113 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:29:38.113 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:29:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:29:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:29:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:29:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:29:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:29:38.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:29:38.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:29:38.617 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:29:38.617 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:29:38.617 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:29:38.617 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T03:29:38.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:29:38.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:38.617 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:29:38.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836543 2024-09-16T03:29:38.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836543 2024-09-16T03:29:38.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836543' 2024-09-16T03:29:38.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:38.782 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:29:38.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673021 2024-09-16T03:29:38.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673021 2024-09-16T03:29:38.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836543 1-42949673021' 2024-09-16T03:29:38.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:38.908 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:29:39.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509498 2024-09-16T03:29:39.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509498 2024-09-16T03:29:39.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836543 1-42949673021 2-64424509498' 2024-09-16T03:29:39.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:39.033 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:29:39.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345976 2024-09-16T03:29:39.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345976 2024-09-16T03:29:39.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836543 1-42949673021 2-64424509498 3-85899345976' 2024-09-16T03:29:39.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:29:39.156 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:29:39.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182453 2024-09-16T03:29:39.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182453 2024-09-16T03:29:39.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836543 1-42949673021 2-64424509498 3-85899345976 4-107374182453' 2024-09-16T03:29:39.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:39.279 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836543 2024-09-16T03:29:39.279 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:39.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:29:39.280 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836543 2024-09-16T03:29:39.281 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:39.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836543 2024-09-16T03:29:39.281 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836543 2024-09-16T03:29:39.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836543' 2024-09-16T03:29:39.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:29:39.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836543 -lt 21474836543 2024-09-16T03:29:39.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:39.725 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673021 2024-09-16T03:29:39.725 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:39.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:29:39.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673021 2024-09-16T03:29:39.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:39.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673021 2024-09-16T03:29:39.727 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673021 2024-09-16T03:29:39.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673021' 2024-09-16T03:29:39.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:29:40.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673021 -lt 42949673021 2024-09-16T03:29:40.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:40.142 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509498 2024-09-16T03:29:40.142 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:40.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:29:40.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509498 2024-09-16T03:29:40.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:40.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509498 2024-09-16T03:29:40.144 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509498 2024-09-16T03:29:40.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509498' 2024-09-16T03:29:40.145 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:29:40.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509496 -lt 64424509498 2024-09-16T03:29:40.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:29:41.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:29:41.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:29:42.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509499 -lt 64424509498 2024-09-16T03:29:42.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:42.075 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345976 2024-09-16T03:29:42.075 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:42.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:29:42.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345976 2024-09-16T03:29:42.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:42.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345976 2024-09-16T03:29:42.078 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345976 2024-09-16T03:29:42.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345976' 2024-09-16T03:29:42.078 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:29:42.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345976 -lt 85899345976 2024-09-16T03:29:42.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:29:42.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182453 2024-09-16T03:29:42.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:29:42.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:29:42.489 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182453 2024-09-16T03:29:42.489 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:29:42.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182453 2024-09-16T03:29:42.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182453' 2024-09-16T03:29:42.491 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182453 2024-09-16T03:29:42.491 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:29:42.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182453 -lt 107374182453 2024-09-16T03:29:42.918 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:29:42.918 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:29:42.918 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:29:43.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 3 == 0 2024-09-16T03:29:43.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:29:43.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:29:43.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:29:43.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:29:43.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:29:43.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:29:43.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:29:44.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:29:44.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:29:44.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:29:44.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:29:44.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:29:44.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T03:29:44.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T03:29:44.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T03:29:44.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:44.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:29:44.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:44.909 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:44.909 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:44.909 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:44.909 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:44.909 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:44.909 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:44.909 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:44.909 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:44.909 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:44.909 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:44.909 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:44.910 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:44.911 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:44.912 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:44.912 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:44.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:29:45.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:29:45.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:29:45.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:29:45.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:29:45.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:29:45.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:29:45.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:29:45.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:29:45.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:29:45.422 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:29:45.422 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:29:45.422 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:29:46.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:29:46.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:29:46.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:29:46.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:29:46.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:29:46.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:29:46.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:29:46.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:29:46.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:29:46.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5564234 2024-09-16T03:29:46.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5564234 '!=' null 2024-09-16T03:29:46.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:29:46.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:46.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:29:46.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:46.716 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:46.716 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:46.716 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:46.716 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:46.716 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:46.716 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:46.716 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:46.716 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:46.716 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:46.716 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:46.716 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:46.717 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:46.717 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:46.717 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:46.717 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:46.717 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:46.717 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:46.717 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:46.717 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:46.717 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:46.718 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:46.718 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:46.718 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:46.718 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:46.718 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:46.718 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:46.718 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:46.718 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:46.718 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:46.718 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:46.718 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:46.718 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:46.719 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:46.719 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:46.719 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:46.719 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:46.719 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:46.719 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:46.719 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:46.719 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:46.719 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:46.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:29:46.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:29:46.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:29:46.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:29:46.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:29:46.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:29:46.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:29:46.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:29:46.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:29:47.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:29:47.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:29:47.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:29:47.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:29:47.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:29:47.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:29:47.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:29:47.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:29:47.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:29:47.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:29:47.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:29:47.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:29:47.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:29:48.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4616080 2024-09-16T03:29:48.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4616080 '!=' null 2024-09-16T03:29:48.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:29:48.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:48.406 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:29:48.406 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:48.486 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:48.486 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:48.486 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:48.486 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:48.486 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:48.487 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:48.487 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:48.487 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:48.487 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:48.487 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:48.489 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:48.489 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:48.489 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:48.489 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:48.489 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:48.490 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:48.490 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:48.490 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:48.490 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:48.490 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:48.490 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:48.491 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:48.491 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:48.491 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:48.491 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:48.491 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:48.491 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:48.492 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:48.492 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:48.492 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:48.492 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:48.492 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:48.492 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:48.493 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:48.493 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:48.494 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:48.494 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:48.494 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:48.494 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:48.494 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:48.495 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:48.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:29:48.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:29:48.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:29:48.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:29:48.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:29:48.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:29:48.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:29:48.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:29:48.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:29:48.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:29:48.997 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:29:48.997 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:29:48.998 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:29:49.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:29:49.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:29:49.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:29:49.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:29:49.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:29:49.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:29:49.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:29:49.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:29:49.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:29:50.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=13506781 2024-09-16T03:29:50.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 13506781 '!=' null 2024-09-16T03:29:50.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:29:50.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:50.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:29:50.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:50.282 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:50.283 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:50.283 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:50.283 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:50.283 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:50.283 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:50.283 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:50.283 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:50.283 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:50.283 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:50.283 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:50.283 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:50.283 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:50.284 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:50.285 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:50.286 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:50.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:29:50.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:29:50.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:29:50.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:29:50.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:29:50.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:29:50.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:29:50.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:29:50.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:29:50.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:29:50.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:29:50.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:29:50.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:29:51.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:29:51.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:29:51.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:29:51.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:29:51.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:29:51.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:29:51.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:29:51.486 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:29:51.486 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:29:52.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=12231220 2024-09-16T03:29:52.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 12231220 '!=' null 2024-09-16T03:29:52.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:29:52.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:52.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:29:52.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:52.252 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:52.252 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:52.252 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:52.253 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:52.254 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:52.255 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:52.255 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:52.255 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:52.255 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:52.255 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:52.255 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:52.255 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:52.255 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:52.255 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:52.255 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:52.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:29:52.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:29:52.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:29:52.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:29:52.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:29:52.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:29:52.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:29:52.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:29:52.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:29:52.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:29:52.768 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:29:52.769 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:29:52.769 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:29:53.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:29:53.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:29:53.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:29:53.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:29:53.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:29:53.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:29:53.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:29:53.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:29:53.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:29:54.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=20967917 2024-09-16T03:29:54.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 20967917 '!=' null 2024-09-16T03:29:54.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:29:54.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:54.145 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:29:54.145 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:54.227 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:54.227 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:54.227 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:54.227 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:54.227 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:54.227 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:54.227 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:54.227 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:54.227 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:54.227 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:54.227 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:54.228 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:54.229 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:54.230 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:54.230 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:54.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:29:54.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:29:54.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:29:54.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:29:54.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:29:54.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:29:54.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:29:54.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:29:54.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:29:54.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:29:54.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:29:54.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:29:54.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:29:55.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:29:55.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:29:55.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:29:55.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:29:55.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:29:55.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:29:55.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:29:55.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:29:55.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:29:56.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=17473285 2024-09-16T03:29:56.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 17473285 '!=' null 2024-09-16T03:29:56.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:29:56.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:56.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:29:56.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:56.139 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:56.139 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:56.139 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:56.140 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:56.141 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:56.141 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:56.141 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:56.141 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:56.141 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:56.141 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:56.141 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:56.141 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:56.141 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:56.142 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:56.143 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:56.143 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:56.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:29:56.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:29:56.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:29:56.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:29:56.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:29:56.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:29:56.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:29:56.250 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:29:56.250 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:29:56.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:29:56.659 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:29:56.659 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:29:56.659 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:29:57.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:29:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:29:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:29:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:29:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:29:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:29:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:29:57.248 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:29:57.248 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:29:57.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=17473354 2024-09-16T03:29:57.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 17473354 '!=' null 2024-09-16T03:29:57.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:29:57.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:57.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:29:57.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:58.021 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:58.021 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:58.021 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:58.021 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:58.021 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:58.021 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:58.021 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:58.021 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:58.021 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:58.021 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:58.021 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:58.022 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:58.023 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:58.024 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:58.024 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:58.024 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:58.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:29:58.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:29:58.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:29:58.151 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:29:58.151 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:29:58.151 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:29:58.151 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:29:58.151 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:29:58.151 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:29:58.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:29:58.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:29:58.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:29:58.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:29:59.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:29:59.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:29:59.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:29:59.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:29:59.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:29:59.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:29:59.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:29:59.140 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:29:59.140 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:29:59.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=25336421 2024-09-16T03:29:59.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 25336421 '!=' null 2024-09-16T03:29:59.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:29:59.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:59.697 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:29:59.697 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:29:59.779 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:29:59.779 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:29:59.779 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:59.779 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:59.779 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:29:59.779 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:59.779 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:59.780 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:59.781 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:29:59.782 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:29:59.782 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:29:59.782 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:29:59.782 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:29:59.782 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:29:59.782 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:29:59.782 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:29:59.782 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:29:59.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:29:59.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:29:59.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:29:59.888 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:29:59.888 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:29:59.888 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:29:59.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:29:59.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:29:59.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:00.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:30:00.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:00.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:00.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:00.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:30:00.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:30:00.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:00.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:00.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:00.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:00.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:00.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:00.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:01.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=16599717 2024-09-16T03:30:01.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 16599717 '!=' null 2024-09-16T03:30:01.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:01.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:01.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:01.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:01.682 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:01.682 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:01.682 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:01.682 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:01.682 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:01.682 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:01.682 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:01.682 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:01.682 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:01.682 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:01.682 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:01.682 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:01.683 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:01.684 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:01.685 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:01.685 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:01.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:01.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:01.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:01.791 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:01.791 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:01.791 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:01.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:01.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:01.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:02.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:30:02.197 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:02.197 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:02.197 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:02.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:30:02.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:30:02.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:02.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:02.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:02.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:02.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:02.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:02.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:03.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=25336641 2024-09-16T03:30:03.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 25336641 '!=' null 2024-09-16T03:30:03.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:03.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:03.526 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:03.526 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:03.605 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:03.606 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:03.606 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:03.606 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:03.606 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:03.606 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:03.606 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:03.606 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:03.606 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:03.606 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:03.606 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:03.606 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:03.606 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:03.607 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:03.608 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:03.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:03.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:03.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:03.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:03.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:03.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:03.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:03.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:03.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:04.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:30:04.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:04.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:04.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:04.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:30:04.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:30:04.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:04.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:04.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:04.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:04.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:04.789 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:04.789 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:05.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=16599790 2024-09-16T03:30:05.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 16599790 '!=' null 2024-09-16T03:30:05.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:05.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:05.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:05.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:05.495 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:05.496 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:05.496 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:05.496 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:05.496 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:05.496 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:05.496 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:05.496 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:05.496 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:05.496 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:05.496 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:05.496 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:05.496 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 151, 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:05.497 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "7.0", 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 254, 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:05.498 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:05.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:05.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:05.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:05.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:05.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:05.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:05.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:05.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:05.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:06.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:30:06.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:06.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:06.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:06.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:30:06.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:30:06.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:06.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:06.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:06.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:06.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:06.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:06.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:07.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=16599790 2024-09-16T03:30:07.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 16599790 '!=' null 2024-09-16T03:30:07.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:07.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:07.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:07.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:07.394 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:07.395 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:07.395 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:07.395 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:07.395 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:07.395 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:07.395 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:07.395 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:07.395 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:07.395 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:07.395 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:07.395 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:07.395 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:07.397 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:07.397 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:07.397 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:07.397 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:07.397 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:07.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:07.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:07.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:07.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:07.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:07.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:07.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:07.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:07.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:08.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:30:08.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:08.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:08.006 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:08.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:30:08.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:30:08.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:08.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:08.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:08.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:08.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:08.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:08.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:09.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=23588938 2024-09-16T03:30:09.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 23588938 '!=' null 2024-09-16T03:30:09.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:09.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:09.410 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:09.410 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:09.490 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:09.490 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:09.490 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:09.491 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:09.492 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:09.493 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:09.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:09.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:09.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:09.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:09.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:09.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:09.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:09.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:09.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:10.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:30:10.036 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:10.036 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:10.036 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:10.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:30:10.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:30:10.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:10.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:10.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:10.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:10.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:10.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:10.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:11.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=10483989 2024-09-16T03:30:11.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 10483989 '!=' null 2024-09-16T03:30:11.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:11.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:11.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:11.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:11.599 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:11.600 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:11.600 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:11.600 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:11.600 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:11.600 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:11.600 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:11.600 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:11.600 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:11.600 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:11.600 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:11.600 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:11.600 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:11.601 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:11.601 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:11.601 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:11.601 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:11.601 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:11.601 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:11.601 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:11.602 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:11.602 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:11.602 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:11.602 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:11.602 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:11.602 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:11.602 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:11.603 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:11.603 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:11.603 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:11.603 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:11.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:11.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:11.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:11.708 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:11.709 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:11.709 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:11.709 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:11.709 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:11.709 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:12.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:30:12.154 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:12.154 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:12.154 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:12.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 3 2024-09-16T03:30:12.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:30:12.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:12.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:12.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:12.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:12.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:12.716 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:12.717 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:13.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=22278803 2024-09-16T03:30:13.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 22278803 '!=' null 2024-09-16T03:30:13.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:13.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:13.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:13.443 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:13.523 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:13.524 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:13.525 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:13.526 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:13.526 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:13.526 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:13.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:13.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:13.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:13.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:13.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:13.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:13.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:13.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:13.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:14.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:14.039 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:14.039 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:14.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:14.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:14.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 0 2024-09-16T03:30:14.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T03:30:14.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=1 2024-09-16T03:30:14.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:14.713 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:14.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:14.796 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:14.796 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:14.796 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:14.796 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:14.796 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:14.796 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:14.796 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:14.797 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:14.798 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:14.798 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:14.798 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:14.798 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:14.798 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:14.798 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:14.798 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:14.798 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:14.798 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:14.798 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:14.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:14.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:14.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:14.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:14.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:14.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:14.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:14.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:14.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:15.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:15.311 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:15.311 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:15.311 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:15.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:15.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:15.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:15.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:15.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:15.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:15.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:15.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:15.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:16.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=22148127 2024-09-16T03:30:16.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 22148127 '!=' null 2024-09-16T03:30:16.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:16.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:16.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:16.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:16.741 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:16.741 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:16.741 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:16.741 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:16.742 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:16.743 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:16.743 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:16.743 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:16.743 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:16.743 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:16.743 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:16.743 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:16.743 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:16.743 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:16.743 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:16.743 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:16.744 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:16.744 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:16.744 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:16.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:16.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:16.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:16.850 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:16.850 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:16.850 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:16.850 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:16.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:16.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:17.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:17.261 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:17.261 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:17.261 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:17.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:17.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:17.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:17.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:17.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:17.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:17.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:17.902 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:17.902 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:18.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=17823098 2024-09-16T03:30:18.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 17823098 '!=' null 2024-09-16T03:30:18.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:18.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:18.533 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:18.533 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:18.613 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:18.613 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:18.613 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:18.613 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:18.613 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:18.614 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:18.615 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:18.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:18.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:18.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:18.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:18.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:18.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:18.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:18.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:18.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:19.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:19.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:19.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:19.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:19.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:19.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:19.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:19.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:19.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:19.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:19.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:19.793 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:19.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:20.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=24906882 2024-09-16T03:30:20.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 24906882 '!=' null 2024-09-16T03:30:20.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:20.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:20.588 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:20.588 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:20.668 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:20.669 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:20.669 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:20.669 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:20.669 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:20.669 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:20.669 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:20.669 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:20.669 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:20.669 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:20.669 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:20.669 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:20.671 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:20.671 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:20.671 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:20.671 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:20.671 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:20.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:20.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:20.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:20.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:20.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:20.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:20.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:20.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:20.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:21.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:21.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:21.189 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:21.189 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:21.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:21.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:21.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:21.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:21.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:21.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:21.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:21.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:21.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:22.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=16600022 2024-09-16T03:30:22.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 16600022 '!=' null 2024-09-16T03:30:22.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:22.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:22.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:22.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:22.559 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:22.559 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:22.559 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:22.560 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:22.561 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:22.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:22.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:22.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:22.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:22.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:22.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:22.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:22.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:22.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:23.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:23.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:23.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:23.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:23.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:23.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:23.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:23.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:23.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:23.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:23.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:23.630 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:23.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:24.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=25336978 2024-09-16T03:30:24.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 25336978 '!=' null 2024-09-16T03:30:24.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:24.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:24.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:24.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:24.374 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:24.374 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:24.374 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:24.374 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:24.374 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:24.374 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:24.374 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:24.375 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:24.375 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:24.375 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:24.375 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:24.375 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:24.375 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:24.375 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:24.375 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:24.375 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:24.375 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:24.376 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:24.376 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:24.376 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:24.376 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:24.376 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:24.376 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:24.376 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:24.376 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:24.376 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:24.376 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:24.376 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:24.376 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:24.377 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:24.377 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:24.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:24.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:24.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:24.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:24.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:24.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:24.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:24.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:24.484 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:24.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:24.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:24.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:24.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:25.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:25.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:25.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:25.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:25.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:25.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:25.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:25.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:25.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:26.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=17473723 2024-09-16T03:30:26.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 17473723 '!=' null 2024-09-16T03:30:26.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:26.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:26.190 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:26.190 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:26.269 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:26.269 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:26.270 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:26.270 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:26.270 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:26.270 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:26.270 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:26.270 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:26.270 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:26.270 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:26.270 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:26.270 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:26.270 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:26.270 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:26.271 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:26.272 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:26.272 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:26.272 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:26.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:26.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:26.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:26.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:26.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:26.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:26.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:26.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:26.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:26.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:26.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:26.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:26.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:27.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:27.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:27.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:27.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:27.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:27.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:27.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:27.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:27.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:28.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=17473690 2024-09-16T03:30:28.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 17473690 '!=' null 2024-09-16T03:30:28.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:28.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:28.079 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:28.079 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:28.159 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:28.159 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:28.159 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:28.159 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:28.160 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:28.161 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:28.162 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:28.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:28.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:28.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:28.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:28.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:28.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:28.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:28.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:28.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:28.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:28.670 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:28.670 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:28.670 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:29.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:29.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:29.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:29.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:29.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:29.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:29.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:29.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:29.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:29.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=25336821 2024-09-16T03:30:29.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 25336821 '!=' null 2024-09-16T03:30:29.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:29.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:29.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:29.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:30.022 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:30.022 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:30.022 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:30.022 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:30.022 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:30.023 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:30.024 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:30.024 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:30.024 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:30.024 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:30.024 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:30.024 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:30.024 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:30.024 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:30.024 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:30.024 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:30.024 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:30.024 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:30.025 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:30.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:30.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:30.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:30.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:30.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:30.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:30.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:30.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:30.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:30.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:30.583 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:30.583 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:30.583 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:31.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:31.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:31.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:31.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:31.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:31.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:31.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:31.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:31.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:31.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=16600019 2024-09-16T03:30:31.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 16600019 '!=' null 2024-09-16T03:30:31.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:31.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:31.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:31.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:31.936 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [ 2024-09-16T03:30:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "priority": 110, 2024-09-16T03:30:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "items": [ 2024-09-16T03:30:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "3.0", 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 151, 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:31.938 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:31.938 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:31.938 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:31.938 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:31.938 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:31.938 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:31.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:32.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:32.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:32.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:32.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:32.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:32.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:32.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:32.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:32.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:32.451 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:32.452 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:32.452 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:33.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:33.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:33.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:33.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:33.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:33.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:33.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:33.084 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:33.084 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:33.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=25336848 2024-09-16T03:30:33.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 25336848 '!=' null 2024-09-16T03:30:33.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:33.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:33.879 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:33.879 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:33.959 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:33.959 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:33.960 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:33.960 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:33.960 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:33.960 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:33.960 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:33.960 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:33.960 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:33.960 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:33.960 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:33.960 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:33.961 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:33.961 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:33.961 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:33.961 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:33.961 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:33.961 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:33.961 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:33.961 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:33.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:34.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:34.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:34.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:34.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:34.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:34.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:34.081 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:34.081 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:34.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:34.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:34.496 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:34.496 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:35.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:35.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:35.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:35.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:35.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:35.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:35.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:35.147 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:35.147 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:35.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=24900136 2024-09-16T03:30:35.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 24900136 '!=' null 2024-09-16T03:30:35.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:35.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:35.817 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:35.817 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:35.897 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:35.898 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:35.898 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:35.898 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:35.898 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:35.898 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:35.898 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:35.898 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:35.898 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:35.898 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:35.898 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:35.898 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:35.898 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:35.899 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:35.899 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:35.899 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:35.899 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:35.899 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:35.899 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:35.899 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:35.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:36.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:36.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:36.007 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:36.007 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:36.007 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:36.007 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:36.007 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:36.007 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:36.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:36.430 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:36.430 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:36.430 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:37.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:37.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:37.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:37.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:37.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:37.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:37.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:37.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:37.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:37.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=13105353 2024-09-16T03:30:37.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 13105353 '!=' null 2024-09-16T03:30:37.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:37.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:37.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:37.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:37.829 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:37.829 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:37.829 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:37.829 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:37.829 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:37.829 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:37.829 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:37.829 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:37.829 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:37.830 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:37.830 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:37.830 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:37.830 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:37.830 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:37.830 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:37.830 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:37.830 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:37.830 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:37.830 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:37.830 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:37.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:37.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:37.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:37.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:37.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:37.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:37.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:37.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:37.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:38.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:30:38.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:38.416 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:38.416 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:38.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 3 2024-09-16T03:30:38.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 1 '!=' 1 2024-09-16T03:30:38.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:38.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:38.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:38.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:38.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:38.972 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:38.973 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:39.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=23589480 2024-09-16T03:30:39.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 23589480 '!=' null 2024-09-16T03:30:39.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:39.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:39.547 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:39.547 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:39.629 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:39.629 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:39.629 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:39.629 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:39.629 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:39.629 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:39.629 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:39.629 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:39.629 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:39.630 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:39.630 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:39.630 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:39.630 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:39.630 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:39.630 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:39.630 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:39.630 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:39.630 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:39.630 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:39.630 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:39.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:39.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:39.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:39.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:39.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:39.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:39.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:39.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:39.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:40.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:30:40.177 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:40.177 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:40.178 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:40.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:30:40.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 1 2024-09-16T03:30:40.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T03:30:40.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=2 2024-09-16T03:30:40.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:40.804 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:40.804 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:40.885 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:40.885 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:40.885 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:40.885 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:40.885 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:40.885 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:40.885 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:40.885 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:40.886 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:40.886 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:40.886 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:40.886 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:40.886 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:40.886 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:40.886 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:40.886 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:40.886 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:40.886 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:40.886 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:40.886 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:40.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:40.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:40.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:40.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:40.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:40.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:40.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:40.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:40.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:41.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:30:41.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:41.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:41.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:42.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:30:42.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 2 2024-09-16T03:30:42.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:42.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:42.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:42.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:42.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:42.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:42.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:42.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=10484137 2024-09-16T03:30:42.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 10484137 '!=' null 2024-09-16T03:30:42.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:42.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:42.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:42.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:42.823 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:42.823 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:42.824 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:42.824 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:42.824 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:42.824 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:42.824 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:42.824 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:42.825 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:42.825 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:42.825 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:42.825 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:42.825 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:42.825 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:42.825 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:42.825 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:42.825 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:42.825 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:42.825 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:42.826 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:42.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:42.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:42.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:42.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:42.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:42.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:42.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:42.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:42.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:43.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:30:43.341 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:43.341 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:43.341 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:43.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:30:43.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 2 2024-09-16T03:30:43.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:43.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:43.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:43.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:43.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:43.972 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:43.972 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:44.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=19551027 2024-09-16T03:30:44.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 19551027 '!=' null 2024-09-16T03:30:44.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:44.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:44.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:44.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:44.755 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:44.755 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:44.755 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:44.756 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:44.756 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:44.756 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:44.756 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:44.756 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:44.756 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:44.756 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:44.756 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:44.756 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:44.757 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:44.757 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:44.757 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:44.757 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:44.757 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:44.757 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:44.757 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:44.757 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:44.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:44.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:44.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:44.866 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:44.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:44.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:44.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:44.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:44.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:45.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:30:45.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:45.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:45.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:45.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:30:45.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 2 2024-09-16T03:30:45.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:45.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:45.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:45.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:45.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:45.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:45.896 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:46.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=17105984 2024-09-16T03:30:46.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 17105984 '!=' null 2024-09-16T03:30:46.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:46.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:46.498 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:46.498 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:46.578 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:46.578 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:46.578 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:46.578 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:46.579 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:46.580 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:46.580 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:46.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:46.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:46.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:46.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:46.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:46.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:46.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:46.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:46.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:47.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:30:47.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:47.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:47.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:47.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:30:47.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 2 2024-09-16T03:30:47.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:47.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:47.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:47.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:47.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:47.760 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:47.760 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:48.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=15726221 2024-09-16T03:30:48.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 15726221 '!=' null 2024-09-16T03:30:48.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:48.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:48.455 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:48.455 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:48.535 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:48.535 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:48.535 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:48.535 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:48.535 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:48.535 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:48.536 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:48.537 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:48.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:48.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:48.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:48.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:48.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:48.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:48.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:48.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:48.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:49.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:30:49.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:49.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:49.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:49.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:30:49.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 2 2024-09-16T03:30:49.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:49.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:49.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:49.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:49.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:49.608 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:49.608 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:50.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=24463057 2024-09-16T03:30:50.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 24463057 '!=' null 2024-09-16T03:30:50.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:50.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:50.332 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:50.332 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:50.412 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:50.412 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:50.412 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:50.412 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:50.413 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:50.413 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:50.413 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:50.413 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:50.413 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:50.413 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:50.414 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:50.414 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:50.414 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:50.414 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:50.414 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:50.414 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:50.414 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:50.415 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:50.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:50.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:50.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:50.521 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:50.521 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:50.521 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:50.521 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:50.521 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:50.521 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:50.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:30:50.956 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:50.956 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:50.956 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:51.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:30:51.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 2 2024-09-16T03:30:51.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:51.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:51.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:51.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:51.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:51.660 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:51.660 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:52.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=17473682 2024-09-16T03:30:52.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 17473682 '!=' null 2024-09-16T03:30:52.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:52.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:52.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:52.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:52.535 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:52.535 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:52.535 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:52.535 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:52.535 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:52.535 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:52.535 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:52.535 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:52.535 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:52.535 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:52.535 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:52.536 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:52.536 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:52.536 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:52.536 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:52.536 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:52.536 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:52.536 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:52.536 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:52.536 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:52.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:52.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:52.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:52.644 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:52.644 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:52.644 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:52.644 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:52.644 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:52.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:53.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:30:53.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:53.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:53.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:53.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:30:53.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 2 2024-09-16T03:30:53.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:53.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:53.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:53.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:53.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:53.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:53.685 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:54.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=26210731 2024-09-16T03:30:54.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 26210731 '!=' null 2024-09-16T03:30:54.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:54.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:54.312 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:54.312 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:54.392 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:54.393 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:54.394 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:54.394 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:54.394 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:54.394 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:54.394 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:54.394 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:54.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:54.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:54.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:54.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:54.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:54.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:54.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:54.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:54.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:54.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:30:54.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:54.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:54.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:55.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:30:55.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 2 2024-09-16T03:30:55.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:55.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:55.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:55.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:55.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:55.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:55.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:56.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=17473775 2024-09-16T03:30:56.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 17473775 '!=' null 2024-09-16T03:30:56.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:56.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:56.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:56.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:56.543 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:56.543 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:56.543 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:56.543 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:56.543 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:56.543 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:56.544 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:56.545 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:56.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:56.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:56.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:56.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:56.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:56.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:56.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:56.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:56.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:57.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:30:57.054 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:57.055 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:57.055 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:57.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:30:57.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 2 2024-09-16T03:30:57.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:57.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:57.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:57.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:57.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:57.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:57.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:30:58.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=17473820 2024-09-16T03:30:58.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 17473820 '!=' null 2024-09-16T03:30:58.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:30:58.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:58.455 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:30:58.455 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:30:58.535 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:30:58.535 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:30:58.535 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:58.535 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:58.535 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [ 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: "item": "1.0", 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: "prio": 110, 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: "can_preempt": true 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:30:58.536 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:30:58.537 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:30:58.537 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:30:58.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:30:58.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:30:58.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:30:58.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:30:58.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:30:58.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:30:58.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:30:58.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:30:58.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:30:59.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:30:59.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:30:59.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:30:59.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:30:59.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:30:59.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 2 2024-09-16T03:30:59.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:30:59.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:30:59.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:30:59.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:30:59.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:30:59.667 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:30:59.667 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:31:00.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=25337144 2024-09-16T03:31:00.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 25337144 '!=' null 2024-09-16T03:31:00.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:31:00.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:31:00.419 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:31:00.419 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:31:00.499 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:31:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:31:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:31:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:31:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:31:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:31:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:31:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:31:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:31:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:31:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:31:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:00.500 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:31:00.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:31:00.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:31:00.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:31:00.609 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:31:00.609 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:31:00.609 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:31:00.609 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:31:00.609 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:31:00.609 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:31:01.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:31:01.008 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:31:01.008 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:31:01.009 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:31:01.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:31:01.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 2 2024-09-16T03:31:01.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:31:01.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:31:01.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:31:01.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:31:01.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:31:01.582 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:31:01.582 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:31:02.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=11794890 2024-09-16T03:31:02.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 11794890 '!=' null 2024-09-16T03:31:02.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:31:02.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:31:02.186 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:31:02.186 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:31:02.266 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:31:02.266 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:31:02.266 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:31:02.266 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:31:02.266 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:31:02.267 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:31:02.267 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:02.267 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:31:02.267 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:31:02.267 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:31:02.267 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:31:02.267 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:31:02.267 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:02.267 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:31:02.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:31:02.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:31:02.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:31:02.375 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:31:02.376 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:31:02.376 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:31:02.376 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:31:02.376 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:31:02.376 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:31:02.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T03:31:02.777 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:31:02.777 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:31:02.777 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:31:03.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 3 2024-09-16T03:31:03.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 2 '!=' 2 2024-09-16T03:31:03.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:31:03.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:31:03.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:31:03.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:31:03.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:31:03.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:31:03.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:31:03.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=17036946 2024-09-16T03:31:03.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 17036946 '!=' null 2024-09-16T03:31:03.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:31:03.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 'CEPH_ARGS='\'''\''' ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:31:03.909 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: CEPH_ARGS= 2024-09-16T03:31:03.909 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_recovery_reservations 2024-09-16T03:31:03.989 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:31:03.989 INFO:tasks.workunit.client.0.smithi026.stdout: "local_reservations": { 2024-09-16T03:31:03.989 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:31:03.989 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:31:03.989 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:31:03.990 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:31:03.990 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:03.990 INFO:tasks.workunit.client.0.smithi026.stdout: "remote_reservations": { 2024-09-16T03:31:03.990 INFO:tasks.workunit.client.0.smithi026.stdout: "max_allowed": 1, 2024-09-16T03:31:03.990 INFO:tasks.workunit.client.0.smithi026.stdout: "min_priority": 0, 2024-09-16T03:31:03.990 INFO:tasks.workunit.client.0.smithi026.stdout: "queues": [], 2024-09-16T03:31:03.990 INFO:tasks.workunit.client.0.smithi026.stdout: "in_progress": [] 2024-09-16T03:31:03.990 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:03.990 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:31:03.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:31:04.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:31:04.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:31:04.098 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:31:04.098 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:31:04.098 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:31:04.098 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:31:04.098 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:31:04.098 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:31:04.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=3 2024-09-16T03:31:04.498 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:31:04.498 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:31:04.498 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:31:05.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 3 = 3 2024-09-16T03:31:05.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:31:05.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:31:05.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:301: TEST_backfill_priority: ceph pg dump pgs 2024-09-16T03:31:05.440 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T03:31:05.440 INFO:tasks.workunit.client.0.smithi026.stdout:7.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-09-16T03:30:07.982592+0000 93'150 120:400 [1,4] 1 [1,4] 1 0'0 2024-09-16T03:26:53.573934+0000 0'0 2024-09-16T03:26:53.573934+0000 0 0 periodic scrub scheduled @ 2024-09-17T15:00:07.795257+0000 0 0 2024-09-16T03:31:05.440 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-09-16T03:30:34.604233+0000 93'150 120:429 [1,2] 1 [1,2] 1 0'0 2024-09-16T03:26:43.428192+0000 0'0 2024-09-16T03:26:43.428192+0000 0 0 periodic scrub scheduled @ 2024-09-17T11:13:26.879229+0000 0 0 2024-09-16T03:31:05.440 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 50 0 0 0 0 524288000 0 0 50 100 50 active+clean 2024-09-16T03:31:00.440980+0000 93'150 120:447 [1,2] 1 [1,2] 1 0'0 2024-09-16T03:26:38.075611+0000 0'0 2024-09-16T03:26:38.075611+0000 0 0 periodic scrub scheduled @ 2024-09-17T05:46:41.984990+0000 0 0 2024-09-16T03:31:05.440 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T03:31:05.440 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T03:31:05.441 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:31:05.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:303: TEST_backfill_priority: get_asok_path osd.1 2024-09-16T03:31:05.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2024-09-16T03:31:05.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2024-09-16T03:31:05.454 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:31:05.454 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:31:05.454 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:31:05.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.27283/ceph-osd.1.asok 2024-09-16T03:31:05.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:303: TEST_backfill_priority: CEPH_ARGS= 2024-09-16T03:31:05.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:303: TEST_backfill_priority: ceph --admin-daemon /tmp/ceph-asok.27283/ceph-osd.1.asok dump_pgstate_history 2024-09-16T03:31:05.535 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:31:05.535 INFO:tasks.workunit.client.0.smithi026.stdout: "pgs": [ 2024-09-16T03:31:05.535 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.535 INFO:tasks.workunit.client.0.smithi026.stdout: "pg": "7.0", 2024-09-16T03:31:05.535 INFO:tasks.workunit.client.0.smithi026.stdout: "currently": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.536 INFO:tasks.workunit.client.0.smithi026.stdout: "history": [ 2024-09-16T03:31:05.536 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.536 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "62", 2024-09-16T03:31:05.536 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.536 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.536 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.536 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:53.873122+0000", 2024-09-16T03:31:05.536 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:53.873129+0000" 2024-09-16T03:31:05.536 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.536 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.536 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.536 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:53.873134+0000", 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:53.987209+0000" 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:53.987210+0000", 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:53.987258+0000" 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:53.987258+0000", 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:53.987267+0000" 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.537 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:53.987267+0000", 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:54.452048+0000" 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:53.873131+0000", 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:54.452055+0000" 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Activating", 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:54.452188+0000", 2024-09-16T03:31:05.538 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:54.779859+0000" 2024-09-16T03:31:05.539 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.539 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.539 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Recovered", 2024-09-16T03:31:05.539 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:54.779860+0000", 2024-09-16T03:31:05.539 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:54.779926+0000" 2024-09-16T03:31:05.539 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.539 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.539 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.539 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:54.779926+0000", 2024-09-16T03:31:05.539 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:55.717597+0000" 2024-09-16T03:31:05.540 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.540 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.540 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active", 2024-09-16T03:31:05.540 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:54.452055+0000", 2024-09-16T03:31:05.540 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:55.717615+0000" 2024-09-16T03:31:05.540 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.540 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.540 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.540 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:53.873129+0000", 2024-09-16T03:31:05.540 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:55.717658+0000" 2024-09-16T03:31:05.540 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.540 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:53.873120+0000", 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:55.717661+0000" 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "63", 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:55.717661+0000", 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:55.717861+0000" 2024-09-16T03:31:05.541 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "92", 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:55.717865+0000", 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:55.717874+0000" 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.542 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:55.717880+0000", 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:55.852859+0000" 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:55.852859+0000", 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:55.852966+0000" 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:55.852967+0000", 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:55.852985+0000" 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.543 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-09-16T03:31:05.544 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:55.852985+0000", 2024-09-16T03:31:05.544 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:56.137500+0000" 2024-09-16T03:31:05.544 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.544 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.544 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.544 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:55.717877+0000", 2024-09-16T03:31:05.544 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:56.137515+0000" 2024-09-16T03:31:05.544 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.544 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.544 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Activating", 2024-09-16T03:31:05.544 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:56.137709+0000", 2024-09-16T03:31:05.544 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:56.782954+0000" 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Recovered", 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:56.782954+0000", 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:56.783019+0000" 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:56.783020+0000", 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.488393+0000" 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active", 2024-09-16T03:31:05.545 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:56.137516+0000", 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.488418+0000" 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:55.717874+0000", 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.488476+0000" 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:55.717862+0000", 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.488481+0000" 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.546 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "92", 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.488482+0000", 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.488775+0000" 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "98", 2024-09-16T03:31:05.547 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.488782+0000", 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.488811+0000" 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.488821+0000", 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.606112+0000" 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.548 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.606112+0000", 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.606197+0000" 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.606197+0000", 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.606216+0000" 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.606217+0000", 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.865490+0000" 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.549 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.488817+0000", 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.865500+0000" 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Activating", 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.865580+0000", 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.915987+0000" 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Recovered", 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.915988+0000", 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.916053+0000" 2024-09-16T03:31:05.550 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.916053+0000", 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:46.911750+0000" 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active", 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.865501+0000", 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:46.911769+0000" 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.551 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.488811+0000", 2024-09-16T03:31:05.552 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:46.911861+0000" 2024-09-16T03:31:05.552 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.552 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.552 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.552 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.488775+0000", 2024-09-16T03:31:05.552 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:46.911865+0000" 2024-09-16T03:31:05.552 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.552 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.552 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.552 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "98", 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:46.911866+0000", 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:46.912170+0000" 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "101", 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.553 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:46.912174+0000", 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:46.912186+0000" 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:46.912193+0000", 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.029590+0000" 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.029591+0000", 2024-09-16T03:31:05.554 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.029682+0000" 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:46.912190+0000", 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.029690+0000" 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/WaitActingChange", 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.029690+0000", 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.364933+0000" 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.555 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:46.912186+0000", 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.364959+0000" 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:46.912170+0000", 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.364963+0000" 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "101", 2024-09-16T03:31:05.556 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.557 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.557 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.557 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.364963+0000", 2024-09-16T03:31:05.557 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.365166+0000" 2024-09-16T03:31:05.557 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.557 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.557 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.557 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.557 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "115", 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.365170+0000", 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.365183+0000" 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.365192+0000", 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.484982+0000" 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.558 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.484983+0000", 2024-09-16T03:31:05.559 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.485049+0000" 2024-09-16T03:31:05.559 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.559 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.559 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-09-16T03:31:05.559 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.485050+0000", 2024-09-16T03:31:05.559 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.485066+0000" 2024-09-16T03:31:05.559 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.559 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.559 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-09-16T03:31:05.559 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.485066+0000", 2024-09-16T03:31:05.559 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.671723+0000" 2024-09-16T03:31:05.560 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.560 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.560 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.560 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.365188+0000", 2024-09-16T03:31:05.560 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:47.671733+0000" 2024-09-16T03:31:05.560 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.560 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.560 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Activating", 2024-09-16T03:31:05.560 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.671975+0000", 2024-09-16T03:31:05.560 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:48.793077+0000" 2024-09-16T03:31:05.560 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.560 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:48.793078+0000", 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:48.793178+0000" 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:48.793178+0000", 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:48.793513+0000" 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Backfilling", 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:48.793515+0000", 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:21.730000+0000" 2024-09-16T03:31:05.561 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.562 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.562 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/NotBackfilling", 2024-09-16T03:31:05.562 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:21.730001+0000", 2024-09-16T03:31:05.562 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:21.730234+0000" 2024-09-16T03:31:05.562 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.562 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.562 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2024-09-16T03:31:05.562 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:21.730234+0000", 2024-09-16T03:31:05.562 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:34.479781+0000" 2024-09-16T03:31:05.562 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.562 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.562 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:34.479781+0000", 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:34.480194+0000" 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Backfilling", 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:34.480194+0000", 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:06.521154+0000" 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Recovered", 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:06.521155+0000", 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:06.521288+0000" 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.563 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:06.521288+0000", 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:07.098065+0000" 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active", 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.671734+0000", 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:07.098086+0000" 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.365184+0000", 2024-09-16T03:31:05.564 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:07.098128+0000" 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:47.365167+0000", 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:07.098131+0000" 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "115", 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.565 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:07.098132+0000", 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:07.098363+0000" 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: "pg": "3.0", 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: "currently": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: "history": [ 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "40", 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.566 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:44.323687+0000", 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:44.323694+0000" 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:44.323699+0000", 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:44.484968+0000" 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:44.484970+0000", 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:44.485022+0000" 2024-09-16T03:31:05.567 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:44.485023+0000", 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:44.485031+0000" 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:44.485032+0000", 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:44.731075+0000" 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:44.323697+0000", 2024-09-16T03:31:05.568 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:44.731081+0000" 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Activating", 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:44.731275+0000", 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:45.507477+0000" 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active", 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:44.731086+0000", 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:45.507492+0000" 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.569 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.570 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:44.323695+0000", 2024-09-16T03:31:05.570 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:45.507507+0000" 2024-09-16T03:31:05.570 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.570 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.570 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.570 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:44.323683+0000", 2024-09-16T03:31:05.570 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:45.507510+0000" 2024-09-16T03:31:05.570 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.570 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.570 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "40", 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:45.507510+0000", 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:45.507646+0000" 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "89", 2024-09-16T03:31:05.571 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:45.507649+0000", 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:45.507657+0000" 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:45.507662+0000", 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:45.616975+0000" 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:45.616976+0000", 2024-09-16T03:31:05.572 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:45.617061+0000" 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:45.617062+0000", 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:45.617077+0000" 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:45.617078+0000", 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:46.178256+0000" 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.573 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:45.507660+0000", 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:46.178265+0000" 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Activating", 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:46.178411+0000", 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:46.480514+0000" 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Recovered", 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:46.480515+0000", 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:46.480547+0000" 2024-09-16T03:31:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.575 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.575 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.575 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:46.480547+0000", 2024-09-16T03:31:05.575 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:23.834431+0000" 2024-09-16T03:31:05.575 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.575 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.575 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active", 2024-09-16T03:31:05.575 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:46.178266+0000", 2024-09-16T03:31:05.575 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:23.834450+0000" 2024-09-16T03:31:05.575 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.575 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.575 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:45.507657+0000", 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:23.834505+0000" 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:45.507646+0000", 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:23.834510+0000" 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "89", 2024-09-16T03:31:05.576 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:23.834511+0000", 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:23.834754+0000" 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "106", 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:23.834759+0000", 2024-09-16T03:31:05.577 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:23.834774+0000" 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:23.834796+0000", 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:23.848792+0000" 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:23.848793+0000", 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:23.848851+0000" 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.578 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:23.848852+0000", 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:23.848861+0000" 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:23.848861+0000", 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.169931+0000" 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:23.834781+0000", 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.169942+0000" 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.579 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.580 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Activating", 2024-09-16T03:31:05.580 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.170015+0000", 2024-09-16T03:31:05.580 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.228909+0000" 2024-09-16T03:31:05.580 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.580 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.580 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Recovered", 2024-09-16T03:31:05.580 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.228910+0000", 2024-09-16T03:31:05.580 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:27:24.228969+0000" 2024-09-16T03:31:05.580 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.580 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.580 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.580 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.228969+0000", 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.165203+0000" 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active", 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:24.169944+0000", 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.165224+0000" 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:23.834775+0000", 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.165290+0000" 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.581 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:27:23.834754+0000", 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.165293+0000" 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "107", 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.165293+0000", 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.165574+0000" 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.582 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "109", 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.165577+0000", 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.165588+0000" 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.165594+0000", 2024-09-16T03:31:05.583 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.389867+0000" 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.389868+0000", 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.389926+0000" 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.165591+0000", 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.389934+0000" 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/WaitActingChange", 2024-09-16T03:31:05.584 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.389934+0000", 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.708490+0000" 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.165588+0000", 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.708515+0000" 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.165574+0000", 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.708519+0000" 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.585 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "109", 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.708519+0000", 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.708726+0000" 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "117", 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.586 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.708730+0000", 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.708744+0000" 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.708751+0000", 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.709246+0000" 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.709247+0000", 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.709307+0000" 2024-09-16T03:31:05.587 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.709308+0000", 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:07.709322+0000" 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.709323+0000", 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:08.135859+0000" 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.588 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.708748+0000", 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:08.135869+0000" 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Activating", 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:08.136113+0000", 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:08.722062+0000" 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:08.722064+0000", 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:21.730109+0000" 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.589 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:21.730110+0000", 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:21.730545+0000" 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Backfilling", 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:21.730546+0000", 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:34.479674+0000" 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/NotBackfilling", 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:34.479675+0000", 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:29:34.479926+0000" 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.590 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:34.479926+0000", 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:06.521543+0000" 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:06.521543+0000", 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:06.521943+0000" 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Backfilling", 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:06.521944+0000", 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:33.187162+0000" 2024-09-16T03:31:05.591 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Recovered", 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:33.187163+0000", 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:33.187259+0000" 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:33.187259+0000", 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:33.471567+0000" 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active", 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:08.135870+0000", 2024-09-16T03:31:05.592 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:33.471600+0000" 2024-09-16T03:31:05.593 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.593 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.593 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.593 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.708745+0000", 2024-09-16T03:31:05.593 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:33.471682+0000" 2024-09-16T03:31:05.593 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.593 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.593 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.593 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:29:07.708726+0000", 2024-09-16T03:31:05.593 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:33.471690+0000" 2024-09-16T03:31:05.593 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "117", 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:33.471691+0000", 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:33.472153+0000" 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.594 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: "pg": "1.0", 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: "currently": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: "history": [ 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "27", 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Initial", 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:38.452732+0000", 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:38.452845+0000" 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.595 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "27", 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:38.452846+0000", 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:38.452878+0000" 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.596 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "29", 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:38.452881+0000", 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:38.452888+0000" 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:38.452893+0000", 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:38.553316+0000" 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.597 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:38.553317+0000", 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:38.553372+0000" 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:38.553373+0000", 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:38.553383+0000" 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:38.553383+0000", 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:38.737600+0000" 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.598 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.599 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.599 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:38.452891+0000", 2024-09-16T03:31:05.599 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:38.737606+0000" 2024-09-16T03:31:05.599 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.599 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.599 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Activating", 2024-09-16T03:31:05.599 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:38.737761+0000", 2024-09-16T03:31:05.599 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:39.758819+0000" 2024-09-16T03:31:05.599 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.599 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Recovered", 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:39.758819+0000", 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:39.758877+0000" 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:39.758878+0000", 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.185857+0000" 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active", 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:38.737607+0000", 2024-09-16T03:31:05.600 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.185878+0000" 2024-09-16T03:31:05.601 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.601 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.601 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.601 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:38.452888+0000", 2024-09-16T03:31:05.601 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.185925+0000" 2024-09-16T03:31:05.601 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.601 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.601 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.601 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:38.452878+0000", 2024-09-16T03:31:05.601 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.185928+0000" 2024-09-16T03:31:05.601 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.602 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.602 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.602 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.602 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "29", 2024-09-16T03:31:05.602 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.602 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.602 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.602 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.185929+0000", 2024-09-16T03:31:05.602 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.186105+0000" 2024-09-16T03:31:05.602 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "103", 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.186108+0000", 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.186116+0000" 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.186126+0000", 2024-09-16T03:31:05.603 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.295339+0000" 2024-09-16T03:31:05.604 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.604 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.604 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.604 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.295340+0000", 2024-09-16T03:31:05.604 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.295401+0000" 2024-09-16T03:31:05.604 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.604 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.604 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-09-16T03:31:05.604 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.295401+0000", 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.295411+0000" 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.295412+0000", 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.655315+0000" 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.186119+0000", 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.655324+0000" 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.605 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Activating", 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.655459+0000", 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.885380+0000" 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Recovered", 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.885381+0000", 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:26:40.885447+0000" 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.885448+0000", 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.087434+0000" 2024-09-16T03:31:05.606 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active", 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.655325+0000", 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.087457+0000" 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.186117+0000", 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.087525+0000" 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:26:40.186105+0000", 2024-09-16T03:31:05.607 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.087528+0000" 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "103", 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.087529+0000", 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.087803+0000" 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.608 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "104", 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.087807+0000", 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.087820+0000" 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.087828+0000", 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.114722+0000" 2024-09-16T03:31:05.609 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.114723+0000", 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.114811+0000" 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.087824+0000", 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.114819+0000" 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/WaitActingChange", 2024-09-16T03:31:05.610 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.114819+0000", 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.348299+0000" 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.087821+0000", 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.348344+0000" 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.087804+0000", 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.348352+0000" 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.611 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "104", 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.348353+0000", 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.348718+0000" 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "119", 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.612 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Start", 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.348726+0000", 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.348751+0000" 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetInfo", 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.348767+0000", 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.465862+0000" 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetLog", 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.465862+0000", 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.465937+0000" 2024-09-16T03:31:05.613 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/GetMissing", 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.465937+0000", 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.465957+0000" 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering/WaitUpThru", 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.465957+0000", 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.709262+0000" 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Peering", 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.348760+0000", 2024-09-16T03:31:05.614 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.709270+0000" 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Activating", 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.709566+0000", 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:28:59.919936+0000" 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/WaitLocalBackfillReserved", 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.919936+0000", 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:33.187470+0000" 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/WaitRemoteBackfillReserved", 2024-09-16T03:31:05.615 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:33.187470+0000", 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:33.187822+0000" 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Backfilling", 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:33.187822+0000", 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:59.609958+0000" 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Recovered", 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:59.609958+0000", 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:59.610108+0000" 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.616 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active/Clean", 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:59.610108+0000", 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:59.945103+0000" 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary/Active", 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.709271+0000", 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:59.945116+0000" 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started/Primary", 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.348751+0000", 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:59.945153+0000" 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.617 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Started", 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:28:59.348718+0000", 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:59.945155+0000" 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: "epoch": "119", 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: "states": [ 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: "state": "Reset", 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: "enter": "2024-09-16T03:30:59.945159+0000", 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: "exit": "2024-09-16T03:30:59.945391+0000" 2024-09-16T03:31:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.619 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.619 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.619 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.619 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:31:05.619 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:31:05.619 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:31:05.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:305: TEST_backfill_priority: '[' 0 '!=' 0 ']' 2024-09-16T03:31:05.620 INFO:tasks.workunit.client.0.smithi026.stdout:TEST PASSED 2024-09-16T03:31:05.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:309: TEST_backfill_priority: echo TEST PASSED 2024-09-16T03:31:05.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:312: TEST_backfill_priority: delete_pool test1 2024-09-16T03:31:05.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test1 2024-09-16T03:31:05.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-09-16T03:31:06.039 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' does not exist 2024-09-16T03:31:06.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:313: TEST_backfill_priority: delete_pool test3 2024-09-16T03:31:06.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test3 2024-09-16T03:31:06.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test3 test3 --yes-i-really-really-mean-it 2024-09-16T03:31:06.590 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test3' does not exist 2024-09-16T03:31:06.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:314: TEST_backfill_priority: delete_pool test7 2024-09-16T03:31:06.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test7 2024-09-16T03:31:06.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test7 test7 --yes-i-really-really-mean-it 2024-09-16T03:31:07.102 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test7' does not exist 2024-09-16T03:31:07.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:315: TEST_backfill_priority: kill_daemons td/osd-backfill-prio 2024-09-16T03:31:07.115 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:31:07.115 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:31:07.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:31:07.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:31:07.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:31:08.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:31:08.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:316: TEST_backfill_priority: return 0 2024-09-16T03:31:08.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh:43: run: teardown td/osd-backfill-prio 2024-09-16T03:31:08.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-prio 2024-09-16T03:31:08.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:31:08.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-prio KILL 2024-09-16T03:31:08.427 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:31:08.427 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:31:08.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:31:08.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:31:08.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:31:08.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:31:08.435 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:31:08.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:31:08.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:31:08.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:31:08.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:31:08.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:31:08.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:31:08.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:31:08.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:31:08.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:31:08.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:31:08.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:31:08.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-prio 2024-09-16T03:31:08.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:31:08.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:31:08.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:31:08.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.27283 2024-09-16T03:31:08.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:31:08.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:31:08.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:31:08.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/osd-backfill-prio 0 2024-09-16T03:31:08.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-prio 2024-09-16T03:31:08.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:31:08.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-prio KILL 2024-09-16T03:31:08.479 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:31:08.479 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:31:08.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:31:08.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:31:08.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:31:08.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:31:08.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:31:08.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:31:08.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:31:08.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:31:08.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:31:08.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:31:08.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:31:08.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:31:08.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:31:08.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:31:08.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:31:08.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:31:08.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-prio 2024-09-16T03:31:08.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:31:08.489 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:31:08.489 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.27283 2024-09-16T03:31:08.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.27283 2024-09-16T03:31:08.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:31:08.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:31:08.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:31:08.491 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:31:08.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:31:08.522 INFO:tasks.workunit:Running workunit osd-backfill/osd-backfill-recovery-log.sh... 2024-09-16T03:31:08.522 DEBUG:teuthology.orchestra.run.smithi026:workunit test osd-backfill/osd-backfill-recovery-log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh 2024-09-16T03:31:08.585 INFO:tasks.workunit.client.0.smithi026.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:31:08.591 INFO:tasks.workunit.client.0.smithi026.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:31:08.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-16T03:31:08.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-16T03:31:08.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:31:08.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:31:08.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/osd-backfill-recovery-log 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:21: run: local dir=td/osd-backfill-recovery-log 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:22: run: shift 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:25: run: export CEPH_MON=127.0.0.1:7129 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:25: run: CEPH_MON=127.0.0.1:7129 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:26: run: export CEPH_ARGS 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:27: run: uuidgen 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:27: run: CEPH_ARGS+='--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none ' 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 ' 2024-09-16T03:31:08.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:29: run: CEPH_ARGS+='--osd_mclock_override_recovery_settings=true ' 2024-09-16T03:31:08.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:31: run: set 2024-09-16T03:31:08.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:31:08.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:31: run: local 'funcs=TEST_backfill_log_1 2024-09-16T03:31:08.595 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_log_2 2024-09-16T03:31:08.595 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_recovery_1 2024-09-16T03:31:08.595 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_recovery_2' 2024-09-16T03:31:08.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:32: run: for func in $funcs 2024-09-16T03:31:08.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:33: run: setup td/osd-backfill-recovery-log 2024-09-16T03:31:08.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-recovery-log 2024-09-16T03:31:08.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-recovery-log 2024-09-16T03:31:08.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:31:08.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:31:08.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-09-16T03:31:08.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:31:08.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:31:08.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:31:08.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:31:08.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:31:08.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:31:08.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:31:08.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:31:08.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:31:08.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:31:08.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:31:08.598 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:31:08.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:31:08.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:31:08.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:31:08.599 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:31:08.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:31:08.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:31:08.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-recovery-log 2024-09-16T03:31:08.602 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:31:08.602 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:31:08.602 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:31:08.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.53196 2024-09-16T03:31:08.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:31:08.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:31:08.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-recovery-log 2024-09-16T03:31:08.604 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:31:08.604 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:31:08.604 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:31:08.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.53196 2024-09-16T03:31:08.609 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-recovery-log 1' TERM HUP INT 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:34: run: TEST_backfill_log_1 td/osd-backfill-recovery-log 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:106: TEST_backfill_log_1: local dir=td/osd-backfill-recovery-log 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:108: TEST_backfill_log_1: _common_test td/osd-backfill-recovery-log '--osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2 8 150 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:41: _common_test: local dir=td/osd-backfill-recovery-log 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:42: _common_test: local 'extra_opts=--osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:43: _common_test: local loglen=2 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:44: _common_test: local dupslen=8 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:45: _common_test: local objects=150 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:46: _common_test: local moreobjects=0 2024-09-16T03:31:08.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:48: _common_test: local OSDS=6 2024-09-16T03:31:08.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:50: _common_test: run_mon td/osd-backfill-recovery-log a 2024-09-16T03:31:08.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-recovery-log 2024-09-16T03:31:08.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:31:08.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:31:08.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:31:08.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-recovery-log/a 2024-09-16T03:31:08.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-recovery-log/a --run-dir=td/osd-backfill-recovery-log 2024-09-16T03:31:09.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:31:09.062 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:31:09.062 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:31:09.062 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:31:09.062 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:31:09.062 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:31:09.062 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:31:09.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-recovery-log/a '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-recovery-log/log --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:31:09.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:31:09.254 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:31:09.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:31:09.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:31:09.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:31:09.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:31:09.255 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:31:09.255 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:31:09.255 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:31:09.256 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:31:09.256 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:31:09.256 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:31:09.256 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.53196/ceph-mon.a.asok 2024-09-16T03:31:09.256 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:31:09.256 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.53196/ceph-mon.a.asok config get fsid 2024-09-16T03:31:09.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:31:09.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:31:09.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:31:09.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:31:09.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:31:09.344 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:31:09.344 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:31:09.344 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:31:09.344 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:31:09.344 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:31:09.344 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:31:09.344 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.53196/ceph-mon.a.asok 2024-09-16T03:31:09.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:31:09.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.53196/ceph-mon.a.asok config get mon_host 2024-09-16T03:31:09.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:51: _common_test: run_mgr td/osd-backfill-recovery-log x 2024-09-16T03:31:09.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-recovery-log 2024-09-16T03:31:09.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:31:09.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:31:09.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:31:09.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-recovery-log/x 2024-09-16T03:31:09.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:31:10.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:31:10.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:31:10.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:31:10.278 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:31:10.278 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:31:10.278 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:31:10.278 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:31:10.278 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:31:10.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-recovery-log/x '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:31:10.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:52: _common_test: export CEPH_ARGS 2024-09-16T03:31:10.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: export 'EXTRA_OPTS= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-09-16T03:31:10.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: EXTRA_OPTS=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-09-16T03:31:10.309 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: expr 6 - 1 2024-09-16T03:31:10.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: seq 0 5 2024-09-16T03:31:10.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:31:10.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 0 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/0 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/0' 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/0/journal' 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:31:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-09-16T03:31:10.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:31:10.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:31:10.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:31:10.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:31:10.315 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:31:10.315 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:31:10.315 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:31:10.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:31:10.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:31:10.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:31:10.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:31:10.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:31:10.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:31:10.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:31:10.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:31:10.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:31:10.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:31:10.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:31:10.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:31:10.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:31:10.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/0 2024-09-16T03:31:10.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:31:10.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1abf3abb-5c00-4cff-8501-5bfec4409f16 2024-09-16T03:31:10.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1abf3abb-5c00-4cff-8501-5bfec4409f16' 2024-09-16T03:31:10.317 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 1abf3abb-5c00-4cff-8501-5bfec4409f16 2024-09-16T03:31:10.318 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:31:10.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB+pudmJY/dExAAv6MF2nX1iEL3NDen9mHUaQ== 2024-09-16T03:31:10.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB+pudmJY/dExAAv6MF2nX1iEL3NDen9mHUaQ=="}' 2024-09-16T03:31:10.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1abf3abb-5c00-4cff-8501-5bfec4409f16 -i td/osd-backfill-recovery-log/0/new.json 2024-09-16T03:31:10.711 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:31:10.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/0/new.json 2024-09-16T03:31:10.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB+pudmJY/dExAAv6MF2nX1iEL3NDen9mHUaQ== --osd-uuid 1abf3abb-5c00-4cff-8501-5bfec4409f16 2024-09-16T03:31:10.756 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:10.754+0000 7f971c417640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:31:10.780 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:10.778+0000 7f971c417640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:31:10.780 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:10.779+0000 7f971c417640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:31:10.781 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:10.779+0000 7f971c417640 -1 bdev(0x560c7ba97c00 td/osd-backfill-recovery-log/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:31:10.781 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:10.779+0000 7f971c417640 -1 bluestore(td/osd-backfill-recovery-log/0) _read_fsid unparsable uuid 2024-09-16T03:31:16.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/0/keyring 2024-09-16T03:31:16.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:31:16.741 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T03:31:16.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:31:16.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:31:17.304 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T03:31:17.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:31:17.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:31:17.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:31:17.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:31:17.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:31:17.336 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:17.335+0000 7efefb433640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:31:17.341 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:17.339+0000 7efefb433640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:31:17.342 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:17.340+0000 7efefb433640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:31:17.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:31:17.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:31:17.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:31:17.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:31:17.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:31:17.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:17.764 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:31:17.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:31:17.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:17.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:18.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:18.437 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:18.436+0000 7efefb433640 -1 Falling back to public interface 2024-09-16T03:31:19.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:19.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:19.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:31:19.199 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:31:19.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:19.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:19.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:20.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:20.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:20.626 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:31:20.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:31:20.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:20.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:21.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:21.594 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:21.592+0000 7efefb433640 -1 osd.0 0 log_to_monitors true 2024-09-16T03:31:22.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:22.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:22.059 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:31:22.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:31:22.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:22.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:22.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:23.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:23.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:23.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:31:23.673 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:31:23.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:23.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:24.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:25.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:25.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:25.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:31:25.090 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:31:25.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:25.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:25.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:26.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:26.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:26.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:31:26.513 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:31:26.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:26.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:26.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:27.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:27.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:27.941 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:31:27.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:31:27.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:27.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:28.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:29.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:29.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:29.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:31:29.472 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:31:29.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:29.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:29.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:30.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:30.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:30.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:31:30.896 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:31:30.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:30.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:31.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:32.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:32.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:32.399 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:31:32.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:31:32.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:32.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:33.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:34.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:34.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:34.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:31:34.006 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:31:34.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:34.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:34.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:35.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:35.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:35.580 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:31:35.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:31:35.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:35.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:36.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:37.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:37.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:37.211 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:31:37.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:31:37.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:37.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:38.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:39.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:39.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:39.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:31:39.115 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:31:39.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:39.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:40.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:41.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:41.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:41.049 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:31:41.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:31:41.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:41.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:41.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:42.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:42.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:42.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:31:42.690 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:31:42.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:42.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:31:43.148 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/453870641,v1:127.0.0.1:6803/453870641] [v2:127.0.0.1:6804/453870641,v1:127.0.0.1:6805/453870641] exists,up 1abf3abb-5c00-4cff-8501-5bfec4409f16 2024-09-16T03:31:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:31:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:31:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:31:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:31:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 1 2024-09-16T03:31:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:31:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:31:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:31:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:31:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/1 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/1' 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/1/journal' 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:31:43.153 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:31:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:31:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:31:43.154 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:31:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:31:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:31:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:31:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:31:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:31:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:31:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:31:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:31:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:31:43.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:31:43.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:31:43.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:31:43.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/1 2024-09-16T03:31:43.155 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:31:43.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ff0a8623-176e-4063-a2b0-283e31dee784 2024-09-16T03:31:43.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ff0a8623-176e-4063-a2b0-283e31dee784' 2024-09-16T03:31:43.155 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 ff0a8623-176e-4063-a2b0-283e31dee784 2024-09-16T03:31:43.155 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:31:43.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCfpudmlp4nChAAAh3olgaQTl50ZFtDq7VEbw== 2024-09-16T03:31:43.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCfpudmlp4nChAAAh3olgaQTl50ZFtDq7VEbw=="}' 2024-09-16T03:31:43.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ff0a8623-176e-4063-a2b0-283e31dee784 -i td/osd-backfill-recovery-log/1/new.json 2024-09-16T03:31:43.805 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:31:43.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/1/new.json 2024-09-16T03:31:43.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCfpudmlp4nChAAAh3olgaQTl50ZFtDq7VEbw== --osd-uuid ff0a8623-176e-4063-a2b0-283e31dee784 2024-09-16T03:31:43.851 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:43.850+0000 7fd22f520640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:31:43.855 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:43.853+0000 7fd22f520640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:31:43.856 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:43.854+0000 7fd22f520640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:31:43.856 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:43.855+0000 7fd22f520640 -1 bdev(0x55cfeb23dc00 td/osd-backfill-recovery-log/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:31:43.856 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:43.855+0000 7fd22f520640 -1 bluestore(td/osd-backfill-recovery-log/1) _read_fsid unparsable uuid 2024-09-16T03:31:49.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/1/keyring 2024-09-16T03:31:49.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:31:49.469 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T03:31:49.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:31:49.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:31:50.048 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T03:31:50.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:31:50.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:31:50.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:31:50.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:31:50.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:31:50.080 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:50.078+0000 7fc7d7e0c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:31:50.082 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:50.080+0000 7fc7d7e0c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:31:50.083 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:50.081+0000 7fc7d7e0c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:31:50.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:31:50.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:31:50.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:31:50.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:31:50.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:31:50.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:50.476 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:31:50.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:31:50.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:50.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:31:50.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:51.701 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:51.677+0000 7fc7d7e0c640 -1 Falling back to public interface 2024-09-16T03:31:51.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:51.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:51.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:31:51.911 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:31:51.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:51.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:31:52.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:53.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:53.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:53.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:31:53.348 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:31:53.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:53.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:31:53.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:54.353 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:31:54.350+0000 7fc7d7e0c640 -1 osd.1 0 log_to_monitors true 2024-09-16T03:31:54.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:54.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:54.821 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:31:54.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:31:54.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:54.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:31:55.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:56.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:56.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:56.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:31:56.441 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:31:56.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:56.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:31:56.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:57.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:57.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:57.936 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:31:57.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:31:57.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:57.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:31:58.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:31:59.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:31:59.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:31:59.382 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:31:59.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:31:59.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:31:59.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:31:59.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:00.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:00.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:00.799 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:32:00.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:32:00.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:00.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:32:01.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:02.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:02.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:02.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:32:02.296 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:32:02.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:02.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:32:02.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:03.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:03.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:03.751 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:32:03.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:32:03.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:03.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:32:04.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:05.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:05.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:05.233 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:32:05.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:32:05.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:05.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:32:05.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:06.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:06.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:06.789 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:32:06.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:32:06.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:06.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:32:07.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:08.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:08.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:08.214 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:32:08.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:32:08.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:08.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:32:08.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:09.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:09.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:09.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:32:09.778 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:32:09.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:09.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:32:10.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:11.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:11.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:11.478 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:32:11.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:32:11.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:11.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:32:12.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:13.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:13.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:13.283 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:32:13.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:32:13.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:13.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:32:14.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:15.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:15.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:15.217 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:32:15.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:32:15.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:15.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:32:16.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:17.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:17.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:17.183 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:32:17.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:32:17.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:17.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:32:17.616 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/465698724,v1:127.0.0.1:6811/465698724] [v2:127.0.0.1:6812/465698724,v1:127.0.0.1:6813/465698724] exists,up ff0a8623-176e-4063-a2b0-283e31dee784 2024-09-16T03:32:17.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:32:17.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 2 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/2 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:32:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/2' 2024-09-16T03:32:17.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/2/journal' 2024-09-16T03:32:17.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:32:17.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-09-16T03:32:17.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:32:17.621 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:32:17.621 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:32:17.621 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:32:17.621 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:32:17.621 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:32:17.621 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:32:17.621 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:32:17.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:32:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:32:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:32:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:32:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:32:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:32:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:32:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:32:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:32:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:32:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:32:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:32:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/2 2024-09-16T03:32:17.623 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:32:17.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9aa11c3a-d099-430b-808c-fd0f5cb5ed2c 2024-09-16T03:32:17.623 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 9aa11c3a-d099-430b-808c-fd0f5cb5ed2c 2024-09-16T03:32:17.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 9aa11c3a-d099-430b-808c-fd0f5cb5ed2c' 2024-09-16T03:32:17.624 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:32:17.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDBpudmgmUUJhAAAVQSJXbsOApLpIZcPon6tg== 2024-09-16T03:32:17.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDBpudmgmUUJhAAAVQSJXbsOApLpIZcPon6tg=="}' 2024-09-16T03:32:17.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9aa11c3a-d099-430b-808c-fd0f5cb5ed2c -i td/osd-backfill-recovery-log/2/new.json 2024-09-16T03:32:18.140 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:32:18.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/2/new.json 2024-09-16T03:32:18.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDBpudmgmUUJhAAAVQSJXbsOApLpIZcPon6tg== --osd-uuid 9aa11c3a-d099-430b-808c-fd0f5cb5ed2c 2024-09-16T03:32:18.184 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:18.182+0000 7ff36732e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:32:18.186 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:18.184+0000 7ff36732e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:32:18.187 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:18.185+0000 7ff36732e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:32:18.187 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:18.186+0000 7ff36732e640 -1 bdev(0x562a6b703c00 td/osd-backfill-recovery-log/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:32:18.187 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:18.186+0000 7ff36732e640 -1 bluestore(td/osd-backfill-recovery-log/2) _read_fsid unparsable uuid 2024-09-16T03:32:23.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/2/keyring 2024-09-16T03:32:23.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:32:23.835 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T03:32:23.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:32:23.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:32:24.405 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T03:32:24.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:32:24.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:32:24.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:32:24.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:32:24.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:32:24.437 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:24.435+0000 7fbc2980e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:32:24.439 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:24.437+0000 7fbc2980e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:32:24.440 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:24.439+0000 7fbc2980e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:32:24.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:32:24.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:32:24.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:32:24.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:32:24.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:32:24.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:24.841 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:32:24.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:32:24.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:24.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:25.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:25.524 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:25.522+0000 7fbc2980e640 -1 Falling back to public interface 2024-09-16T03:32:26.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:26.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:26.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:32:26.285 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:32:26.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:26.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:26.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:27.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:27.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:27.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:32:27.736 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:32:27.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:27.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:27.838 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:27.836+0000 7fbc2980e640 -1 osd.2 0 log_to_monitors true 2024-09-16T03:32:28.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:29.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:29.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:29.283 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:32:29.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:32:29.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:29.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:29.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:30.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:30.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:30.736 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:32:30.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:32:30.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:30.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:31.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:32.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:32.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:32.170 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:32:32.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:32:32.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:32.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:32.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:33.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:33.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:33.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:32:33.685 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:32:33.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:33.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:34.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:35.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:35.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:35.137 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:32:35.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:32:35.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:35.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:35.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:36.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:36.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:36.607 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:32:36.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:32:36.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:36.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:37.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:38.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:38.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:38.045 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:32:38.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:32:38.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:38.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:38.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:39.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:39.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:39.605 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:32:39.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:32:39.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:39.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:40.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:41.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:41.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:41.482 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:32:41.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:32:41.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:41.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:42.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:43.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:43.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:43.341 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:32:43.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:32:43.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:43.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:44.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:45.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:45.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:45.025 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:32:45.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:32:45.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:45.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:45.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:46.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:46.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:46.796 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:32:46.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:32:46.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:46.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:47.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:48.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:48.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:48.316 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:32:48.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:32:48.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:48.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:48.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:49.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:49.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:49.975 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:32:49.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:32:49.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:49.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:32:50.424 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1695011997,v1:127.0.0.1:6819/1695011997] [v2:127.0.0.1:6820/1695011997,v1:127.0.0.1:6821/1695011997] exists,up 9aa11c3a-d099-430b-808c-fd0f5cb5ed2c 2024-09-16T03:32:50.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:32:50.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:32:50.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:32:50.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:32:50.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 3 2024-09-16T03:32:50.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:32:50.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:32:50.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T03:32:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:32:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/3 2024-09-16T03:32:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:32:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:32:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:32:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:32:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/3' 2024-09-16T03:32:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/3/journal' 2024-09-16T03:32:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:32:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:32:50.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:32:50.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:32:50.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:32:50.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:32:50.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:32:50.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:32:50.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:32:50.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:32:50.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/3 2024-09-16T03:32:50.431 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:32:50.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=41e1f787-4057-435f-86b0-3addf034f80b 2024-09-16T03:32:50.432 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 41e1f787-4057-435f-86b0-3addf034f80b 2024-09-16T03:32:50.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 41e1f787-4057-435f-86b0-3addf034f80b' 2024-09-16T03:32:50.432 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:32:50.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDipudmM6vAGhAAh6EZUgaHbw/mBCEw7dYZ/Q== 2024-09-16T03:32:50.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDipudmM6vAGhAAh6EZUgaHbw/mBCEw7dYZ/Q=="}' 2024-09-16T03:32:50.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 41e1f787-4057-435f-86b0-3addf034f80b -i td/osd-backfill-recovery-log/3/new.json 2024-09-16T03:32:51.007 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:32:51.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/3/new.json 2024-09-16T03:32:51.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDipudmM6vAGhAAh6EZUgaHbw/mBCEw7dYZ/Q== --osd-uuid 41e1f787-4057-435f-86b0-3addf034f80b 2024-09-16T03:32:51.054 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:51.052+0000 7f25dc930640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:32:51.055 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:51.054+0000 7f25dc930640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:32:51.057 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:51.055+0000 7f25dc930640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:32:51.057 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:51.055+0000 7f25dc930640 -1 bdev(0x56239ac3bc00 td/osd-backfill-recovery-log/3/block) open stat got: (1) Operation not permitted 2024-09-16T03:32:51.057 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:51.056+0000 7f25dc930640 -1 bluestore(td/osd-backfill-recovery-log/3) _read_fsid unparsable uuid 2024-09-16T03:32:56.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/3/keyring 2024-09-16T03:32:56.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:32:56.955 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T03:32:56.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T03:32:56.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:32:57.532 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T03:32:57.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T03:32:57.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:32:57.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:32:57.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:32:57.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:32:57.564 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:57.562+0000 7fa5032ef640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:32:57.566 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:57.564+0000 7fa5032ef640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:32:57.567 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:57.565+0000 7fa5032ef640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:32:57.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T03:32:57.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:32:57.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T03:32:57.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:32:57.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:32:57.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:57.969 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:32:57.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:32:57.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:57.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:32:58.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:32:58.643 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:32:58.642+0000 7fa5032ef640 -1 Falling back to public interface 2024-09-16T03:32:59.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:32:59.395 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:32:59.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:32:59.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:32:59.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:32:59.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:32:59.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:00.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:00.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:00.847 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:33:00.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:33:00.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:00.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:01.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:01.842 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:33:01.840+0000 7fa5032ef640 -1 osd.3 0 log_to_monitors true 2024-09-16T03:33:02.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:02.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:02.307 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:33:02.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:33:02.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:02.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:03.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:04.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:04.006 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:33:04.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:04.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:33:04.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:04.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:04.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:05.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:05.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:05.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:33:05.430 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:33:05.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:05.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:05.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:06.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:06.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:06.936 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:33:06.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:33:06.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:06.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:07.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:08.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:08.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:08.351 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:33:08.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:33:08.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:08.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:08.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:09.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:09.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:09.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:33:09.831 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:33:09.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:09.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:10.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:11.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:11.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:11.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:33:11.247 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:33:11.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:11.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:11.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:12.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:12.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:12.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:33:12.736 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:33:12.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:12.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:13.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:14.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:14.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:14.156 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:33:14.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:33:14.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:14.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:15.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:16.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:16.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:16.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:33:16.032 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:33:16.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:16.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:16.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:17.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:17.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:17.893 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:33:17.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:33:17.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:17.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:18.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:19.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:19.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:19.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:33:19.687 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:33:19.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:19.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:20.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:21.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:21.429 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:33:21.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:21.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:33:21.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:21.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:21.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:22.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:22.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:22.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:33:22.882 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:33:22.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:22.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:23.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:24.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:24.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:24.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:33:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:33:24.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:24.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:33:25.260 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1253587634,v1:127.0.0.1:6827/1253587634] [v2:127.0.0.1:6828/1253587634,v1:127.0.0.1:6829/1253587634] exists,up 41e1f787-4057-435f-86b0-3addf034f80b 2024-09-16T03:33:25.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:33:25.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:33:25.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:33:25.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:33:25.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 4 2024-09-16T03:33:25.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:33:25.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:33:25.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T03:33:25.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:33:25.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/4 2024-09-16T03:33:25.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:33:25.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:33:25.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:33:25.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:33:25.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/4' 2024-09-16T03:33:25.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/4/journal' 2024-09-16T03:33:25.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:33:25.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-09-16T03:33:25.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:33:25.265 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:33:25.265 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:33:25.265 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:33:25.265 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:33:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:33:25.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:33:25.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:33:25.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/4 2024-09-16T03:33:25.267 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:33:25.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c19bd54f-596d-46a6-9c44-d9baef99e391 2024-09-16T03:33:25.268 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 c19bd54f-596d-46a6-9c44-d9baef99e391 2024-09-16T03:33:25.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 c19bd54f-596d-46a6-9c44-d9baef99e391' 2024-09-16T03:33:25.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:33:25.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAFp+dmYO3gEBAAqCD/6hLbCyDJ+P9+Ixqwng== 2024-09-16T03:33:25.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAFp+dmYO3gEBAAqCD/6hLbCyDJ+P9+Ixqwng=="}' 2024-09-16T03:33:25.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c19bd54f-596d-46a6-9c44-d9baef99e391 -i td/osd-backfill-recovery-log/4/new.json 2024-09-16T03:33:25.782 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:33:25.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/4/new.json 2024-09-16T03:33:25.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAFp+dmYO3gEBAAqCD/6hLbCyDJ+P9+Ixqwng== --osd-uuid c19bd54f-596d-46a6-9c44-d9baef99e391 2024-09-16T03:33:25.829 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:33:25.827+0000 7fd203ea5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:33:25.831 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:33:25.829+0000 7fd203ea5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:33:25.832 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:33:25.830+0000 7fd203ea5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:33:25.832 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:33:25.831+0000 7fd203ea5640 -1 bdev(0x55767f431c00 td/osd-backfill-recovery-log/4/block) open stat got: (1) Operation not permitted 2024-09-16T03:33:25.832 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:33:25.831+0000 7fd203ea5640 -1 bluestore(td/osd-backfill-recovery-log/4) _read_fsid unparsable uuid 2024-09-16T03:33:31.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/4/keyring 2024-09-16T03:33:31.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:33:31.709 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T03:33:31.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T03:33:31.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:33:32.278 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T03:33:32.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T03:33:32.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:33:32.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:33:32.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:33:32.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:33:32.311 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:33:32.309+0000 7f2f1dc1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:33:32.313 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:33:32.312+0000 7f2f1dc1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:33:32.315 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:33:32.313+0000 7f2f1dc1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:33:32.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T03:33:32.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:33:32.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T03:33:32.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:33:32.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:33:32.730 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:33:32.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:32.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:33:32.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:32.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:33.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:33.660 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:33:33.659+0000 7f2f1dc1e640 -1 Falling back to public interface 2024-09-16T03:33:34.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:34.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:34.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:33:34.166 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:33:34.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:34.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:34.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:35.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:35.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:35.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:33:35.633 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:33:35.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:35.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:36.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:36.504 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:33:36.502+0000 7f2f1dc1e640 -1 osd.4 0 log_to_monitors true 2024-09-16T03:33:37.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:37.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:37.055 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:33:37.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:33:37.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:37.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:37.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:38.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:38.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:38.568 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:33:38.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:33:38.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:38.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:39.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:40.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:40.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:33:40.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:33:40.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:40.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:40.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:41.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:41.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:41.433 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:33:41.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:33:41.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:41.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:42.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:43.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:43.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:43.006 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:33:43.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:33:43.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:43.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:43.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:44.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:44.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:44.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:33:44.446 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:33:44.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:44.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:44.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:45.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:45.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:45.913 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:33:45.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:33:45.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:45.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:46.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:47.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:47.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:47.436 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:33:47.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:33:47.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:47.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:47.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:48.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:48.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:48.991 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:33:48.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:33:48.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:48.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:49.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:50.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:50.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:50.888 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:33:50.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:33:50.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:50.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:51.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:52.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:52.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:52.839 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:33:52.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:33:52.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:52.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:53.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:54.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:54.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:54.608 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:33:54.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:33:54.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:54.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:55.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:56.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:56.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:56.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:33:56.061 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:33:56.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:56.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:56.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:57.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:57.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:57.741 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:33:57.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:33:57.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:57.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:58.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:33:59.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:33:59.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:33:59.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:33:59.541 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:33:59.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:33:59.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:33:59.967 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1221102340,v1:127.0.0.1:6835/1221102340] [v2:127.0.0.1:6836/1221102340,v1:127.0.0.1:6837/1221102340] exists,up c19bd54f-596d-46a6-9c44-d9baef99e391 2024-09-16T03:33:59.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:33:59.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:33:59.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:33:59.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:33:59.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 5 2024-09-16T03:33:59.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:33:59.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:33:59.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T03:33:59.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:33:59.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/5 2024-09-16T03:33:59.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:33:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:33:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:33:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:33:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/5' 2024-09-16T03:33:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/5/journal' 2024-09-16T03:33:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:33:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10' 2024-09-16T03:33:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:33:59.972 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:33:59.972 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:33:59.972 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:33:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:33:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:33:59.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:33:59.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/5 2024-09-16T03:33:59.974 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:33:59.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d9b6cb4c-5e7e-4f3f-8665-41a92fa5ac66 2024-09-16T03:33:59.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 d9b6cb4c-5e7e-4f3f-8665-41a92fa5ac66' 2024-09-16T03:33:59.975 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 d9b6cb4c-5e7e-4f3f-8665-41a92fa5ac66 2024-09-16T03:33:59.975 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:33:59.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAnp+dm+eoDOxAA+1qNuvaiHCPbB4gJmC7GVQ== 2024-09-16T03:33:59.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAnp+dm+eoDOxAA+1qNuvaiHCPbB4gJmC7GVQ=="}' 2024-09-16T03:33:59.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d9b6cb4c-5e7e-4f3f-8665-41a92fa5ac66 -i td/osd-backfill-recovery-log/5/new.json 2024-09-16T03:34:00.499 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:34:00.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/5/new.json 2024-09-16T03:34:00.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAnp+dm+eoDOxAA+1qNuvaiHCPbB4gJmC7GVQ== --osd-uuid d9b6cb4c-5e7e-4f3f-8665-41a92fa5ac66 2024-09-16T03:34:00.546 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:34:00.544+0000 7f545da9c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:34:00.547 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:34:00.546+0000 7f545da9c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:34:00.548 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:34:00.547+0000 7f545da9c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:34:00.549 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:34:00.547+0000 7f545da9c640 -1 bdev(0x55a4ded05c00 td/osd-backfill-recovery-log/5/block) open stat got: (1) Operation not permitted 2024-09-16T03:34:00.549 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:34:00.547+0000 7f545da9c640 -1 bluestore(td/osd-backfill-recovery-log/5) _read_fsid unparsable uuid 2024-09-16T03:34:06.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/5/keyring 2024-09-16T03:34:06.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:34:06.542 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T03:34:06.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T03:34:06.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:34:07.115 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T03:34:07.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T03:34:07.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:34:07.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:34:07.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:34:07.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:34:07.147 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:34:07.145+0000 7f2dee211640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:34:07.183 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:34:07.181+0000 7f2dee211640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:34:07.185 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:34:07.183+0000 7f2dee211640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:34:07.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T03:34:07.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:34:07.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T03:34:07.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:34:07.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:34:07.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:07.533 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:34:07.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:34:07.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:07.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:07.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:08.533 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:34:08.531+0000 7f2dee211640 -1 Falling back to public interface 2024-09-16T03:34:08.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:08.981 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:34:08.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:08.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:34:08.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:08.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:09.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:10.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:10.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:10.433 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:34:10.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:34:10.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:10.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:10.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:11.152 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:34:11.151+0000 7f2dee211640 -1 osd.5 0 log_to_monitors true 2024-09-16T03:34:11.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:11.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:11.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:34:11.855 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:34:11.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:11.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:12.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:13.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:13.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:13.308 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:34:13.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:34:13.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:13.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:13.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:14.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:14.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:14.788 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:34:14.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:34:14.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:14.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:15.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:16.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:16.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:16.261 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:34:16.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:34:16.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:16.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:16.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:17.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:17.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:17.755 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:34:17.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:34:17.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:17.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:18.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:19.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:19.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:19.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:34:19.248 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:34:19.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:19.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:19.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:20.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:20.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:20.806 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:34:20.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:34:20.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:20.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:21.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:22.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:22.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:22.292 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:34:22.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:34:22.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:22.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:22.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:23.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:23.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:23.752 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:34:23.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:34:23.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:23.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:24.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:25.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:25.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:25.534 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:34:25.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:34:25.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:25.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:26.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:27.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:27.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:27.215 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:34:27.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:34:27.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:27.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:28.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:29.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:29.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:29.034 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:34:29.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:34:29.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:29.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:29.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:30.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:30.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:30.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:34:30.950 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:34:30.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:30.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:31.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:32.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:32.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:32.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:34:32.570 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:34:32.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:32.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:33.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:34:34.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:34:34.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:34:34.073 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:34:34.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:34:34.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:34:34.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:34:34.508 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 29 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3381889927,v1:127.0.0.1:6843/3381889927] [v2:127.0.0.1:6844/3381889927,v1:127.0.0.1:6845/3381889927] exists,up d9b6cb4c-5e7e-4f3f-8665-41a92fa5ac66 2024-09-16T03:34:34.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:34:34.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:34:34.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:34:34.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:60: _common_test: create_pool test 1 1 2024-09-16T03:34:34.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2024-09-16T03:34:35.141 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T03:34:35.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:34:36.154 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: seq 1 150 2024-09-16T03:34:36.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:36.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-1 /etc/passwd 2024-09-16T03:34:36.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:36.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-2 /etc/passwd 2024-09-16T03:34:36.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:36.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-3 /etc/passwd 2024-09-16T03:34:36.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:36.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-4 /etc/passwd 2024-09-16T03:34:37.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:37.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-5 /etc/passwd 2024-09-16T03:34:37.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:37.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-6 /etc/passwd 2024-09-16T03:34:37.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:37.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-7 /etc/passwd 2024-09-16T03:34:37.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:37.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-8 /etc/passwd 2024-09-16T03:34:37.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:37.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-9 /etc/passwd 2024-09-16T03:34:37.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:37.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-10 /etc/passwd 2024-09-16T03:34:38.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:38.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-11 /etc/passwd 2024-09-16T03:34:38.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:38.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-12 /etc/passwd 2024-09-16T03:34:38.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:38.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-13 /etc/passwd 2024-09-16T03:34:38.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:38.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-14 /etc/passwd 2024-09-16T03:34:38.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:38.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-15 /etc/passwd 2024-09-16T03:34:38.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:38.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-16 /etc/passwd 2024-09-16T03:34:38.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:38.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-17 /etc/passwd 2024-09-16T03:34:39.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:39.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-18 /etc/passwd 2024-09-16T03:34:39.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:39.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-19 /etc/passwd 2024-09-16T03:34:39.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:39.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-20 /etc/passwd 2024-09-16T03:34:39.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:39.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-21 /etc/passwd 2024-09-16T03:34:39.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:39.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-22 /etc/passwd 2024-09-16T03:34:39.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:39.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-23 /etc/passwd 2024-09-16T03:34:39.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:39.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-24 /etc/passwd 2024-09-16T03:34:40.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:40.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-25 /etc/passwd 2024-09-16T03:34:40.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:40.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-26 /etc/passwd 2024-09-16T03:34:40.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:40.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-27 /etc/passwd 2024-09-16T03:34:40.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:40.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-28 /etc/passwd 2024-09-16T03:34:40.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:40.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-29 /etc/passwd 2024-09-16T03:34:40.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:40.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-30 /etc/passwd 2024-09-16T03:34:40.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:40.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-31 /etc/passwd 2024-09-16T03:34:41.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:41.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-32 /etc/passwd 2024-09-16T03:34:41.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:41.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-33 /etc/passwd 2024-09-16T03:34:41.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:41.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-34 /etc/passwd 2024-09-16T03:34:41.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:41.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-35 /etc/passwd 2024-09-16T03:34:41.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:41.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-36 /etc/passwd 2024-09-16T03:34:41.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:41.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-37 /etc/passwd 2024-09-16T03:34:41.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:41.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-38 /etc/passwd 2024-09-16T03:34:42.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:42.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-39 /etc/passwd 2024-09-16T03:34:42.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:42.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-40 /etc/passwd 2024-09-16T03:34:42.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:42.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-41 /etc/passwd 2024-09-16T03:34:42.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:42.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-42 /etc/passwd 2024-09-16T03:34:42.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:42.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-43 /etc/passwd 2024-09-16T03:34:42.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:42.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-44 /etc/passwd 2024-09-16T03:34:42.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:42.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-45 /etc/passwd 2024-09-16T03:34:42.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:42.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-46 /etc/passwd 2024-09-16T03:34:43.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:43.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-47 /etc/passwd 2024-09-16T03:34:43.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:43.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-48 /etc/passwd 2024-09-16T03:34:43.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:43.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-49 /etc/passwd 2024-09-16T03:34:43.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:43.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-50 /etc/passwd 2024-09-16T03:34:43.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:43.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-51 /etc/passwd 2024-09-16T03:34:43.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:43.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-52 /etc/passwd 2024-09-16T03:34:43.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:43.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-53 /etc/passwd 2024-09-16T03:34:44.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:44.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-54 /etc/passwd 2024-09-16T03:34:44.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:44.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-55 /etc/passwd 2024-09-16T03:34:44.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:44.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-56 /etc/passwd 2024-09-16T03:34:44.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:44.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-57 /etc/passwd 2024-09-16T03:34:44.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:44.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-58 /etc/passwd 2024-09-16T03:34:44.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:44.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-59 /etc/passwd 2024-09-16T03:34:44.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:44.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-60 /etc/passwd 2024-09-16T03:34:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-61 /etc/passwd 2024-09-16T03:34:45.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:45.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-62 /etc/passwd 2024-09-16T03:34:45.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:45.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-63 /etc/passwd 2024-09-16T03:34:45.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:45.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-64 /etc/passwd 2024-09-16T03:34:45.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:45.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-65 /etc/passwd 2024-09-16T03:34:45.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:45.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-66 /etc/passwd 2024-09-16T03:34:45.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:45.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-67 /etc/passwd 2024-09-16T03:34:46.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:46.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-68 /etc/passwd 2024-09-16T03:34:46.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:46.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-69 /etc/passwd 2024-09-16T03:34:46.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:46.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-70 /etc/passwd 2024-09-16T03:34:46.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:46.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-71 /etc/passwd 2024-09-16T03:34:46.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:46.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-72 /etc/passwd 2024-09-16T03:34:46.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:46.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-73 /etc/passwd 2024-09-16T03:34:46.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:46.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-74 /etc/passwd 2024-09-16T03:34:46.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:46.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-75 /etc/passwd 2024-09-16T03:34:47.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:47.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-76 /etc/passwd 2024-09-16T03:34:47.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:47.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-77 /etc/passwd 2024-09-16T03:34:47.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:47.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-78 /etc/passwd 2024-09-16T03:34:47.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:47.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-79 /etc/passwd 2024-09-16T03:34:47.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:47.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-80 /etc/passwd 2024-09-16T03:34:47.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:47.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-81 /etc/passwd 2024-09-16T03:34:48.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:48.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-82 /etc/passwd 2024-09-16T03:34:48.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:48.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-83 /etc/passwd 2024-09-16T03:34:48.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:48.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-84 /etc/passwd 2024-09-16T03:34:48.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:48.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-85 /etc/passwd 2024-09-16T03:34:48.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:48.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-86 /etc/passwd 2024-09-16T03:34:48.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:48.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-87 /etc/passwd 2024-09-16T03:34:49.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:49.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-88 /etc/passwd 2024-09-16T03:34:49.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:49.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-89 /etc/passwd 2024-09-16T03:34:49.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:49.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-90 /etc/passwd 2024-09-16T03:34:49.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:49.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-91 /etc/passwd 2024-09-16T03:34:49.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:49.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-92 /etc/passwd 2024-09-16T03:34:49.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:49.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-93 /etc/passwd 2024-09-16T03:34:49.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:49.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-94 /etc/passwd 2024-09-16T03:34:49.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:49.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-95 /etc/passwd 2024-09-16T03:34:50.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:50.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-96 /etc/passwd 2024-09-16T03:34:50.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:50.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-97 /etc/passwd 2024-09-16T03:34:50.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:50.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-98 /etc/passwd 2024-09-16T03:34:50.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:50.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-99 /etc/passwd 2024-09-16T03:34:50.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:50.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-100 /etc/passwd 2024-09-16T03:34:50.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:50.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-101 /etc/passwd 2024-09-16T03:34:50.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:50.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-102 /etc/passwd 2024-09-16T03:34:51.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:51.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-103 /etc/passwd 2024-09-16T03:34:51.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:51.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-104 /etc/passwd 2024-09-16T03:34:51.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:51.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-105 /etc/passwd 2024-09-16T03:34:51.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:51.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-106 /etc/passwd 2024-09-16T03:34:51.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:51.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-107 /etc/passwd 2024-09-16T03:34:51.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:51.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-108 /etc/passwd 2024-09-16T03:34:51.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:51.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-109 /etc/passwd 2024-09-16T03:34:52.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:52.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-110 /etc/passwd 2024-09-16T03:34:52.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:52.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-111 /etc/passwd 2024-09-16T03:34:52.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:52.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-112 /etc/passwd 2024-09-16T03:34:52.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:52.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-113 /etc/passwd 2024-09-16T03:34:52.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:52.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-114 /etc/passwd 2024-09-16T03:34:52.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:52.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-115 /etc/passwd 2024-09-16T03:34:52.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:52.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-116 /etc/passwd 2024-09-16T03:34:53.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:53.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-117 /etc/passwd 2024-09-16T03:34:53.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:53.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-118 /etc/passwd 2024-09-16T03:34:53.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:53.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-119 /etc/passwd 2024-09-16T03:34:53.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:53.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-120 /etc/passwd 2024-09-16T03:34:53.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:53.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-121 /etc/passwd 2024-09-16T03:34:53.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:53.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-122 /etc/passwd 2024-09-16T03:34:53.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:53.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-123 /etc/passwd 2024-09-16T03:34:54.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:54.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-124 /etc/passwd 2024-09-16T03:34:54.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:54.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-125 /etc/passwd 2024-09-16T03:34:54.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:54.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-126 /etc/passwd 2024-09-16T03:34:54.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:54.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-127 /etc/passwd 2024-09-16T03:34:54.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:54.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-128 /etc/passwd 2024-09-16T03:34:54.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:54.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-129 /etc/passwd 2024-09-16T03:34:54.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:54.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-130 /etc/passwd 2024-09-16T03:34:55.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:55.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-131 /etc/passwd 2024-09-16T03:34:55.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:55.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-132 /etc/passwd 2024-09-16T03:34:55.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:55.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-133 /etc/passwd 2024-09-16T03:34:55.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:55.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-134 /etc/passwd 2024-09-16T03:34:55.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:55.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-135 /etc/passwd 2024-09-16T03:34:55.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:55.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-136 /etc/passwd 2024-09-16T03:34:55.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:55.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-137 /etc/passwd 2024-09-16T03:34:56.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:56.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-138 /etc/passwd 2024-09-16T03:34:56.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:56.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-139 /etc/passwd 2024-09-16T03:34:56.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:56.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-140 /etc/passwd 2024-09-16T03:34:56.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:56.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-141 /etc/passwd 2024-09-16T03:34:56.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:56.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-142 /etc/passwd 2024-09-16T03:34:56.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:56.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-143 /etc/passwd 2024-09-16T03:34:56.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:56.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-144 /etc/passwd 2024-09-16T03:34:56.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:56.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-145 /etc/passwd 2024-09-16T03:34:57.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:57.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-146 /etc/passwd 2024-09-16T03:34:57.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:57.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-147 /etc/passwd 2024-09-16T03:34:57.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:57.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-148 /etc/passwd 2024-09-16T03:34:57.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:57.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-149 /etc/passwd 2024-09-16T03:34:57.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:34:57.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-150 /etc/passwd 2024-09-16T03:34:57.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph pg dump pgs --format=json 2024-09-16T03:34:57.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: jq '.pg_stats[0].up[]' 2024-09-16T03:34:58.178 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:34:58.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph osd out 1 0 2 2024-09-16T03:34:58.834 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. osd.0 is already out. osd.2 is already out. 2024-09-16T03:34:58.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:69: _common_test: '[' 0 '!=' 0 ']' 2024-09-16T03:34:58.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:75: _common_test: sleep 1 2024-09-16T03:34:59.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:76: _common_test: wait_for_clean 2024-09-16T03:34:59.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:34:59.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:34:59.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:34:59.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:34:59.848 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:34:59.848 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:34:59.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:34:59.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:34:59.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:34:59.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:34:59.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:34:59.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:34:59.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:34:59.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:34:59.950 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:35:00.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:35:00.359 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:35:00.359 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:35:00.359 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:35:00.359 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T03:35:00.359 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T03:35:00.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:35:00.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:35:00.360 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:35:00.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836524 2024-09-16T03:35:00.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836524 2024-09-16T03:35:00.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836524' 2024-09-16T03:35:00.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:35:00.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:35:00.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673001 2024-09-16T03:35:00.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673001 2024-09-16T03:35:00.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836524 1-42949673001' 2024-09-16T03:35:00.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:35:00.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:35:00.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509472 2024-09-16T03:35:00.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509472 2024-09-16T03:35:00.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836524 1-42949673001 2-64424509472' 2024-09-16T03:35:00.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:35:00.819 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:35:00.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=81604378651 2024-09-16T03:35:00.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 81604378651 2024-09-16T03:35:00.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836524 1-42949673001 2-64424509472 3-81604378651' 2024-09-16T03:35:00.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:35:00.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:35:01.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=103079215124 2024-09-16T03:35:01.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 103079215124 2024-09-16T03:35:01.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836524 1-42949673001 2-64424509472 3-81604378651 4-103079215124' 2024-09-16T03:35:01.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:35:01.115 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T03:35:01.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=124554051598 2024-09-16T03:35:01.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 124554051598 2024-09-16T03:35:01.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836524 1-42949673001 2-64424509472 3-81604378651 4-103079215124 5-124554051598' 2024-09-16T03:35:01.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:35:01.234 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836524 2024-09-16T03:35:01.234 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:35:01.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:35:01.235 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836524 2024-09-16T03:35:01.235 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:35:01.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836524 2024-09-16T03:35:01.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836524' 2024-09-16T03:35:01.237 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836524 2024-09-16T03:35:01.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:35:01.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836523 -lt 21474836524 2024-09-16T03:35:01.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:35:02.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:35:02.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:35:03.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836524 -lt 21474836524 2024-09-16T03:35:03.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:35:03.265 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673001 2024-09-16T03:35:03.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:35:03.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:35:03.267 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673001 2024-09-16T03:35:03.267 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:35:03.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673001 2024-09-16T03:35:03.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673001' 2024-09-16T03:35:03.269 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673001 2024-09-16T03:35:03.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:35:03.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673001 -lt 42949673001 2024-09-16T03:35:03.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:35:03.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509472 2024-09-16T03:35:03.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:35:03.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:35:03.782 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509472 2024-09-16T03:35:03.782 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:35:03.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509472 2024-09-16T03:35:03.783 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509472 2024-09-16T03:35:03.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509472' 2024-09-16T03:35:03.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:35:04.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509472 -lt 64424509472 2024-09-16T03:35:04.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:35:04.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-81604378651 2024-09-16T03:35:04.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:35:04.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:35:04.378 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-81604378651 2024-09-16T03:35:04.378 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:35:04.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=81604378651 2024-09-16T03:35:04.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 81604378651' 2024-09-16T03:35:04.380 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 81604378651 2024-09-16T03:35:04.380 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:35:04.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 81604378651 -lt 81604378651 2024-09-16T03:35:04.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:35:04.932 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-103079215124 2024-09-16T03:35:04.932 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:35:04.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:35:04.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-103079215124 2024-09-16T03:35:04.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:35:04.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=103079215124 2024-09-16T03:35:04.935 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 103079215124 2024-09-16T03:35:04.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 103079215124' 2024-09-16T03:35:04.936 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:35:05.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 103079215124 -lt 103079215124 2024-09-16T03:35:05.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:35:05.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-124554051598 2024-09-16T03:35:05.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:35:05.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T03:35:05.518 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-124554051598 2024-09-16T03:35:05.518 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:35:05.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=124554051598 2024-09-16T03:35:05.519 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 124554051598 2024-09-16T03:35:05.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 124554051598' 2024-09-16T03:35:05.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T03:35:06.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 124554051598 -lt 124554051598 2024-09-16T03:35:06.063 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:35:06.063 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:06.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:06.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T03:35:06.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:06.806 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:06.806 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:06.806 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:06.806 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:06.806 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:06.806 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:07.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:07.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:07.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:07.204 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:07.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:07.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T03:35:07.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T03:35:07.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T03:35:07.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:07.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:07.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:07.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:07.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:07.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:07.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:07.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:07.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:07.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:08.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:08.461 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:08.461 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:08.461 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:09.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:09.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:35:09.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:35:09.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:35:09.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:35:09.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:35:09.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:35:09.159 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:35:09.159 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=60418 2024-09-16T03:35:09.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 60418 '!=' null 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:09.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:09.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:09.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:09.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:09.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:09.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:09.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:09.830 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:09.830 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:10.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:10.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:10.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:10.234 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:10.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:10.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:35:10.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:35:10.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:35:10.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:35:10.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:35:10.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:35:10.977 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:35:10.977 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:35:11.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=52144 2024-09-16T03:35:11.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 52144 '!=' null 2024-09-16T03:35:11.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:35:11.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:11.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:11.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:11.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:11.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:11.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:11.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:11.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:11.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:11.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:12.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:12.260 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:12.261 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:12.261 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:12.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:12.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:35:12.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:35:12.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:35:12.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:35:12.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:35:12.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:35:12.963 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:35:12.963 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:35:13.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=46131 2024-09-16T03:35:13.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 46131 '!=' null 2024-09-16T03:35:13.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:35:13.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:13.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:13.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:13.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:13.702 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:13.702 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:13.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:13.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:13.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:13.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:14.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:14.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:14.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:14.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:14.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:14.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:35:14.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:35:14.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:35:14.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:35:14.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:35:14.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:35:14.799 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:35:14.799 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:35:15.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=77243 2024-09-16T03:35:15.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 77243 '!=' null 2024-09-16T03:35:15.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:35:15.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:15.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:15.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:15.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:15.678 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:15.679 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:15.679 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:15.679 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:15.679 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:15.679 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:16.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:16.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:16.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:16.107 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:16.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:16.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:35:16.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:35:16.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:35:16.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:35:16.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:35:16.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:35:16.717 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:35:16.717 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:35:17.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=61151 2024-09-16T03:35:17.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 61151 '!=' null 2024-09-16T03:35:17.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:35:17.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:17.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:17.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:17.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:17.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:17.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:17.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:17.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:17.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:17.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:17.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:17.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:17.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:17.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:18.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:18.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:35:18.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:35:18.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:35:18.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:35:18.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:35:18.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:35:18.699 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:35:18.699 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:35:19.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=93337 2024-09-16T03:35:19.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 93337 '!=' null 2024-09-16T03:35:19.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:35:19.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:19.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:19.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:19.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:19.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:19.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:19.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:19.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:19.478 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:19.478 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:20.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:20.007 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:20.007 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:20.007 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:20.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:20.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:35:20.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:35:20.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:35:20.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:35:20.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:35:20.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:35:20.558 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:35:20.559 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:35:21.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=63297 2024-09-16T03:35:21.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 63297 '!=' null 2024-09-16T03:35:21.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:35:21.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:21.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:21.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:21.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:21.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:21.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:21.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:21.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:21.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:21.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:21.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:21.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:21.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:21.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:22.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:22.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:35:22.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:35:22.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:35:22.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:35:22.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:35:22.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:35:22.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:35:22.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:35:22.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=63297 2024-09-16T03:35:22.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 63297 '!=' null 2024-09-16T03:35:22.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:35:22.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:22.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:23.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:23.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:23.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:23.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:23.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:23.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:23.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:23.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:23.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:23.411 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:23.411 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:23.412 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:24.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:24.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:35:24.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:35:24.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:35:24.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:35:24.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:35:24.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:35:24.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:35:24.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:35:24.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=91192 2024-09-16T03:35:24.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 91192 '!=' null 2024-09-16T03:35:24.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:35:24.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:24.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:24.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:24.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:24.993 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:24.993 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:24.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:24.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:24.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:24.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:25.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:25.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:25.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:25.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:26.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:26.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:35:26.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:35:26.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:35:26.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:35:26.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:35:26.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:35:26.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:35:26.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:35:26.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=91192 2024-09-16T03:35:26.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 91192 '!=' null 2024-09-16T03:35:26.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:35:26.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:26.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:26.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:26.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:26.683 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:26.683 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:26.683 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:26.683 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:26.683 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:26.683 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:27.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:27.150 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:27.150 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:27.150 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:27.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:27.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:35:27.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:35:27.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:35:27.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:35:27.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:35:27.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:35:27.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:35:27.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:35:28.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=60078 2024-09-16T03:35:28.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 60078 '!=' null 2024-09-16T03:35:28.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:35:28.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:28.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:28.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:28.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:28.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:28.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:28.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:28.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:28.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:28.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:28.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:35:28.912 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:28.912 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:28.912 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:29.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:35:29.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:35:29.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:35:29.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:35:29.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:35:29.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:35:29.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:35:29.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:35:29.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:35:30.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=41840 2024-09-16T03:35:30.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 41840 '!=' null 2024-09-16T03:35:30.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:35:30.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:35:30.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:35:30.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:35:30.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:35:30.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:35:30.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:35:30.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:35:30.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:35:30.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:35:30.159 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:35:30.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:35:30.560 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:35:30.560 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:35:30.560 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:35:31.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T03:35:31.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:35:31.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:35:31.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:78: _common_test: flush_pg_stats 2024-09-16T03:35:31.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:35:31.120 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:35:31.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:35:31.549 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:35:31.549 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:35:31.549 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:35:31.549 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T03:35:31.549 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T03:35:31.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:35:31.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:35:31.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:35:31.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836532 2024-09-16T03:35:31.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836532 2024-09-16T03:35:31.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532' 2024-09-16T03:35:31.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:35:31.678 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:35:31.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673009 2024-09-16T03:35:31.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673009 2024-09-16T03:35:31.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673009' 2024-09-16T03:35:31.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:35:31.797 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:35:31.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509480 2024-09-16T03:35:31.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509480 2024-09-16T03:35:31.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673009 2-64424509480' 2024-09-16T03:35:31.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:35:31.915 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:35:32.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=81604378659 2024-09-16T03:35:32.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 81604378659 2024-09-16T03:35:32.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673009 2-64424509480 3-81604378659' 2024-09-16T03:35:32.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:35:32.033 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:35:32.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=103079215132 2024-09-16T03:35:32.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 103079215132 2024-09-16T03:35:32.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673009 2-64424509480 3-81604378659 4-103079215132' 2024-09-16T03:35:32.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:35:32.152 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T03:35:32.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=124554051606 2024-09-16T03:35:32.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 124554051606 2024-09-16T03:35:32.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673009 2-64424509480 3-81604378659 4-103079215132 5-124554051606' 2024-09-16T03:35:32.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:35:32.271 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836532 2024-09-16T03:35:32.271 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:35:32.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:35:32.272 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836532 2024-09-16T03:35:32.272 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:35:32.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836532 2024-09-16T03:35:32.274 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836532 2024-09-16T03:35:32.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836532' 2024-09-16T03:35:32.274 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:35:32.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836532 -lt 21474836532 2024-09-16T03:35:32.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:35:32.712 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673009 2024-09-16T03:35:32.712 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:35:32.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:35:32.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673009 2024-09-16T03:35:32.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:35:32.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673009 2024-09-16T03:35:32.715 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673009 2024-09-16T03:35:32.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673009' 2024-09-16T03:35:32.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:35:33.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673009 -lt 42949673009 2024-09-16T03:35:33.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:35:33.164 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509480 2024-09-16T03:35:33.164 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:35:33.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:35:33.165 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509480 2024-09-16T03:35:33.165 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:35:33.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509480 2024-09-16T03:35:33.166 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509480 2024-09-16T03:35:33.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509480' 2024-09-16T03:35:33.167 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:35:33.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509480 -lt 64424509480 2024-09-16T03:35:33.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:35:33.615 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-81604378659 2024-09-16T03:35:33.615 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:35:33.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:35:33.617 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-81604378659 2024-09-16T03:35:33.617 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:35:33.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=81604378659 2024-09-16T03:35:33.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 81604378659' 2024-09-16T03:35:33.618 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 81604378659 2024-09-16T03:35:33.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:35:34.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 81604378659 -lt 81604378659 2024-09-16T03:35:34.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:35:34.100 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-103079215132 2024-09-16T03:35:34.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:35:34.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:35:34.102 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-103079215132 2024-09-16T03:35:34.102 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:35:34.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=103079215132 2024-09-16T03:35:34.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 103079215132' 2024-09-16T03:35:34.104 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 103079215132 2024-09-16T03:35:34.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:35:34.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 103079215132 -lt 103079215132 2024-09-16T03:35:34.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:35:34.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-124554051606 2024-09-16T03:35:34.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:35:34.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T03:35:34.578 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-124554051606 2024-09-16T03:35:34.578 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:35:34.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=124554051606 2024-09-16T03:35:34.579 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 124554051606 2024-09-16T03:35:34.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 124554051606' 2024-09-16T03:35:34.580 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T03:35:35.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 124554051606 -lt 124554051606 2024-09-16T03:35:35.078 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: ceph pg dump pgs --format=json 2024-09-16T03:35:35.078 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: jq '.pg_stats[0].up_primary' 2024-09-16T03:35:35.466 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:35:35.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: newprimary=4 2024-09-16T03:35:35.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:81: _common_test: kill_daemons 2024-09-16T03:35:35.474 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:35:35.474 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:35:35.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:35:35.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:35:35.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:35:40.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:35:40.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:83: _common_test: ERRORS=0 2024-09-16T03:35:40.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: _objectstore_tool_nodown td/osd-backfill-recovery-log 4 --no-mon-config --pgid 1.0 --op log 2024-09-16T03:35:40.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:35:40.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2024-09-16T03:35:40.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=4 2024-09-16T03:35:40.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: tee td/osd-backfill-recovery-log/result.log 2024-09-16T03:35:40.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2024-09-16T03:35:40.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-backfill-recovery-log/4 2024-09-16T03:35:40.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-recovery-log/4 --no-mon-config --pgid 1.0 --op log 2024-09-16T03:35:42.401 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:35:42.401 INFO:tasks.workunit.client.0.smithi026.stdout: "pg_log_t": { 2024-09-16T03:35:42.401 INFO:tasks.workunit.client.0.smithi026.stdout: "head": "33'150", 2024-09-16T03:35:42.401 INFO:tasks.workunit.client.0.smithi026.stdout: "tail": "33'148", 2024-09-16T03:35:42.403 INFO:tasks.workunit.client.0.smithi026.stdout: "log": [ 2024-09-16T03:35:42.403 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:35:42.403 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:35:42.403 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:e9c179f9:::obj-149:head", 2024-09-16T03:35:42.403 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'149", 2024-09-16T03:35:42.403 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:35:42.403 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4821.0:1", 2024-09-16T03:35:42.403 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:35:42.403 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:34:57.561155+0000", 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:35:42.404 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:35:42.405 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:35:42.405 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:35:42.405 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:35:42.405 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:35:42.405 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:35:42.405 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:cb39fd60:::obj-150:head", 2024-09-16T03:35:42.405 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'150", 2024-09-16T03:35:42.405 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:35:42.405 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4824.0:1", 2024-09-16T03:35:42.405 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:35:42.405 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:34:57.686846+0000", 2024-09-16T03:35:42.405 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:35:42.406 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: "dups": [ 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4797.0:1", 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'141", 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "141", 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4800.0:1", 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'142", 2024-09-16T03:35:42.407 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "142", 2024-09-16T03:35:42.408 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:35:42.408 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:35:42.408 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:35:42.408 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4803.0:1", 2024-09-16T03:35:42.408 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'143", 2024-09-16T03:35:42.408 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "143", 2024-09-16T03:35:42.409 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:35:42.409 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:35:42.409 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:35:42.409 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4806.0:1", 2024-09-16T03:35:42.409 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'144", 2024-09-16T03:35:42.409 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "144", 2024-09-16T03:35:42.409 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:35:42.410 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:35:42.410 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:35:42.410 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4809.0:1", 2024-09-16T03:35:42.410 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'145", 2024-09-16T03:35:42.410 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "145", 2024-09-16T03:35:42.410 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:35:42.410 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:35:42.410 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:35:42.411 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4812.0:1", 2024-09-16T03:35:42.411 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'146", 2024-09-16T03:35:42.411 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "146", 2024-09-16T03:35:42.411 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:35:42.411 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:35:42.411 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:35:42.411 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4815.0:1", 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'147", 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "147", 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4818.0:1", 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'148", 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "148", 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: "pg_missing_t": { 2024-09-16T03:35:42.412 INFO:tasks.workunit.client.0.smithi026.stdout: "missing": [], 2024-09-16T03:35:42.413 INFO:tasks.workunit.client.0.smithi026.stdout: "may_include_deletes": true 2024-09-16T03:35:42.413 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:35:42.413 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:35:42.414 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: jq '.pg_log_t.log | length' td/osd-backfill-recovery-log/result.log 2024-09-16T03:35:42.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: LOGLEN=2 2024-09-16T03:35:42.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:86: _common_test: '[' 2 '!=' 2 ']' 2024-09-16T03:35:42.414 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: jq '.pg_log_t.dups | length' td/osd-backfill-recovery-log/result.log 2024-09-16T03:35:42.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: DUPSLEN=8 2024-09-16T03:35:42.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:91: _common_test: '[' 8 '!=' 8 ']' 2024-09-16T03:35:42.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:95: _common_test: grep 'copy_up_to\|copy_after' td/osd-backfill-recovery-log/osd.0.log td/osd-backfill-recovery-log/osd.1.log td/osd-backfill-recovery-log/osd.2.log td/osd-backfill-recovery-log/osd.3.log td/osd-backfill-recovery-log/osd.4.log td/osd-backfill-recovery-log/osd.5.log 2024-09-16T03:35:42.415 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to max 2 dups.size()=0 other.dups.size()=7 2024-09-16T03:35:42.415 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to copy log version 33'150 2024-09-16T03:35:42.415 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to copy log version 33'149 2024-09-16T03:35:42.415 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'141 2024-09-16T03:35:42.415 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'142 2024-09-16T03:35:42.415 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'143 2024-09-16T03:35:42.415 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'144 2024-09-16T03:35:42.415 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'145 2024-09-16T03:35:42.415 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'146 2024-09-16T03:35:42.415 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'147 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'148 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to END max 2 dups.size()=8 other.dups.size()=7 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to max 2 dups.size()=0 other.dups.size()=7 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to copy log version 33'150 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to copy log version 33'149 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'141 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'142 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'143 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'144 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'145 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'146 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'147 2024-09-16T03:35:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'148 2024-09-16T03:35:42.417 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to END max 2 dups.size()=8 other.dups.size()=7 2024-09-16T03:35:42.417 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to max 2 dups.size()=0 other.dups.size()=7 2024-09-16T03:35:42.417 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to copy log version 33'150 2024-09-16T03:35:42.417 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to copy log version 33'149 2024-09-16T03:35:42.417 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'141 2024-09-16T03:35:42.417 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'142 2024-09-16T03:35:42.417 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'143 2024-09-16T03:35:42.441 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'144 2024-09-16T03:35:42.441 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'145 2024-09-16T03:35:42.442 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'146 2024-09-16T03:35:42.442 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'147 2024-09-16T03:35:42.442 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'148 2024-09-16T03:35:42.442 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:34:59.755+0000 7efedf3a5640 20 copy_up_to END max 2 dups.size()=8 other.dups.size()=7 2024-09-16T03:35:42.442 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:35:27.406+0000 7efedf3a5640 20 copy_after v 33'150 dups.size()=0 other.dups.size()=7 2024-09-16T03:35:42.442 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:35:27.406+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'141 2024-09-16T03:35:42.442 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:35:27.406+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'142 2024-09-16T03:35:42.442 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:35:27.407+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'143 2024-09-16T03:35:42.443 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:35:27.407+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'144 2024-09-16T03:35:42.443 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:35:27.407+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'145 2024-09-16T03:35:42.443 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:35:27.407+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'146 2024-09-16T03:35:42.443 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:35:27.407+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'147 2024-09-16T03:35:42.443 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:35:27.407+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'148 2024-09-16T03:35:42.443 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:35:27.407+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'149 2024-09-16T03:35:42.443 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:35:27.407+0000 7efedf3a5640 20 copy_up_to/copy_after copy dup from log version 33'150 2024-09-16T03:35:42.443 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:35:27.407+0000 7efedf3a5640 20 copy_after END v 33'150 dups.size()=10 other.dups.size()=7 2024-09-16T03:35:42.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:96: _common_test: rm -f td/osd-backfill-recovery-log/result.log 2024-09-16T03:35:42.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:97: _common_test: '[' 0 '!=' 0 ']' 2024-09-16T03:35:42.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:35: run: teardown td/osd-backfill-recovery-log 2024-09-16T03:35:42.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:35:42.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:35:42.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-09-16T03:35:42.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:35:42.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:35:42.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:35:42.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:35:42.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:35:42.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:35:42.452 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:35:42.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:35:42.453 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:35:42.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:35:42.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:35:42.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:35:42.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:35:42.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:35:42.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:35:42.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:35:42.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:35:42.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:35:42.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-recovery-log 2024-09-16T03:35:42.496 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:35:42.496 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:35:42.496 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:35:42.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.53196 2024-09-16T03:35:42.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:35:42.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:35:42.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:32: run: for func in $funcs 2024-09-16T03:35:42.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:33: run: setup td/osd-backfill-recovery-log 2024-09-16T03:35:42.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-recovery-log 2024-09-16T03:35:42.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-recovery-log 2024-09-16T03:35:42.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:35:42.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:35:42.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-09-16T03:35:42.499 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:35:42.499 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:35:42.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:35:42.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:35:42.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:35:42.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:35:42.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:35:42.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:35:42.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:35:42.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:35:42.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:35:42.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:35:42.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:35:42.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:35:42.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:35:42.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:35:42.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:35:42.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:35:42.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-recovery-log 2024-09-16T03:35:42.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:35:42.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:35:42.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:35:42.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.53196 2024-09-16T03:35:42.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:35:42.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:35:42.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-recovery-log 2024-09-16T03:35:42.509 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:35:42.509 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:35:42.509 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:35:42.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.53196 2024-09-16T03:35:42.512 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:35:42.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:35:42.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:35:42.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-recovery-log 1' TERM HUP INT 2024-09-16T03:35:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:34: run: TEST_backfill_log_2 td/osd-backfill-recovery-log 2024-09-16T03:35:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:114: TEST_backfill_log_2: local dir=td/osd-backfill-recovery-log 2024-09-16T03:35:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:116: TEST_backfill_log_2: _common_test td/osd-backfill-recovery-log '--osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2 148 150 2024-09-16T03:35:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:41: _common_test: local dir=td/osd-backfill-recovery-log 2024-09-16T03:35:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:42: _common_test: local 'extra_opts=--osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-09-16T03:35:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:43: _common_test: local loglen=2 2024-09-16T03:35:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:44: _common_test: local dupslen=148 2024-09-16T03:35:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:45: _common_test: local objects=150 2024-09-16T03:35:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:46: _common_test: local moreobjects=0 2024-09-16T03:35:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:48: _common_test: local OSDS=6 2024-09-16T03:35:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:50: _common_test: run_mon td/osd-backfill-recovery-log a 2024-09-16T03:35:42.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-recovery-log 2024-09-16T03:35:42.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:35:42.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:35:42.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:35:42.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-recovery-log/a 2024-09-16T03:35:42.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-recovery-log/a --run-dir=td/osd-backfill-recovery-log 2024-09-16T03:35:42.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:35:42.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:35:42.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:35:42.905 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:35:42.905 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:35:42.906 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:35:42.906 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:35:42.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-recovery-log/a '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-recovery-log/log --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:35:43.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:35:43.087 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:35:43.088 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:35:43.088 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:35:43.088 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:35:43.089 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:35:43.089 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:35:43.089 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:35:43.089 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:35:43.089 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:35:43.089 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:35:43.090 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:35:43.090 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.53196/ceph-mon.a.asok 2024-09-16T03:35:43.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:35:43.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.53196/ceph-mon.a.asok config get fsid 2024-09-16T03:35:43.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:35:43.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:35:43.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:35:43.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:35:43.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:35:43.181 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:35:43.181 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:35:43.182 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:35:43.182 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:35:43.182 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:35:43.182 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:35:43.182 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.53196/ceph-mon.a.asok 2024-09-16T03:35:43.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:35:43.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.53196/ceph-mon.a.asok config get mon_host 2024-09-16T03:35:43.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:51: _common_test: run_mgr td/osd-backfill-recovery-log x 2024-09-16T03:35:43.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-recovery-log 2024-09-16T03:35:43.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:35:43.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:35:43.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:35:43.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-recovery-log/x 2024-09-16T03:35:43.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:35:44.120 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:35:44.120 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:35:44.120 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:35:44.120 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:35:44.120 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:35:44.120 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:35:44.120 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:35:44.121 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:35:44.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd_pg_log_dups_tracked=10 --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-recovery-log/x '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:35:44.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:52: _common_test: export CEPH_ARGS 2024-09-16T03:35:44.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: export 'EXTRA_OPTS= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-09-16T03:35:44.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: EXTRA_OPTS=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-09-16T03:35:44.154 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: expr 6 - 1 2024-09-16T03:35:44.155 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: seq 0 5 2024-09-16T03:35:44.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:35:44.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 0 2024-09-16T03:35:44.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:35:44.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:35:44.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:35:44.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:35:44.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/0 2024-09-16T03:35:44.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/0' 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/0/journal' 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:35:44.160 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:35:44.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/0 2024-09-16T03:35:44.162 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:35:44.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5263952b-4111-4b58-a66b-a05d7a33a10e 2024-09-16T03:35:44.163 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 5263952b-4111-4b58-a66b-a05d7a33a10e 2024-09-16T03:35:44.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 5263952b-4111-4b58-a66b-a05d7a33a10e' 2024-09-16T03:35:44.163 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:35:44.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCQp+dmuximChAAP6dUiIDvBOzdy6/bO6xJTQ== 2024-09-16T03:35:44.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCQp+dmuximChAAP6dUiIDvBOzdy6/bO6xJTQ=="}' 2024-09-16T03:35:44.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5263952b-4111-4b58-a66b-a05d7a33a10e -i td/osd-backfill-recovery-log/0/new.json 2024-09-16T03:35:44.444 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:35:44.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/0/new.json 2024-09-16T03:35:44.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCQp+dmuximChAAP6dUiIDvBOzdy6/bO6xJTQ== --osd-uuid 5263952b-4111-4b58-a66b-a05d7a33a10e 2024-09-16T03:35:44.489 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:35:44.487+0000 7f1f16a0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:35:44.513 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:35:44.511+0000 7f1f16a0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:35:44.514 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:35:44.512+0000 7f1f16a0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:35:44.515 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:35:44.513+0000 7f1f16a0d640 -1 bdev(0x55e69fac1c00 td/osd-backfill-recovery-log/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:35:44.515 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:35:44.513+0000 7f1f16a0d640 -1 bluestore(td/osd-backfill-recovery-log/0) _read_fsid unparsable uuid 2024-09-16T03:35:50.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/0/keyring 2024-09-16T03:35:50.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:35:50.043 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T03:35:50.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:35:50.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:35:50.608 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T03:35:50.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:35:50.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:35:50.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:35:50.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:35:50.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:35:50.640 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:35:50.638+0000 7f968300f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:35:50.642 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:35:50.641+0000 7f968300f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:35:50.643 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:35:50.642+0000 7f968300f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:35:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:35:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:35:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:35:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:35:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:35:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:35:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:35:51.040 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:35:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:35:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:35:51.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:35:52.222 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:35:52.220+0000 7f968300f640 -1 Falling back to public interface 2024-09-16T03:35:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:35:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:35:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:35:52.491 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:35:52.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:35:52.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:35:52.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:35:53.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:35:53.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:35:53.943 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:35:53.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:35:53.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:35:53.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:35:54.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:35:55.112 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:35:55.110+0000 7f968300f640 -1 osd.0 0 log_to_monitors true 2024-09-16T03:35:55.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:35:55.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:35:55.395 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:35:55.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:35:55.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:35:55.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:35:55.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:35:56.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:35:56.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:35:56.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:35:56.842 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:35:56.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:35:56.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:35:57.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:35:58.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:35:58.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:35:58.262 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:35:58.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:35:58.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:35:58.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:35:58.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:35:59.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:35:59.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:35:59.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:35:59.681 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:35:59.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:35:59.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:36:00.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:01.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:01.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:01.166 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:36:01.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:36:01.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:01.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:36:01.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:02.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:02.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:02.608 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:36:02.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:36:02.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:02.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:36:03.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:04.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:04.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:04.053 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:36:04.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:36:04.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:04.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:36:04.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:05.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:05.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:05.509 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:36:05.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:36:05.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:05.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:36:06.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:07.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:07.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:07.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:36:07.065 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:36:07.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:07.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:36:07.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:08.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:08.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:08.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:36:08.836 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:36:08.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:08.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:36:09.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:10.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:10.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:10.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:36:10.949 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:36:10.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:10.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:36:11.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:12.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:12.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:12.710 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:36:12.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:36:12.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:12.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:36:13.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:14.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:14.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:14.266 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:36:14.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:36:14.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:14.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:36:14.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:15.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:15.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:15.707 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:36:15.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:36:15.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:15.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:36:16.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:17.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:17.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:17.415 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:36:17.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:36:17.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:17.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:36:17.874 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/650417707,v1:127.0.0.1:6803/650417707] [v2:127.0.0.1:6804/650417707,v1:127.0.0.1:6805/650417707] exists,up 5263952b-4111-4b58-a66b-a05d7a33a10e 2024-09-16T03:36:17.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:36:17.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:36:17.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:36:17.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:36:17.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 1 2024-09-16T03:36:17.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:36:17.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:36:17.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:36:17.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:36:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/1 2024-09-16T03:36:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:36:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:36:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:36:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:36:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/1' 2024-09-16T03:36:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/1/journal' 2024-09-16T03:36:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:36:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-09-16T03:36:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:36:17.880 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:36:17.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:36:17.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:36:17.881 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:36:17.881 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:36:17.881 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:36:17.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:36:17.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:36:17.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/1 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:36:17.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ac0cef51-b994-48c8-8f49-3a5f722e7893 2024-09-16T03:36:17.883 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 ac0cef51-b994-48c8-8f49-3a5f722e7893 2024-09-16T03:36:17.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ac0cef51-b994-48c8-8f49-3a5f722e7893' 2024-09-16T03:36:17.883 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:36:17.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCxp+dmIFdsNRAA+gXSBf1kO0AKihldysDToQ== 2024-09-16T03:36:17.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCxp+dmIFdsNRAA+gXSBf1kO0AKihldysDToQ=="}' 2024-09-16T03:36:17.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ac0cef51-b994-48c8-8f49-3a5f722e7893 -i td/osd-backfill-recovery-log/1/new.json 2024-09-16T03:36:18.561 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:36:18.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/1/new.json 2024-09-16T03:36:18.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCxp+dmIFdsNRAA+gXSBf1kO0AKihldysDToQ== --osd-uuid ac0cef51-b994-48c8-8f49-3a5f722e7893 2024-09-16T03:36:18.607 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:18.605+0000 7f06ae210640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:36:18.618 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:18.617+0000 7f06ae210640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:36:18.619 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:18.618+0000 7f06ae210640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:36:18.620 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:18.618+0000 7f06ae210640 -1 bdev(0x55fdd6d27c00 td/osd-backfill-recovery-log/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:36:18.620 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:18.618+0000 7f06ae210640 -1 bluestore(td/osd-backfill-recovery-log/1) _read_fsid unparsable uuid 2024-09-16T03:36:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/1/keyring 2024-09-16T03:36:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:36:24.745 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T03:36:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:36:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:36:25.308 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T03:36:25.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:36:25.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:36:25.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:36:25.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:36:25.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:36:25.340 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:25.338+0000 7f2e920e4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:36:25.342 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:25.340+0000 7f2e920e4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:36:25.343 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:25.342+0000 7f2e920e4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:36:25.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:36:25.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:36:25.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:36:25.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:36:25.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:36:25.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:25.749 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:36:25.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:36:25.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:25.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:26.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:26.710 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:26.709+0000 7f2e920e4640 -1 Falling back to public interface 2024-09-16T03:36:27.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:27.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:27.176 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:36:27.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:36:27.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:27.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:27.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:28.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:28.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:28.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:36:28.661 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:36:28.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:28.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:29.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:29.549 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:29.545+0000 7f2e920e4640 -1 osd.1 0 log_to_monitors true 2024-09-16T03:36:30.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:30.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:30.090 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:36:30.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:36:30.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:30.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:30.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:31.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:31.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:31.644 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:36:31.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:36:31.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:31.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:32.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:33.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:33.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:33.084 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:36:33.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:36:33.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:33.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:33.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:34.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:34.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:34.749 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:36:34.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:36:34.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:34.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:35.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:36.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:36.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:36.300 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:36:36.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:36:36.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:36.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:36.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:37.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:37.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:37.721 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:36:37.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:36:37.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:37.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:38.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:39.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:39.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:39.159 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:36:39.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:36:39.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:39.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:39.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:40.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:40.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:40.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:36:40.775 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:36:40.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:40.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:41.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:42.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:42.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:42.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:36:42.429 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:36:42.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:42.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:42.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:43.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:43.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:43.851 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:36:43.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:36:43.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:43.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:44.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:45.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:45.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:45.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:36:45.532 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:36:45.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:45.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:46.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:47.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:47.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:47.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:36:47.295 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:36:47.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:47.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:48.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:49.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:49.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:49.022 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:36:49.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:36:49.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:49.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:49.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:50.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:50.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:50.624 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:36:50.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:36:50.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:50.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:51.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:36:52.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:36:52.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:52.042 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:36:52.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:36:52.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:52.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:36:52.484 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2390822218,v1:127.0.0.1:6811/2390822218] [v2:127.0.0.1:6812/2390822218,v1:127.0.0.1:6813/2390822218] exists,up ac0cef51-b994-48c8-8f49-3a5f722e7893 2024-09-16T03:36:52.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:36:52.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:36:52.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:36:52.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 2 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/2 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/2' 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/2/journal' 2024-09-16T03:36:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:36:52.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:36:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:36:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:36:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:36:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:36:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:36:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:36:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:36:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/2 2024-09-16T03:36:52.491 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:36:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8bd9dd01-543c-4eb0-bab1-8516ec6fccac 2024-09-16T03:36:52.491 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 8bd9dd01-543c-4eb0-bab1-8516ec6fccac 2024-09-16T03:36:52.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 8bd9dd01-543c-4eb0-bab1-8516ec6fccac' 2024-09-16T03:36:52.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:36:52.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDUp+dm7Vk6HhAAq5mU81sOPCUGVzCbZAxVfg== 2024-09-16T03:36:52.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDUp+dm7Vk6HhAAq5mU81sOPCUGVzCbZAxVfg=="}' 2024-09-16T03:36:52.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8bd9dd01-543c-4eb0-bab1-8516ec6fccac -i td/osd-backfill-recovery-log/2/new.json 2024-09-16T03:36:53.072 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:36:53.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/2/new.json 2024-09-16T03:36:53.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDUp+dm7Vk6HhAAq5mU81sOPCUGVzCbZAxVfg== --osd-uuid 8bd9dd01-543c-4eb0-bab1-8516ec6fccac 2024-09-16T03:36:53.118 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:53.116+0000 7f1fa331e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:36:53.119 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:53.118+0000 7f1fa331e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:36:53.120 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:53.119+0000 7f1fa331e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:36:53.121 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:53.119+0000 7f1fa331e640 -1 bdev(0x555fcf8b1c00 td/osd-backfill-recovery-log/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:36:53.121 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:53.120+0000 7f1fa331e640 -1 bluestore(td/osd-backfill-recovery-log/2) _read_fsid unparsable uuid 2024-09-16T03:36:58.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/2/keyring 2024-09-16T03:36:58.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:36:58.573 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T03:36:58.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:36:58.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:36:59.148 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T03:36:59.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:36:59.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:36:59.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:36:59.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:36:59.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:36:59.181 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:59.179+0000 7f9a6ac0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:36:59.183 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:59.181+0000 7f9a6ac0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:36:59.184 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:36:59.182+0000 7f9a6ac0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:36:59.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:36:59.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:36:59.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:36:59.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:36:59.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:36:59.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:36:59.574 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:36:59.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:36:59.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:36:59.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:00.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:00.519 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:37:00.517+0000 7f9a6ac0d640 -1 Falling back to public interface 2024-09-16T03:37:01.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:01.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:01.056 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:37:01.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:37:01.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:01.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:01.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:02.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:02.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:02.479 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:37:02.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:37:02.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:02.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:02.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:03.579 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:37:03.577+0000 7f9a6ac0d640 -1 osd.2 0 log_to_monitors true 2024-09-16T03:37:03.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:03.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:03.934 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:37:03.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:37:03.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:03.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:04.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:05.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:05.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:05.362 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:37:05.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:37:05.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:05.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:05.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:06.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:06.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:06.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:37:06.818 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:37:06.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:06.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:07.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:08.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:08.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:08.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:37:08.305 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:37:08.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:08.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:08.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:09.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:09.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:09.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:37:09.733 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:37:09.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:09.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:10.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:11.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:11.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:11.170 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:37:11.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:37:11.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:11.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:11.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:12.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:12.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:12.756 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:37:12.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:37:12.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:12.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:13.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:14.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:14.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:14.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:37:14.181 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:37:14.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:14.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:14.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:15.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:15.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:15.728 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:37:15.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:37:15.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:15.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:16.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:17.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:17.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:17.155 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:37:17.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:37:17.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:17.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:17.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:18.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:18.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:18.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:37:18.942 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:37:18.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:18.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:19.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:20.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:20.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:20.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:37:20.711 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:37:20.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:20.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:21.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:22.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:22.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:22.842 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:37:22.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:37:22.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:22.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:23.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:24.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:24.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:24.661 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:37:24.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:37:24.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:24.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:25.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:26.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:26.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:26.525 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:37:26.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:37:26.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:26.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:37:26.942 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/841470353,v1:127.0.0.1:6819/841470353] [v2:127.0.0.1:6820/841470353,v1:127.0.0.1:6821/841470353] exists,up 8bd9dd01-543c-4eb0-bab1-8516ec6fccac 2024-09-16T03:37:26.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:37:26.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:37:26.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:37:26.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:37:26.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 3 2024-09-16T03:37:26.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:37:26.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:37:26.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T03:37:26.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:37:26.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/3 2024-09-16T03:37:26.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:37:26.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/3' 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/3/journal' 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:37:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:37:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:37:26.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/3 2024-09-16T03:37:26.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:37:26.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=779dd550-89a6-4384-86fd-fc3a3206f5a3 2024-09-16T03:37:26.949 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 779dd550-89a6-4384-86fd-fc3a3206f5a3 2024-09-16T03:37:26.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 779dd550-89a6-4384-86fd-fc3a3206f5a3' 2024-09-16T03:37:26.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:37:26.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD2p+dmboKCORAAMABs3fxHT/CeurZ2u/2bVA== 2024-09-16T03:37:26.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD2p+dmboKCORAAMABs3fxHT/CeurZ2u/2bVA=="}' 2024-09-16T03:37:26.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 779dd550-89a6-4384-86fd-fc3a3206f5a3 -i td/osd-backfill-recovery-log/3/new.json 2024-09-16T03:37:27.640 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:37:27.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/3/new.json 2024-09-16T03:37:27.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD2p+dmboKCORAAMABs3fxHT/CeurZ2u/2bVA== --osd-uuid 779dd550-89a6-4384-86fd-fc3a3206f5a3 2024-09-16T03:37:27.687 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:37:27.685+0000 7f5b9260d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:37:27.707 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:37:27.705+0000 7f5b9260d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:37:27.708 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:37:27.707+0000 7f5b9260d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:37:27.709 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:37:27.707+0000 7f5b9260d640 -1 bdev(0x558950db9c00 td/osd-backfill-recovery-log/3/block) open stat got: (1) Operation not permitted 2024-09-16T03:37:27.709 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:37:27.707+0000 7f5b9260d640 -1 bluestore(td/osd-backfill-recovery-log/3) _read_fsid unparsable uuid 2024-09-16T03:37:34.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/3/keyring 2024-09-16T03:37:34.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:37:34.198 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T03:37:34.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T03:37:34.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:37:34.771 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T03:37:34.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T03:37:34.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:37:34.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:37:34.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:37:34.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:37:34.803 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:37:34.802+0000 7feb8fd4d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:37:34.805 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:37:34.804+0000 7feb8fd4d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:37:34.807 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:37:34.805+0000 7feb8fd4d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:37:35.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T03:37:35.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:37:35.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T03:37:35.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:37:35.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:37:35.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:35.212 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:37:35.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:37:35.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:35.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:35.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:35.904 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:37:35.903+0000 7feb8fd4d640 -1 Falling back to public interface 2024-09-16T03:37:36.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:36.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:36.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:37:36.655 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:37:36.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:36.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:37.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:38.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:38.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:38.090 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:37:38.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:37:38.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:38.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:38.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:38.995 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:37:38.992+0000 7feb8fd4d640 -1 osd.3 0 log_to_monitors true 2024-09-16T03:37:39.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:39.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:39.549 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:37:39.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:37:39.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:39.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:40.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:41.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:41.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:41.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:37:41.082 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:37:41.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:41.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:41.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:42.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:42.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:42.534 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:37:42.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:37:42.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:42.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:43.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:44.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:44.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:44.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:37:44.040 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:37:44.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:44.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:44.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:45.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:45.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:45.456 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:37:45.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:37:45.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:45.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:45.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:46.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:46.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:46.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:37:46.953 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:37:46.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:46.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:47.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:48.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:48.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:48.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:37:48.499 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:37:48.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:48.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:48.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:49.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:49.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:49.981 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:37:49.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:37:49.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:49.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:50.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:51.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:51.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:51.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:37:51.404 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:37:51.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:51.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:52.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:53.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:53.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:53.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:37:53.328 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:37:53.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:53.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:54.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:55.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:55.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:55.334 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:37:55.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:37:55.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:55.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:56.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:57.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:57.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:57.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:37:57.029 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:37:57.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:57.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:37:57.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:37:58.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:37:58.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:37:58.988 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:37:58.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:37:58.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:37:58.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:38:00.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:01.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:01.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:01.144 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:38:01.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:38:01.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:01.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:38:01.637 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3114663738,v1:127.0.0.1:6827/3114663738] [v2:127.0.0.1:6828/3114663738,v1:127.0.0.1:6829/3114663738] exists,up 779dd550-89a6-4384-86fd-fc3a3206f5a3 2024-09-16T03:38:01.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:38:01.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:38:01.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:38:01.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:38:01.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 4 2024-09-16T03:38:01.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:38:01.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:38:01.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T03:38:01.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:38:01.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/4 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/4' 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/4/journal' 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:38:01.642 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:38:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:38:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:38:01.643 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:38:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:38:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:38:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:38:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:38:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:38:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:38:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:38:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:38:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:38:01.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:38:01.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:38:01.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:38:01.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/4 2024-09-16T03:38:01.644 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:38:01.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2090e509-3ce6-4eeb-8929-86a64d6c7640 2024-09-16T03:38:01.644 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 2090e509-3ce6-4eeb-8929-86a64d6c7640 2024-09-16T03:38:01.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 2090e509-3ce6-4eeb-8929-86a64d6c7640' 2024-09-16T03:38:01.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:38:01.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAZqOdm7MpVJxAAdYGL/HwD/gnmcgrMtg3OFg== 2024-09-16T03:38:01.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAZqOdm7MpVJxAAdYGL/HwD/gnmcgrMtg3OFg=="}' 2024-09-16T03:38:01.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2090e509-3ce6-4eeb-8929-86a64d6c7640 -i td/osd-backfill-recovery-log/4/new.json 2024-09-16T03:38:02.188 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:38:02.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/4/new.json 2024-09-16T03:38:02.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAZqOdm7MpVJxAAdYGL/HwD/gnmcgrMtg3OFg== --osd-uuid 2090e509-3ce6-4eeb-8929-86a64d6c7640 2024-09-16T03:38:02.235 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:02.233+0000 7f8836212640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:38:02.305 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:02.303+0000 7f8836212640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:38:02.305 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:02.304+0000 7f8836212640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:38:02.306 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:02.304+0000 7f8836212640 -1 bdev(0x55df37073c00 td/osd-backfill-recovery-log/4/block) open stat got: (1) Operation not permitted 2024-09-16T03:38:02.306 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:02.304+0000 7f8836212640 -1 bluestore(td/osd-backfill-recovery-log/4) _read_fsid unparsable uuid 2024-09-16T03:38:08.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/4/keyring 2024-09-16T03:38:08.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:38:08.485 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T03:38:08.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T03:38:08.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:38:09.051 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T03:38:09.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T03:38:09.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:38:09.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:38:09.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:38:09.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:38:09.083 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:09.082+0000 7f87da218640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:38:09.085 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:09.084+0000 7f87da218640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:38:09.086 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:09.085+0000 7f87da218640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:38:09.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T03:38:09.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:38:09.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T03:38:09.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:38:09.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:38:09.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:09.476 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:38:09.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:38:09.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:09.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:09.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:10.189 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:10.188+0000 7f87da218640 -1 Falling back to public interface 2024-09-16T03:38:10.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:10.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:10.947 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:38:10.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:38:10.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:10.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:11.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:12.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:12.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:12.376 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:38:12.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:38:12.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:12.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:12.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:12.950 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:12.948+0000 7f87da218640 -1 osd.4 0 log_to_monitors true 2024-09-16T03:38:13.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:13.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:13.792 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:38:13.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:38:13.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:13.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:14.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:15.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:15.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:15.283 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:38:15.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:38:15.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:15.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:15.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:16.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:16.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:16.704 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:38:16.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:38:16.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:16.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:17.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:18.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:18.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:18.188 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:38:18.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:38:18.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:18.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:18.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:19.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:19.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:19.637 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:38:19.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:38:19.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:19.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:20.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:21.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:21.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:21.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:38:21.117 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:38:21.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:21.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:21.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:22.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:22.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:22.617 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:38:22.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:38:22.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:22.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:23.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:24.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:24.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:24.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:38:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:38:24.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:24.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:24.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:25.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:25.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:25.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:38:25.474 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:38:25.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:25.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:26.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:27.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:27.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:27.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:38:27.184 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:38:27.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:27.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:27.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:28.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:28.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:28.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:38:28.830 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:38:28.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:28.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:30.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:31.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:31.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:31.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:38:31.078 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:38:31.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:31.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:31.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:32.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:32.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:32.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:38:32.806 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:38:32.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:32.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:33.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:34.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:34.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:34.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:38:34.601 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:38:34.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:34.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:35.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:36.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:36.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:36.437 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:38:36.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:38:36.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:36.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:38:36.922 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/4209825723,v1:127.0.0.1:6835/4209825723] [v2:127.0.0.1:6836/4209825723,v1:127.0.0.1:6837/4209825723] exists,up 2090e509-3ce6-4eeb-8929-86a64d6c7640 2024-09-16T03:38:36.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:38:36.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:38:36.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:38:36.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:38:36.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 5 2024-09-16T03:38:36.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:38:36.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:38:36.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T03:38:36.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:38:36.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/5 2024-09-16T03:38:36.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:38:36.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:38:36.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:38:36.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:38:36.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/5' 2024-09-16T03:38:36.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/5/journal' 2024-09-16T03:38:36.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:38:36.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2' 2024-09-16T03:38:36.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:38:36.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:38:36.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:38:36.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:38:36.929 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:38:36.929 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:38:36.929 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:38:36.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:38:36.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:38:36.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:38:36.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:38:36.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:38:36.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:38:36.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:38:36.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:38:36.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:38:36.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:38:36.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:38:36.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:38:36.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:38:36.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/5 2024-09-16T03:38:36.930 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:38:36.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=237c8ec7-7f22-456b-b45a-71295c3509c4 2024-09-16T03:38:36.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 237c8ec7-7f22-456b-b45a-71295c3509c4' 2024-09-16T03:38:36.931 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 237c8ec7-7f22-456b-b45a-71295c3509c4 2024-09-16T03:38:36.931 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:38:36.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA8qOdm/zdVOBAAGPYH69eyJ1BtVvqfKmidTA== 2024-09-16T03:38:36.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA8qOdm/zdVOBAAGPYH69eyJ1BtVvqfKmidTA=="}' 2024-09-16T03:38:36.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 237c8ec7-7f22-456b-b45a-71295c3509c4 -i td/osd-backfill-recovery-log/5/new.json 2024-09-16T03:38:37.481 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:38:37.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/5/new.json 2024-09-16T03:38:37.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA8qOdm/zdVOBAAGPYH69eyJ1BtVvqfKmidTA== --osd-uuid 237c8ec7-7f22-456b-b45a-71295c3509c4 2024-09-16T03:38:37.526 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:37.525+0000 7f7b29a2c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:38:37.601 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:37.599+0000 7f7b29a2c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:38:37.602 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:37.601+0000 7f7b29a2c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:38:37.603 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:37.601+0000 7f7b29a2c640 -1 bdev(0x563149447c00 td/osd-backfill-recovery-log/5/block) open stat got: (1) Operation not permitted 2024-09-16T03:38:37.603 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:37.601+0000 7f7b29a2c640 -1 bluestore(td/osd-backfill-recovery-log/5) _read_fsid unparsable uuid 2024-09-16T03:38:43.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/5/keyring 2024-09-16T03:38:43.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:38:43.308 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T03:38:43.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T03:38:43.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:38:43.872 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T03:38:43.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T03:38:43.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:38:43.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:38:43.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:38:43.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:38:43.903 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:43.902+0000 7f7e8ca31640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:38:43.908 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:43.906+0000 7f7e8ca31640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:38:43.909 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:43.908+0000 7f7e8ca31640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:38:44.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T03:38:44.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:38:44.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T03:38:44.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:38:44.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:38:44.331 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:38:44.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:44.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:38:44.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:44.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:38:44.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:45.246 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:45.244+0000 7f7e8ca31640 -1 Falling back to public interface 2024-09-16T03:38:45.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:45.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:45.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:38:45.775 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:38:45.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:45.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:38:46.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:47.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:47.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:47.228 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:38:47.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:38:47.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:47.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:38:47.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:48.224 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:38:48.220+0000 7f7e8ca31640 -1 osd.5 0 log_to_monitors true 2024-09-16T03:38:48.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:48.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:48.697 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:38:48.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:38:48.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:48.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:38:49.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:50.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:50.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:50.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:38:50.130 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:38:50.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:50.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:38:50.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:51.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:51.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:51.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:38:51.568 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:38:51.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:51.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:38:52.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:53.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:53.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:53.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:38:53.124 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:38:53.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:53.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:38:53.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:54.629 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:38:54.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:38:54.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:54.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:38:55.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:56.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:56.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:56.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:38:56.108 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:38:56.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:56.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:38:56.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:57.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:57.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:57.582 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:38:57.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:38:57.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:57.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:38:58.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:38:59.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:38:59.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:38:59.082 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:38:59.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:38:59.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:38:59.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:38:59.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:39:00.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:39:00.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:39:00.637 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:39:00.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:39:00.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:39:00.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:39:01.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:39:02.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:39:02.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:39:02.139 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:39:02.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:39:02.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:39:02.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:39:03.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:39:04.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:39:04.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:39:04.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:39:04.241 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:39:04.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:39:04.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:39:05.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:39:06.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:39:06.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:39:06.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:39:06.076 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:39:06.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:39:06.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:39:06.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:39:07.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:39:07.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:39:07.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:39:07.852 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:39:07.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:39:07.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:39:08.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:39:09.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:39:09.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:39:09.530 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:39:09.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:39:09.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:39:09.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:39:10.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:39:11.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:39:11.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:39:11.524 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:39:11.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:39:11.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:39:11.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:39:12.129 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/1988888917,v1:127.0.0.1:6843/1988888917] [v2:127.0.0.1:6844/1988888917,v1:127.0.0.1:6845/1988888917] exists,up 237c8ec7-7f22-456b-b45a-71295c3509c4 2024-09-16T03:39:12.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:39:12.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:39:12.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:39:12.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:60: _common_test: create_pool test 1 1 2024-09-16T03:39:12.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2024-09-16T03:39:12.806 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T03:39:12.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:39:13.819 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: seq 1 150 2024-09-16T03:39:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-1 /etc/passwd 2024-09-16T03:39:14.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:14.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-2 /etc/passwd 2024-09-16T03:39:15.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:15.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-3 /etc/passwd 2024-09-16T03:39:15.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:15.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-4 /etc/passwd 2024-09-16T03:39:15.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:15.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-5 /etc/passwd 2024-09-16T03:39:15.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:15.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-6 /etc/passwd 2024-09-16T03:39:15.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:15.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-7 /etc/passwd 2024-09-16T03:39:16.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:16.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-8 /etc/passwd 2024-09-16T03:39:16.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:16.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-9 /etc/passwd 2024-09-16T03:39:16.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:16.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-10 /etc/passwd 2024-09-16T03:39:16.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:16.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-11 /etc/passwd 2024-09-16T03:39:16.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:16.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-12 /etc/passwd 2024-09-16T03:39:16.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:16.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-13 /etc/passwd 2024-09-16T03:39:16.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:16.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-14 /etc/passwd 2024-09-16T03:39:17.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:17.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-15 /etc/passwd 2024-09-16T03:39:17.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:17.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-16 /etc/passwd 2024-09-16T03:39:17.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:17.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-17 /etc/passwd 2024-09-16T03:39:17.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:17.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-18 /etc/passwd 2024-09-16T03:39:17.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:17.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-19 /etc/passwd 2024-09-16T03:39:17.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:17.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-20 /etc/passwd 2024-09-16T03:39:18.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:18.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-21 /etc/passwd 2024-09-16T03:39:18.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:18.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-22 /etc/passwd 2024-09-16T03:39:18.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:18.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-23 /etc/passwd 2024-09-16T03:39:18.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:18.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-24 /etc/passwd 2024-09-16T03:39:18.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:18.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-25 /etc/passwd 2024-09-16T03:39:18.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:18.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-26 /etc/passwd 2024-09-16T03:39:18.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:18.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-27 /etc/passwd 2024-09-16T03:39:19.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:19.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-28 /etc/passwd 2024-09-16T03:39:19.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:19.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-29 /etc/passwd 2024-09-16T03:39:19.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:19.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-30 /etc/passwd 2024-09-16T03:39:19.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:19.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-31 /etc/passwd 2024-09-16T03:39:19.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:19.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-32 /etc/passwd 2024-09-16T03:39:19.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:19.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-33 /etc/passwd 2024-09-16T03:39:19.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:19.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-34 /etc/passwd 2024-09-16T03:39:20.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:20.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-35 /etc/passwd 2024-09-16T03:39:20.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:20.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-36 /etc/passwd 2024-09-16T03:39:20.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:20.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-37 /etc/passwd 2024-09-16T03:39:20.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:20.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-38 /etc/passwd 2024-09-16T03:39:20.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:20.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-39 /etc/passwd 2024-09-16T03:39:20.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:20.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-40 /etc/passwd 2024-09-16T03:39:20.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:20.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-41 /etc/passwd 2024-09-16T03:39:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:21.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-42 /etc/passwd 2024-09-16T03:39:21.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:21.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-43 /etc/passwd 2024-09-16T03:39:21.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:21.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-44 /etc/passwd 2024-09-16T03:39:21.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:21.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-45 /etc/passwd 2024-09-16T03:39:21.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:21.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-46 /etc/passwd 2024-09-16T03:39:21.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:21.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-47 /etc/passwd 2024-09-16T03:39:21.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:21.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-48 /etc/passwd 2024-09-16T03:39:22.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:22.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-49 /etc/passwd 2024-09-16T03:39:22.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:22.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-50 /etc/passwd 2024-09-16T03:39:22.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:22.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-51 /etc/passwd 2024-09-16T03:39:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-52 /etc/passwd 2024-09-16T03:39:22.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:22.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-53 /etc/passwd 2024-09-16T03:39:22.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:22.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-54 /etc/passwd 2024-09-16T03:39:22.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:22.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-55 /etc/passwd 2024-09-16T03:39:23.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:23.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-56 /etc/passwd 2024-09-16T03:39:23.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:23.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-57 /etc/passwd 2024-09-16T03:39:23.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:23.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-58 /etc/passwd 2024-09-16T03:39:23.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:23.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-59 /etc/passwd 2024-09-16T03:39:23.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:23.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-60 /etc/passwd 2024-09-16T03:39:23.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:23.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-61 /etc/passwd 2024-09-16T03:39:23.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:23.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-62 /etc/passwd 2024-09-16T03:39:24.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:24.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-63 /etc/passwd 2024-09-16T03:39:24.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:24.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-64 /etc/passwd 2024-09-16T03:39:24.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:24.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-65 /etc/passwd 2024-09-16T03:39:24.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:24.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-66 /etc/passwd 2024-09-16T03:39:24.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:24.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-67 /etc/passwd 2024-09-16T03:39:24.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:24.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-68 /etc/passwd 2024-09-16T03:39:24.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:24.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-69 /etc/passwd 2024-09-16T03:39:25.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:25.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-70 /etc/passwd 2024-09-16T03:39:25.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:25.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-71 /etc/passwd 2024-09-16T03:39:25.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:25.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-72 /etc/passwd 2024-09-16T03:39:25.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:25.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-73 /etc/passwd 2024-09-16T03:39:25.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:25.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-74 /etc/passwd 2024-09-16T03:39:25.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:25.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-75 /etc/passwd 2024-09-16T03:39:25.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:25.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-76 /etc/passwd 2024-09-16T03:39:26.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:26.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-77 /etc/passwd 2024-09-16T03:39:26.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:26.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-78 /etc/passwd 2024-09-16T03:39:26.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:26.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-79 /etc/passwd 2024-09-16T03:39:26.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:26.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-80 /etc/passwd 2024-09-16T03:39:26.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:26.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-81 /etc/passwd 2024-09-16T03:39:26.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:26.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-82 /etc/passwd 2024-09-16T03:39:26.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:26.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-83 /etc/passwd 2024-09-16T03:39:27.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:27.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-84 /etc/passwd 2024-09-16T03:39:27.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:27.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-85 /etc/passwd 2024-09-16T03:39:27.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:27.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-86 /etc/passwd 2024-09-16T03:39:27.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:27.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-87 /etc/passwd 2024-09-16T03:39:27.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:27.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-88 /etc/passwd 2024-09-16T03:39:27.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:27.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-89 /etc/passwd 2024-09-16T03:39:27.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:27.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-90 /etc/passwd 2024-09-16T03:39:28.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:28.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-91 /etc/passwd 2024-09-16T03:39:28.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:28.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-92 /etc/passwd 2024-09-16T03:39:28.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:28.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-93 /etc/passwd 2024-09-16T03:39:28.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:28.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-94 /etc/passwd 2024-09-16T03:39:28.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:28.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-95 /etc/passwd 2024-09-16T03:39:28.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:28.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-96 /etc/passwd 2024-09-16T03:39:28.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:28.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-97 /etc/passwd 2024-09-16T03:39:29.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:29.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-98 /etc/passwd 2024-09-16T03:39:29.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:29.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-99 /etc/passwd 2024-09-16T03:39:29.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:29.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-100 /etc/passwd 2024-09-16T03:39:29.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:29.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-101 /etc/passwd 2024-09-16T03:39:29.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:29.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-102 /etc/passwd 2024-09-16T03:39:29.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:29.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-103 /etc/passwd 2024-09-16T03:39:29.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:29.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-104 /etc/passwd 2024-09-16T03:39:30.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:30.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-105 /etc/passwd 2024-09-16T03:39:30.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:30.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-106 /etc/passwd 2024-09-16T03:39:30.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:30.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-107 /etc/passwd 2024-09-16T03:39:30.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:30.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-108 /etc/passwd 2024-09-16T03:39:30.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:30.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-109 /etc/passwd 2024-09-16T03:39:30.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:30.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-110 /etc/passwd 2024-09-16T03:39:30.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:30.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-111 /etc/passwd 2024-09-16T03:39:31.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:31.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-112 /etc/passwd 2024-09-16T03:39:31.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:31.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-113 /etc/passwd 2024-09-16T03:39:31.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:31.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-114 /etc/passwd 2024-09-16T03:39:31.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:31.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-115 /etc/passwd 2024-09-16T03:39:31.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:31.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-116 /etc/passwd 2024-09-16T03:39:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-117 /etc/passwd 2024-09-16T03:39:31.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:31.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-118 /etc/passwd 2024-09-16T03:39:32.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:32.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-119 /etc/passwd 2024-09-16T03:39:32.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:32.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-120 /etc/passwd 2024-09-16T03:39:32.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:32.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-121 /etc/passwd 2024-09-16T03:39:32.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:32.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-122 /etc/passwd 2024-09-16T03:39:32.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:32.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-123 /etc/passwd 2024-09-16T03:39:32.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:32.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-124 /etc/passwd 2024-09-16T03:39:32.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:32.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-125 /etc/passwd 2024-09-16T03:39:33.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:33.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-126 /etc/passwd 2024-09-16T03:39:33.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:33.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-127 /etc/passwd 2024-09-16T03:39:33.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:33.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-128 /etc/passwd 2024-09-16T03:39:33.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:33.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-129 /etc/passwd 2024-09-16T03:39:33.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:33.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-130 /etc/passwd 2024-09-16T03:39:33.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:33.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-131 /etc/passwd 2024-09-16T03:39:33.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:33.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-132 /etc/passwd 2024-09-16T03:39:34.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:34.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-133 /etc/passwd 2024-09-16T03:39:34.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:34.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-134 /etc/passwd 2024-09-16T03:39:34.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:34.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-135 /etc/passwd 2024-09-16T03:39:34.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:34.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-136 /etc/passwd 2024-09-16T03:39:34.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:34.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-137 /etc/passwd 2024-09-16T03:39:34.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:34.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-138 /etc/passwd 2024-09-16T03:39:34.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:34.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-139 /etc/passwd 2024-09-16T03:39:35.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:35.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-140 /etc/passwd 2024-09-16T03:39:35.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:35.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-141 /etc/passwd 2024-09-16T03:39:35.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:35.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-142 /etc/passwd 2024-09-16T03:39:35.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:35.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-143 /etc/passwd 2024-09-16T03:39:35.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:35.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-144 /etc/passwd 2024-09-16T03:39:35.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:35.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-145 /etc/passwd 2024-09-16T03:39:35.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:35.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-146 /etc/passwd 2024-09-16T03:39:36.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:36.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-147 /etc/passwd 2024-09-16T03:39:36.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:36.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-148 /etc/passwd 2024-09-16T03:39:36.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:36.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-149 /etc/passwd 2024-09-16T03:39:36.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:39:36.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-150 /etc/passwd 2024-09-16T03:39:36.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph pg dump pgs --format=json 2024-09-16T03:39:36.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: jq '.pg_stats[0].up[]' 2024-09-16T03:39:37.036 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:39:37.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph osd out 1 0 2 2024-09-16T03:39:37.680 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. osd.0 is already out. osd.2 is already out. 2024-09-16T03:39:37.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:69: _common_test: '[' 0 '!=' 0 ']' 2024-09-16T03:39:37.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:75: _common_test: sleep 1 2024-09-16T03:39:38.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:76: _common_test: wait_for_clean 2024-09-16T03:39:38.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:39:38.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:39:38.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:39:38.693 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:39:38.694 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:39:38.694 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:39:38.694 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:39:38.694 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:39:38.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:39:38.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:39:38.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:39:38.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:39:38.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:39:38.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:39:38.797 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:39:39.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:39:39.267 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:39:39.267 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:39:39.267 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:39:39.267 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T03:39:39.267 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T03:39:39.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:39:39.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:39:39.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:39:39.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836528 2024-09-16T03:39:39.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836528 2024-09-16T03:39:39.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528' 2024-09-16T03:39:39.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:39:39.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:39:39.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673000 2024-09-16T03:39:39.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673000 2024-09-16T03:39:39.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949673000' 2024-09-16T03:39:39.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:39:39.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:39:39.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509472 2024-09-16T03:39:39.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509472 2024-09-16T03:39:39.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949673000 2-64424509472' 2024-09-16T03:39:39.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:39:39.690 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:39:39.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345947 2024-09-16T03:39:39.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345947 2024-09-16T03:39:39.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949673000 2-64424509472 3-85899345947' 2024-09-16T03:39:39.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:39:39.810 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:39:39.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182418 2024-09-16T03:39:39.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182418 2024-09-16T03:39:39.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949673000 2-64424509472 3-85899345947 4-107374182418' 2024-09-16T03:39:39.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:39:39.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T03:39:40.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018890 2024-09-16T03:39:40.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018890 2024-09-16T03:39:40.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949673000 2-64424509472 3-85899345947 4-107374182418 5-128849018890' 2024-09-16T03:39:40.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:39:40.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836528 2024-09-16T03:39:40.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:39:40.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:39:40.049 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836528 2024-09-16T03:39:40.049 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:39:40.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836528 2024-09-16T03:39:40.050 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836528 2024-09-16T03:39:40.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836528' 2024-09-16T03:39:40.051 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:39:40.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 0 -lt 21474836528 2024-09-16T03:39:40.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:39:41.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:39:41.459 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:39:41.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836528 -lt 21474836528 2024-09-16T03:39:41.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:39:41.874 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673000 2024-09-16T03:39:41.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:39:41.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:39:41.876 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673000 2024-09-16T03:39:41.876 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:39:41.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673000 2024-09-16T03:39:41.878 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673000 2024-09-16T03:39:41.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673000' 2024-09-16T03:39:41.878 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:39:42.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673000 -lt 42949673000 2024-09-16T03:39:42.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:39:42.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509472 2024-09-16T03:39:42.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:39:42.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:39:42.512 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509472 2024-09-16T03:39:42.512 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:39:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509472 2024-09-16T03:39:42.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509472' 2024-09-16T03:39:42.514 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509472 2024-09-16T03:39:42.514 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:39:43.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509473 -lt 64424509472 2024-09-16T03:39:43.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:39:43.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345947 2024-09-16T03:39:43.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:39:43.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:39:43.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345947 2024-09-16T03:39:43.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:39:43.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345947 2024-09-16T03:39:43.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345947' 2024-09-16T03:39:43.102 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345947 2024-09-16T03:39:43.102 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:39:43.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345948 -lt 85899345947 2024-09-16T03:39:43.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:39:43.705 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182418 2024-09-16T03:39:43.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:39:43.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:39:43.707 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182418 2024-09-16T03:39:43.707 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:39:43.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182418 2024-09-16T03:39:43.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182418' 2024-09-16T03:39:43.708 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182418 2024-09-16T03:39:43.709 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:39:44.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182419 -lt 107374182418 2024-09-16T03:39:44.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:39:44.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018890 2024-09-16T03:39:44.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:39:44.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T03:39:44.261 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018890 2024-09-16T03:39:44.261 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:39:44.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018890 2024-09-16T03:39:44.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018890' 2024-09-16T03:39:44.262 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018890 2024-09-16T03:39:44.262 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T03:39:44.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018891 -lt 128849018890 2024-09-16T03:39:44.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:39:44.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:39:44.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:39:45.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T03:39:45.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:39:45.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:39:45.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:39:45.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:39:45.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:39:45.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:39:45.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:39:45.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:39:45.712 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:39:45.712 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:39:45.712 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:39:46.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:39:46.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T03:39:46.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T03:39:46.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T03:39:46.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:39:46.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:39:46.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:39:46.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:39:46.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:39:46.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:39:46.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:39:46.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:39:46.464 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:39:46.464 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:39:47.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:39:47.025 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:39:47.026 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:39:47.026 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:39:47.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:39:47.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:39:47.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:39:47.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:39:47.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:39:47.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:39:47.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:39:47.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:39:47.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:39:48.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=31875 2024-09-16T03:39:48.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 31875 '!=' null 2024-09-16T03:39:48.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:39:48.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:39:48.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:39:48.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:39:48.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:39:48.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:39:48.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:39:48.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:39:48.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:39:48.566 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:39:48.566 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:39:48.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:39:48.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:39:48.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:39:48.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:39:49.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:39:49.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:39:49.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:39:49.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:39:49.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:39:49.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:39:49.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:39:49.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:39:49.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:39:50.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=25746 2024-09-16T03:39:50.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 25746 '!=' null 2024-09-16T03:39:50.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:39:50.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:39:50.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:39:50.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:39:50.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:39:50.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:39:50.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:39:50.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:39:50.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:39:50.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:39:50.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:39:50.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:39:50.920 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:39:50.920 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:39:50.920 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:39:51.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:39:51.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:39:51.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:39:51.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:39:51.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:39:51.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:39:51.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:39:51.553 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:39:51.553 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:39:52.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=54347 2024-09-16T03:39:52.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 54347 '!=' null 2024-09-16T03:39:52.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:39:52.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:39:52.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:39:52.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:39:52.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:39:52.361 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:39:52.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:39:52.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:39:52.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:39:52.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:39:52.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:39:52.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:39:52.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:39:52.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:39:52.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:39:53.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:39:53.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:39:53.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:39:53.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:39:53.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:39:53.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:39:53.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:39:53.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:39:53.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:39:54.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=52566 2024-09-16T03:39:54.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 52566 '!=' null 2024-09-16T03:39:54.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:39:54.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:39:54.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:39:54.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:39:54.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:39:54.193 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:39:54.193 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:39:54.193 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:39:54.193 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:39:54.193 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:39:54.193 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:39:54.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:39:54.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:39:54.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:39:54.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:39:55.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:39:55.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:39:55.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:39:55.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:39:55.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:39:55.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:39:55.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:39:55.267 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:39:55.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:39:55.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=83676 2024-09-16T03:39:55.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 83676 '!=' null 2024-09-16T03:39:55.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:39:55.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:39:55.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:39:56.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:39:56.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:39:56.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:39:56.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:39:56.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:39:56.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:39:56.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:39:56.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:39:56.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:39:56.574 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:39:56.574 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:39:56.574 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:39:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:39:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:39:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:39:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:39:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:39:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:39:57.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:39:57.248 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:39:57.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:39:57.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=62221 2024-09-16T03:39:57.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 62221 '!=' null 2024-09-16T03:39:57.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:39:57.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:39:57.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:39:58.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:39:58.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:39:58.012 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:39:58.012 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:39:58.012 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:39:58.012 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:39:58.012 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:39:58.012 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:39:58.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:39:58.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:39:58.511 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:39:58.511 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:39:59.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:39:59.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:39:59.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:39:59.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:39:59.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:39:59.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:39:59.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:39:59.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:39:59.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:39:59.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=62221 2024-09-16T03:39:59.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 62221 '!=' null 2024-09-16T03:39:59.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:39:59.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:39:59.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:39:59.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:39:59.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:39:59.944 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:39:59.944 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:39:59.944 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:39:59.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:39:59.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:39:59.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:40:00.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:40:00.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:40:00.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:40:00.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:40:01.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:40:01.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:40:01.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:40:01.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:40:01.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:40:01.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:40:01.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:40:01.103 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:40:01.103 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:40:01.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=93333 2024-09-16T03:40:01.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 93333 '!=' null 2024-09-16T03:40:01.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:40:01.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:40:01.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:40:01.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:40:01.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:40:01.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:40:01.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:40:01.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:40:01.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:40:01.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:40:01.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:40:02.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:40:02.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:40:02.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:40:02.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:40:02.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:40:02.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:40:02.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:40:02.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:40:02.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:40:02.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:40:02.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:40:02.850 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:40:02.850 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:40:03.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=62222 2024-09-16T03:40:03.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 62222 '!=' null 2024-09-16T03:40:03.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:40:03.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:40:03.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:40:03.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:40:03.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:40:03.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:40:03.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:40:03.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:40:03.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:40:03.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:40:03.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:40:04.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:40:04.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:40:04.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:40:04.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:40:04.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:40:04.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:40:04.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:40:04.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:40:04.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:40:04.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:40:04.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:40:04.760 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:40:04.760 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:40:05.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=92263 2024-09-16T03:40:05.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 92263 '!=' null 2024-09-16T03:40:05.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:40:05.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:40:05.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:40:05.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:40:05.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:40:05.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:40:05.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:40:05.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:40:05.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:40:05.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:40:05.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:40:06.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:40:06.079 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:40:06.079 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:40:06.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:40:06.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:40:06.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:40:06.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:40:06.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:40:06.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:40:06.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:40:06.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:40:06.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:40:06.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:40:07.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=61151 2024-09-16T03:40:07.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 61151 '!=' null 2024-09-16T03:40:07.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:40:07.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:40:07.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:40:07.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:40:07.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:40:07.370 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:40:07.370 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:40:07.370 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:40:07.370 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:40:07.370 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:40:07.370 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:40:07.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:40:07.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:40:07.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:40:07.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:40:08.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:40:08.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:40:08.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:40:08.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:40:08.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:40:08.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:40:08.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:40:08.459 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:40:08.459 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:40:09.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=45059 2024-09-16T03:40:09.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 45059 '!=' null 2024-09-16T03:40:09.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:40:09.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:40:09.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:40:09.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:40:09.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:40:09.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:40:09.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:40:09.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:40:09.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:40:09.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:40:09.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:40:09.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:40:09.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:40:09.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:40:09.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:40:10.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:40:10.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:40:10.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:40:10.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:40:10.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:40:10.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:40:10.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:40:10.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:40:10.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:40:10.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=45059 2024-09-16T03:40:10.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 45059 '!=' null 2024-09-16T03:40:10.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:40:10.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:40:10.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:40:10.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:40:10.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:40:10.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:40:10.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:40:10.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:40:10.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:40:10.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:40:10.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:40:11.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:40:11.124 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:40:11.125 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:40:11.125 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:40:11.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:40:11.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:40:11.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:40:11.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:40:11.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:40:11.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:40:11.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:40:11.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:40:11.676 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:40:12.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=45059 2024-09-16T03:40:12.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 45059 '!=' null 2024-09-16T03:40:12.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:40:12.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:40:12.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:40:12.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:40:12.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:40:12.409 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:40:12.409 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:40:12.410 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:40:12.410 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:40:12.410 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:40:12.410 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:40:12.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:40:12.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:40:12.808 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:40:12.808 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:40:13.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T03:40:13.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:40:13.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:40:13.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:78: _common_test: flush_pg_stats 2024-09-16T03:40:13.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:40:13.359 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:40:13.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:40:13.787 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:40:13.787 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:40:13.787 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:40:13.788 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T03:40:13.788 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T03:40:13.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:40:13.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:40:13.788 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:40:13.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836537 2024-09-16T03:40:13.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836537 2024-09-16T03:40:13.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836537' 2024-09-16T03:40:13.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:40:13.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:40:14.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673009 2024-09-16T03:40:14.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673009 2024-09-16T03:40:14.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836537 1-42949673009' 2024-09-16T03:40:14.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:40:14.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:40:14.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509481 2024-09-16T03:40:14.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509481 2024-09-16T03:40:14.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836537 1-42949673009 2-64424509481' 2024-09-16T03:40:14.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:40:14.166 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:40:14.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345956 2024-09-16T03:40:14.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345956 2024-09-16T03:40:14.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836537 1-42949673009 2-64424509481 3-85899345956' 2024-09-16T03:40:14.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:40:14.284 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:40:14.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182427 2024-09-16T03:40:14.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182427 2024-09-16T03:40:14.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836537 1-42949673009 2-64424509481 3-85899345956 4-107374182427' 2024-09-16T03:40:14.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:40:14.403 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T03:40:14.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018899 2024-09-16T03:40:14.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018899 2024-09-16T03:40:14.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836537 1-42949673009 2-64424509481 3-85899345956 4-107374182427 5-128849018899' 2024-09-16T03:40:14.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:40:14.523 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836537 2024-09-16T03:40:14.523 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:40:14.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:40:14.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836537 2024-09-16T03:40:14.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:40:14.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836537 2024-09-16T03:40:14.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836537' 2024-09-16T03:40:14.526 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836537 2024-09-16T03:40:14.526 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:40:14.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836537 -lt 21474836537 2024-09-16T03:40:14.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:40:14.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673009 2024-09-16T03:40:14.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:40:14.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:40:14.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673009 2024-09-16T03:40:14.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:40:14.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673009 2024-09-16T03:40:14.967 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673009 2024-09-16T03:40:14.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673009' 2024-09-16T03:40:14.967 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:40:15.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673009 -lt 42949673009 2024-09-16T03:40:15.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:40:15.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509481 2024-09-16T03:40:15.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:40:15.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:40:15.468 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509481 2024-09-16T03:40:15.468 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:40:15.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509481 2024-09-16T03:40:15.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509481' 2024-09-16T03:40:15.469 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509481 2024-09-16T03:40:15.469 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:40:15.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509481 -lt 64424509481 2024-09-16T03:40:15.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:40:15.909 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345956 2024-09-16T03:40:15.910 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:40:15.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:40:15.911 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345956 2024-09-16T03:40:15.911 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:40:15.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345956 2024-09-16T03:40:15.912 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345956 2024-09-16T03:40:15.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345956' 2024-09-16T03:40:15.913 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:40:16.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345956 -lt 85899345956 2024-09-16T03:40:16.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:40:16.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182427 2024-09-16T03:40:16.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:40:16.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:40:16.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182427 2024-09-16T03:40:16.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:40:16.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182427 2024-09-16T03:40:16.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182427' 2024-09-16T03:40:16.317 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182427 2024-09-16T03:40:16.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:40:16.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182427 -lt 107374182427 2024-09-16T03:40:16.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:40:16.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018899 2024-09-16T03:40:16.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:40:16.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T03:40:16.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018899 2024-09-16T03:40:16.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:40:16.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018899 2024-09-16T03:40:16.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018899' 2024-09-16T03:40:16.740 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018899 2024-09-16T03:40:16.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T03:40:17.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018899 -lt 128849018899 2024-09-16T03:40:17.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: ceph pg dump pgs --format=json 2024-09-16T03:40:17.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: jq '.pg_stats[0].up_primary' 2024-09-16T03:40:17.555 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:40:17.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: newprimary=4 2024-09-16T03:40:17.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:81: _common_test: kill_daemons 2024-09-16T03:40:17.568 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:40:17.568 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:40:17.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:40:17.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:40:17.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:40:22.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:40:22.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:83: _common_test: ERRORS=0 2024-09-16T03:40:22.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: _objectstore_tool_nodown td/osd-backfill-recovery-log 4 --no-mon-config --pgid 1.0 --op log 2024-09-16T03:40:22.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:40:22.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: tee td/osd-backfill-recovery-log/result.log 2024-09-16T03:40:22.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2024-09-16T03:40:22.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=4 2024-09-16T03:40:22.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2024-09-16T03:40:22.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-backfill-recovery-log/4 2024-09-16T03:40:22.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-recovery-log/4 --no-mon-config --pgid 1.0 --op log 2024-09-16T03:40:24.498 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:40:24.498 INFO:tasks.workunit.client.0.smithi026.stdout: "pg_log_t": { 2024-09-16T03:40:24.498 INFO:tasks.workunit.client.0.smithi026.stdout: "head": "33'150", 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "tail": "33'148", 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "log": [ 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:e9c179f9:::obj-149:head", 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'149", 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4823.0:1", 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:39:36.391199+0000", 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:40:24.499 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.500 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:cb39fd60:::obj-150:head", 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'150", 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4826.0:1", 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:39:36.531178+0000", 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:40:24.501 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:40:24.502 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.502 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:40:24.502 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:40:24.502 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:40:24.502 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:40:24.502 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:40:24.502 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:40:24.502 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:40:24.502 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:40:24.502 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:40:24.502 INFO:tasks.workunit.client.0.smithi026.stdout: "dups": [ 2024-09-16T03:40:24.502 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.503 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4379.0:1", 2024-09-16T03:40:24.503 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'1", 2024-09-16T03:40:24.503 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "1", 2024-09-16T03:40:24.503 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.503 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.503 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.503 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4382.0:1", 2024-09-16T03:40:24.503 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'2", 2024-09-16T03:40:24.503 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "2", 2024-09-16T03:40:24.503 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.503 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.503 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4385.0:1", 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'3", 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "3", 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4388.0:1", 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'4", 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "4", 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.504 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4391.0:1", 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'5", 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "5", 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4394.0:1", 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'6", 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "6", 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4397.0:1", 2024-09-16T03:40:24.505 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'7", 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "7", 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4400.0:1", 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'8", 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "8", 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4403.0:1", 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'9", 2024-09-16T03:40:24.506 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "9", 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4406.0:1", 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'10", 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "10", 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4409.0:1", 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'11", 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "11", 2024-09-16T03:40:24.507 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4412.0:1", 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'12", 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "12", 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4415.0:1", 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'13", 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "13", 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.508 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4418.0:1", 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'14", 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "14", 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4421.0:1", 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'15", 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "15", 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.509 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4424.0:1", 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'16", 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "16", 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4427.0:1", 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'17", 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "17", 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4430.0:1", 2024-09-16T03:40:24.510 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'18", 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "18", 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4433.0:1", 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'19", 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "19", 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4436.0:1", 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'20", 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "20", 2024-09-16T03:40:24.511 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4439.0:1", 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'21", 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "21", 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4442.0:1", 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'22", 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "22", 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.512 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4445.0:1", 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'23", 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "23", 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4448.0:1", 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'24", 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "24", 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.513 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4451.0:1", 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'25", 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "25", 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4454.0:1", 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'26", 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "26", 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4457.0:1", 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'27", 2024-09-16T03:40:24.514 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "27", 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4460.0:1", 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'28", 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "28", 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4463.0:1", 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'29", 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "29", 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.515 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4466.0:1", 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'30", 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "30", 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4469.0:1", 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'31", 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "31", 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4472.0:1", 2024-09-16T03:40:24.516 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'32", 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "32", 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4475.0:1", 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'33", 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "33", 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4478.0:1", 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'34", 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "34", 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.517 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4481.0:1", 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'35", 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "35", 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4484.0:1", 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'36", 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "36", 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.518 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4487.0:1", 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'37", 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "37", 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4490.0:1", 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'38", 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "38", 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4493.0:1", 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'39", 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "39", 2024-09-16T03:40:24.519 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4496.0:1", 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'40", 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "40", 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4499.0:1", 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'41", 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "41", 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.520 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4502.0:1", 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'42", 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "42", 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4505.0:1", 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'43", 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "43", 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4508.0:1", 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'44", 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "44", 2024-09-16T03:40:24.521 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4511.0:1", 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'45", 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "45", 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4514.0:1", 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'46", 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "46", 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.522 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4517.0:1", 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'47", 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "47", 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4520.0:1", 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'48", 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "48", 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4523.0:1", 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'49", 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "49", 2024-09-16T03:40:24.523 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4526.0:1", 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'50", 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "50", 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4529.0:1", 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'51", 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "51", 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.524 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4532.0:1", 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'52", 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "52", 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4535.0:1", 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'53", 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "53", 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.525 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4538.0:1", 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'54", 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "54", 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4541.0:1", 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'55", 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "55", 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4544.0:1", 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'56", 2024-09-16T03:40:24.526 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "56", 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4547.0:1", 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'57", 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "57", 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4550.0:1", 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'58", 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "58", 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.527 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4553.0:1", 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'59", 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "59", 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4556.0:1", 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'60", 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "60", 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.528 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4559.0:1", 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'61", 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "61", 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4562.0:1", 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'62", 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "62", 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4565.0:1", 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'63", 2024-09-16T03:40:24.529 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "63", 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4568.0:1", 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'64", 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "64", 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4571.0:1", 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'65", 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "65", 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.530 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4574.0:1", 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'66", 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "66", 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4577.0:1", 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'67", 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "67", 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4580.0:1", 2024-09-16T03:40:24.531 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'68", 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "68", 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4583.0:1", 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'69", 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "69", 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4586.0:1", 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'70", 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "70", 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.532 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4589.0:1", 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'71", 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "71", 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4592.0:1", 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'72", 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "72", 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4595.0:1", 2024-09-16T03:40:24.533 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'73", 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "73", 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4598.0:1", 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'74", 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "74", 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4601.0:1", 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'75", 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "75", 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.534 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4604.0:1", 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'76", 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "76", 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4607.0:1", 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'77", 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "77", 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4610.0:1", 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'78", 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "78", 2024-09-16T03:40:24.535 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4613.0:1", 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'79", 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "79", 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4616.0:1", 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'80", 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "80", 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.536 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4619.0:1", 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'81", 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "81", 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4622.0:1", 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'82", 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "82", 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4625.0:1", 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'83", 2024-09-16T03:40:24.537 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "83", 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4628.0:1", 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'84", 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "84", 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4631.0:1", 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'85", 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "85", 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.538 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4634.0:1", 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'86", 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "86", 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4637.0:1", 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'87", 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "87", 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4640.0:1", 2024-09-16T03:40:24.539 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'88", 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "88", 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4643.0:1", 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'89", 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "89", 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4646.0:1", 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'90", 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "90", 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.540 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4649.0:1", 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'91", 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "91", 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4652.0:1", 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'92", 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "92", 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4655.0:1", 2024-09-16T03:40:24.541 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'93", 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "93", 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4658.0:1", 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'94", 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "94", 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4661.0:1", 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'95", 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "95", 2024-09-16T03:40:24.542 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4664.0:1", 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'96", 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "96", 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4667.0:1", 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'97", 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "97", 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.543 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4670.0:1", 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'98", 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "98", 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4673.0:1", 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'99", 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "99", 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.544 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4676.0:1", 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'100", 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "100", 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4679.0:1", 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'101", 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "101", 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4682.0:1", 2024-09-16T03:40:24.545 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'102", 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "102", 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4685.0:1", 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'103", 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "103", 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4688.0:1", 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'104", 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "104", 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.546 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4691.0:1", 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'105", 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "105", 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4694.0:1", 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'106", 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "106", 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.547 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4697.0:1", 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'107", 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "107", 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4700.0:1", 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'108", 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "108", 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4703.0:1", 2024-09-16T03:40:24.548 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'109", 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "109", 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4706.0:1", 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'110", 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "110", 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4709.0:1", 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'111", 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "111", 2024-09-16T03:40:24.549 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4712.0:1", 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'112", 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "112", 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4715.0:1", 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'113", 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "113", 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.550 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4718.0:1", 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'114", 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "114", 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4721.0:1", 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'115", 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "115", 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4724.0:1", 2024-09-16T03:40:24.551 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'116", 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "116", 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4727.0:1", 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'117", 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "117", 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4730.0:1", 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'118", 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "118", 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.552 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4733.0:1", 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'119", 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "119", 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4736.0:1", 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'120", 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "120", 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.553 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4739.0:1", 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'121", 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "121", 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4742.0:1", 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'122", 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "122", 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4745.0:1", 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'123", 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "123", 2024-09-16T03:40:24.554 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4748.0:1", 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'124", 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "124", 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4751.0:1", 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'125", 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "125", 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.555 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4754.0:1", 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'126", 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "126", 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4757.0:1", 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'127", 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "127", 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4760.0:1", 2024-09-16T03:40:24.556 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'128", 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "128", 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4763.0:1", 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'129", 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "129", 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4766.0:1", 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'130", 2024-09-16T03:40:24.557 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "130", 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4769.0:1", 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'131", 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "131", 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4772.0:1", 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'132", 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "132", 2024-09-16T03:40:24.558 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4775.0:1", 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'133", 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "133", 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4778.0:1", 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'134", 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "134", 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.559 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4781.0:1", 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'135", 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "135", 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4784.0:1", 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'136", 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "136", 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.560 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4787.0:1", 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'137", 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "137", 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4790.0:1", 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'138", 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "138", 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4793.0:1", 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'139", 2024-09-16T03:40:24.561 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "139", 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4796.0:1", 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'140", 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "140", 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4799.0:1", 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'141", 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "141", 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.562 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4802.0:1", 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'142", 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "142", 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4805.0:1", 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'143", 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "143", 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4808.0:1", 2024-09-16T03:40:24.563 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'144", 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "144", 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4811.0:1", 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'145", 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "145", 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4814.0:1", 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'146", 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "146", 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.564 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.565 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.565 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4817.0:1", 2024-09-16T03:40:24.565 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'147", 2024-09-16T03:40:24.761 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "147", 2024-09-16T03:40:24.761 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4820.0:1", 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "33'148", 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "148", 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: "pg_missing_t": { 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: "missing": [], 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: "may_include_deletes": true 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:40:24.762 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:40:24.764 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: jq '.pg_log_t.log | length' td/osd-backfill-recovery-log/result.log 2024-09-16T03:40:24.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: LOGLEN=2 2024-09-16T03:40:24.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:86: _common_test: '[' 2 '!=' 2 ']' 2024-09-16T03:40:24.768 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: jq '.pg_log_t.dups | length' td/osd-backfill-recovery-log/result.log 2024-09-16T03:40:24.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: DUPSLEN=148 2024-09-16T03:40:24.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:91: _common_test: '[' 148 '!=' 148 ']' 2024-09-16T03:40:24.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:95: _common_test: grep 'copy_up_to\|copy_after' td/osd-backfill-recovery-log/osd.0.log td/osd-backfill-recovery-log/osd.1.log td/osd-backfill-recovery-log/osd.2.log td/osd-backfill-recovery-log/osd.3.log td/osd-backfill-recovery-log/osd.4.log td/osd-backfill-recovery-log/osd.5.log 2024-09-16T03:40:24.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to max 2 dups.size()=0 other.dups.size()=100 2024-09-16T03:40:24.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to copy log version 33'150 2024-09-16T03:40:24.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to copy log version 33'149 2024-09-16T03:40:24.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 32'1 2024-09-16T03:40:24.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'2 2024-09-16T03:40:24.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'3 2024-09-16T03:40:24.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'4 2024-09-16T03:40:24.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'5 2024-09-16T03:40:24.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'6 2024-09-16T03:40:24.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'7 2024-09-16T03:40:24.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'8 2024-09-16T03:40:24.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'9 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'10 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'11 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'12 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'13 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'14 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'15 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'16 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'17 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'18 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'19 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'20 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'21 2024-09-16T03:40:24.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'22 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'23 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'24 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'25 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'26 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'27 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'28 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'29 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'30 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'31 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'32 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'33 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'34 2024-09-16T03:40:24.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'35 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'36 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'37 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'38 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'39 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'40 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'41 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'42 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'43 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'44 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'45 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'46 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'47 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'48 2024-09-16T03:40:24.779 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'49 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'50 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'51 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'52 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'53 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'54 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'55 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'56 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'57 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'58 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'59 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'60 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'61 2024-09-16T03:40:24.780 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'62 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'63 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'64 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'65 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'66 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'67 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'68 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'69 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'70 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'71 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'72 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'73 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'74 2024-09-16T03:40:24.781 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'75 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'76 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'77 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'78 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'79 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'80 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'81 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'82 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'83 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'84 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'85 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'86 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'87 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'88 2024-09-16T03:40:24.782 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'89 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'90 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'91 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'92 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'93 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'94 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'95 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'96 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'97 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'98 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'99 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'100 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'101 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'102 2024-09-16T03:40:24.783 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'103 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'104 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'105 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'106 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'107 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'108 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'109 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'110 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'111 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'112 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'113 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'114 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'115 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'116 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'117 2024-09-16T03:40:24.784 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'118 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'119 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'120 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'121 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'122 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'123 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'124 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'125 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'126 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'127 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'128 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'129 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'130 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'131 2024-09-16T03:40:24.785 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'132 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'133 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'134 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'135 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'136 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'137 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'138 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'139 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'140 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'141 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'142 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'143 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'144 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'145 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'146 2024-09-16T03:40:24.786 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'147 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'148 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to END max 2 dups.size()=148 other.dups.size()=100 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to max 2 dups.size()=0 other.dups.size()=100 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to copy log version 33'150 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to copy log version 33'149 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 32'1 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'2 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'3 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'4 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'5 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'6 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'7 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'8 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'9 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'10 2024-09-16T03:40:24.787 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'11 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'12 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'13 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'14 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'15 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'16 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'17 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'18 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'19 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'20 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'21 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'22 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'23 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'24 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'25 2024-09-16T03:40:24.788 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'26 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'27 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'28 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'29 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'30 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'31 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'32 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'33 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'34 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'35 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'36 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'37 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'38 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'39 2024-09-16T03:40:24.789 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'40 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'41 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'42 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'43 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'44 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'45 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'46 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'47 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'48 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'49 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'50 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'51 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'52 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'53 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'54 2024-09-16T03:40:24.790 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'55 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'56 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'57 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'58 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'59 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'60 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'61 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'62 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'63 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'64 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'65 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'66 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'67 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'68 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'69 2024-09-16T03:40:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'70 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'71 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'72 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'73 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'74 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'75 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'76 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'77 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'78 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'79 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'80 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'81 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'82 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'83 2024-09-16T03:40:24.792 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'84 2024-09-16T03:40:24.793 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'85 2024-09-16T03:40:24.793 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'86 2024-09-16T03:40:24.793 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'87 2024-09-16T03:40:24.793 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'88 2024-09-16T03:40:24.793 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'89 2024-09-16T03:40:24.793 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'90 2024-09-16T03:40:24.793 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'91 2024-09-16T03:40:24.793 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'92 2024-09-16T03:40:24.793 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'93 2024-09-16T03:40:24.793 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'94 2024-09-16T03:40:24.793 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'95 2024-09-16T03:40:24.793 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'96 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'97 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'98 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'99 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'100 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'101 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'102 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'103 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'104 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'105 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'106 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'107 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'108 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'109 2024-09-16T03:40:24.794 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'110 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'111 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'112 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'113 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'114 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'115 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'116 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'117 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'118 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'119 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'120 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'121 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'122 2024-09-16T03:40:24.795 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'123 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'124 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'125 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'126 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'127 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'128 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'129 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'130 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'131 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'132 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'133 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'134 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'135 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'136 2024-09-16T03:40:24.796 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'137 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'138 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'139 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'140 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'141 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'142 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'143 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'144 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'145 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'146 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'147 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'148 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to END max 2 dups.size()=148 other.dups.size()=100 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to max 2 dups.size()=0 other.dups.size()=100 2024-09-16T03:40:24.797 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to copy log version 33'150 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to copy log version 33'149 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 32'1 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'2 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'3 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'4 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'5 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'6 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'7 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'8 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'9 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'10 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'11 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'12 2024-09-16T03:40:24.798 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'13 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'14 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'15 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'16 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'17 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'18 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'19 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'20 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'21 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'22 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'23 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'24 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'25 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'26 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'27 2024-09-16T03:40:24.799 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'28 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'29 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'30 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'31 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'32 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'33 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'34 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'35 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'36 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'37 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'38 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'39 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'40 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'41 2024-09-16T03:40:24.800 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'42 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'43 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'44 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'45 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'46 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'47 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'48 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'49 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'50 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'51 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'52 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'53 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'54 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'55 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'56 2024-09-16T03:40:24.801 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'57 2024-09-16T03:40:24.802 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'58 2024-09-16T03:40:24.802 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'59 2024-09-16T03:40:24.802 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'60 2024-09-16T03:40:24.802 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'61 2024-09-16T03:40:24.802 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'62 2024-09-16T03:40:24.802 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'63 2024-09-16T03:40:24.802 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'64 2024-09-16T03:40:24.802 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'65 2024-09-16T03:40:24.802 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'66 2024-09-16T03:40:24.802 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'67 2024-09-16T03:40:24.802 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'68 2024-09-16T03:40:24.802 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'69 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'70 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'71 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'72 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'73 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'74 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'75 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'76 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'77 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'78 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'79 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'80 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'81 2024-09-16T03:40:24.803 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'82 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'83 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'84 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'85 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'86 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'87 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'88 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'89 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'90 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'91 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'92 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'93 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'94 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'95 2024-09-16T03:40:24.804 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'96 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'97 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'98 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'99 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'100 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'101 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'102 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'103 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'104 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'105 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'106 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'107 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'108 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'109 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'110 2024-09-16T03:40:24.805 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'111 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'112 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'113 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'114 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'115 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'116 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'117 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'118 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'119 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'120 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'121 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'122 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'123 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'124 2024-09-16T03:40:24.806 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'125 2024-09-16T03:40:24.807 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'126 2024-09-16T03:40:24.807 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'127 2024-09-16T03:40:24.807 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'128 2024-09-16T03:40:24.808 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'129 2024-09-16T03:40:24.808 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'130 2024-09-16T03:40:24.808 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'131 2024-09-16T03:40:24.808 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'132 2024-09-16T03:40:24.808 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'133 2024-09-16T03:40:24.808 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'134 2024-09-16T03:40:24.808 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'135 2024-09-16T03:40:24.808 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'136 2024-09-16T03:40:24.808 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'137 2024-09-16T03:40:24.808 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'138 2024-09-16T03:40:24.808 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'139 2024-09-16T03:40:24.808 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'140 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'141 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'142 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'143 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'144 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'145 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'146 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'147 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'148 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:39:38.815+0000 7f9666869640 20 copy_up_to END max 2 dups.size()=148 other.dups.size()=100 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_after v 33'150 dups.size()=0 other.dups.size()=100 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 32'1 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'2 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'3 2024-09-16T03:40:24.809 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'4 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'5 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'6 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'7 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'8 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'9 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'10 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'11 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'12 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'13 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'14 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'15 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'16 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'17 2024-09-16T03:40:24.810 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'18 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'19 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'20 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'21 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'22 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'23 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'24 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'25 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'26 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'27 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'28 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'29 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'30 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'31 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'32 2024-09-16T03:40:24.811 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'33 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'34 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'35 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'36 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'37 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'38 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'39 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'40 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'41 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'42 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'43 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'44 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'45 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'46 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'47 2024-09-16T03:40:24.812 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'48 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'49 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'50 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'51 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'52 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'53 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'54 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'55 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'56 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'57 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'58 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'59 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'60 2024-09-16T03:40:24.813 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'61 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'62 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'63 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'64 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'65 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'66 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'67 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'68 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'69 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'70 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'71 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'72 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'73 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'74 2024-09-16T03:40:24.814 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'75 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'76 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'77 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'78 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'79 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'80 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'81 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'82 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'83 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'84 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'85 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'86 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'87 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'88 2024-09-16T03:40:24.815 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'89 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'90 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'91 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'92 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'93 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'94 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'95 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'96 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'97 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'98 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'99 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup version 33'100 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'101 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'102 2024-09-16T03:40:24.816 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'103 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'104 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'105 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'106 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'107 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'108 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'109 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'110 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'111 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'112 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'113 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'114 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'115 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'116 2024-09-16T03:40:24.817 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'117 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'118 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'119 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'120 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'121 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'122 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'123 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'124 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'125 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'126 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'127 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'128 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'129 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'130 2024-09-16T03:40:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'131 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'132 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'133 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'134 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'135 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'136 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'137 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'138 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'139 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'140 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'141 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'142 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'143 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'144 2024-09-16T03:40:24.819 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'145 2024-09-16T03:40:24.820 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'146 2024-09-16T03:40:24.820 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'147 2024-09-16T03:40:24.820 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'148 2024-09-16T03:40:24.820 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'149 2024-09-16T03:40:24.820 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_up_to/copy_after copy dup from log version 33'150 2024-09-16T03:40:24.820 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:40:06.730+0000 7f9666869640 20 copy_after END v 33'150 dups.size()=150 other.dups.size()=100 2024-09-16T03:40:24.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:96: _common_test: rm -f td/osd-backfill-recovery-log/result.log 2024-09-16T03:40:24.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:97: _common_test: '[' 0 '!=' 0 ']' 2024-09-16T03:40:24.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:35: run: teardown td/osd-backfill-recovery-log 2024-09-16T03:40:24.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:40:24.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:40:24.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-09-16T03:40:24.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:40:24.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:40:24.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:40:24.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:40:24.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:40:24.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:40:24.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-recovery-log 2024-09-16T03:40:24.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:40:24.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:40:24.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:40:24.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.53196 2024-09-16T03:40:24.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:40:24.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:40:24.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:32: run: for func in $funcs 2024-09-16T03:40:24.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:33: run: setup td/osd-backfill-recovery-log 2024-09-16T03:40:24.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-recovery-log 2024-09-16T03:40:24.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-recovery-log 2024-09-16T03:40:24.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:40:24.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:40:24.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-09-16T03:40:24.861 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:40:24.861 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:40:24.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:40:24.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:40:24.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:40:24.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:40:24.862 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:40:24.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:40:24.863 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:40:24.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:40:24.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:40:24.865 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:40:24.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:40:24.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:40:24.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:40:24.866 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:40:24.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:40:24.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:40:24.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-recovery-log 2024-09-16T03:40:24.869 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:40:24.869 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:40:24.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:40:24.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.53196 2024-09-16T03:40:24.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:40:24.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:40:24.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-recovery-log 2024-09-16T03:40:24.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:40:24.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:40:24.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:40:24.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.53196 2024-09-16T03:40:24.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:40:24.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:40:24.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:40:24.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-recovery-log 1' TERM HUP INT 2024-09-16T03:40:24.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:34: run: TEST_recovery_1 td/osd-backfill-recovery-log 2024-09-16T03:40:24.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:122: TEST_recovery_1: local dir=td/osd-backfill-recovery-log 2024-09-16T03:40:24.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:124: TEST_recovery_1: _common_test td/osd-backfill-recovery-log '--osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 40 0 40 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:41: _common_test: local dir=td/osd-backfill-recovery-log 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:42: _common_test: local 'extra_opts=--osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:43: _common_test: local loglen=40 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:44: _common_test: local dupslen=0 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:45: _common_test: local objects=40 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:46: _common_test: local moreobjects=0 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:48: _common_test: local OSDS=6 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:50: _common_test: run_mon td/osd-backfill-recovery-log a 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-recovery-log 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-recovery-log/a 2024-09-16T03:40:24.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-recovery-log/a --run-dir=td/osd-backfill-recovery-log 2024-09-16T03:40:25.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:40:25.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:40:25.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:40:25.347 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:40:25.347 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:40:25.347 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:40:25.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:40:25.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-recovery-log/a '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-recovery-log/log --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:40:25.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:40:25.540 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:40:25.540 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:40:25.540 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:40:25.540 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:40:25.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:40:25.542 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:40:25.542 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:40:25.542 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:40:25.542 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:40:25.542 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:40:25.542 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:40:25.542 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.53196/ceph-mon.a.asok 2024-09-16T03:40:25.542 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:40:25.542 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.53196/ceph-mon.a.asok config get fsid 2024-09-16T03:40:25.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:40:25.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:40:25.635 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:40:25.635 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:40:25.635 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:40:25.635 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:40:25.635 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:40:25.635 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:40:25.636 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:40:25.636 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:40:25.636 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:40:25.636 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.53196/ceph-mon.a.asok 2024-09-16T03:40:25.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:40:25.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.53196/ceph-mon.a.asok config get mon_host 2024-09-16T03:40:25.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:51: _common_test: run_mgr td/osd-backfill-recovery-log x 2024-09-16T03:40:25.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-recovery-log 2024-09-16T03:40:25.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:40:25.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:40:25.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:40:25.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-recovery-log/x 2024-09-16T03:40:25.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:40:26.580 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:40:26.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:40:26.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:40:26.650 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:40:26.650 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:40:26.650 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:40:26.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:40:26.654 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:40:26.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd_min_pg_log_entries=1 --osd_max_pg_log_entries=2 --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-recovery-log/x '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:40:26.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:52: _common_test: export CEPH_ARGS 2024-09-16T03:40:26.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: export 'EXTRA_OPTS= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-09-16T03:40:26.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: EXTRA_OPTS=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: expr 6 - 1 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: seq 0 5 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 0 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/0 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:40:26.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/0' 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/0/journal' 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:40:26.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:40:26.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:40:26.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:40:26.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:40:26.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:40:26.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:40:26.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:40:26.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:40:26.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:40:26.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:40:26.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:40:26.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/0 2024-09-16T03:40:26.660 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:40:26.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4a3ae3c6-0b88-4943-95b4-699c33c7564a 2024-09-16T03:40:26.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 4a3ae3c6-0b88-4943-95b4-699c33c7564a' 2024-09-16T03:40:26.660 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 4a3ae3c6-0b88-4943-95b4-699c33c7564a 2024-09-16T03:40:26.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:40:26.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCqqOdmlKv/JRAAr9QXxZAZZKQ5XkHxrw666A== 2024-09-16T03:40:26.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCqqOdmlKv/JRAAr9QXxZAZZKQ5XkHxrw666A=="}' 2024-09-16T03:40:26.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4a3ae3c6-0b88-4943-95b4-699c33c7564a -i td/osd-backfill-recovery-log/0/new.json 2024-09-16T03:40:26.888 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:40:26.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/0/new.json 2024-09-16T03:40:26.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCqqOdmlKv/JRAAr9QXxZAZZKQ5XkHxrw666A== --osd-uuid 4a3ae3c6-0b88-4943-95b4-699c33c7564a 2024-09-16T03:40:26.935 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:40:26.933+0000 7fcbb6e14640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:40:26.948 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:40:26.947+0000 7fcbb6e14640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:40:26.950 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:40:26.948+0000 7fcbb6e14640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:40:26.950 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:40:26.948+0000 7fcbb6e14640 -1 bdev(0x55e6683d9c00 td/osd-backfill-recovery-log/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:40:26.950 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:40:26.949+0000 7fcbb6e14640 -1 bluestore(td/osd-backfill-recovery-log/0) _read_fsid unparsable uuid 2024-09-16T03:40:32.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/0/keyring 2024-09-16T03:40:32.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:40:32.467 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T03:40:32.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:40:32.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:40:33.037 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T03:40:33.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:40:33.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:40:33.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:40:33.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:40:33.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:40:33.070 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:40:33.069+0000 7f24a9589640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:40:33.072 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:40:33.071+0000 7f24a9589640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:40:33.073 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:40:33.072+0000 7f24a9589640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:40:33.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:40:33.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:40:33.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:40:33.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:40:33.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:40:33.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:33.484 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:40:33.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:40:33.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:33.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:33.910 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:40:33.909+0000 7f24a9589640 -1 Falling back to public interface 2024-09-16T03:40:33.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:34.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:34.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:34.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:40:34.919 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:40:34.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:34.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:35.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:36.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:36.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:36.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:40:36.362 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:40:36.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:36.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:36.546 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:40:36.544+0000 7f24a9589640 -1 osd.0 0 log_to_monitors true 2024-09-16T03:40:36.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:37.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:37.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:37.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:40:37.807 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:40:37.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:37.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:38.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:39.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:39.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:39.330 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:40:39.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:40:39.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:39.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:39.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:40.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:40.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:40.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:40:40.748 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:40:40.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:40.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:41.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:42.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:42.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:42.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:40:42.166 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:40:42.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:42.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:42.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:43.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:43.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:43.604 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:40:43.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:40:43.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:43.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:44.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:45.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:45.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:45.035 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:40:45.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:40:45.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:45.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:45.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:46.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:46.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:46.485 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:40:46.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:40:46.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:46.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:46.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:47.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:47.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:47.934 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:40:47.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:40:47.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:47.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:48.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:49.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:49.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:49.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:40:49.604 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:40:49.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:49.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:50.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:51.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:51.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:51.327 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:40:51.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:40:51.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:51.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:51.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:52.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:52.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:52.993 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:40:52.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:40:52.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:52.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:53.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:54.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:54.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:54.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:40:54.415 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:40:54.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:54.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:55.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:56.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:56.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:56.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:40:56.315 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:40:56.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:56.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:56.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:57.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:57.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:57.748 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:40:57.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:40:57.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:57.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:58.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:40:59.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:40:59.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:40:59.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:40:59.380 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:40:59.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:40:59.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:40:59.807 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3283441899,v1:127.0.0.1:6803/3283441899] [v2:127.0.0.1:6804/3283441899,v1:127.0.0.1:6805/3283441899] exists,up 4a3ae3c6-0b88-4943-95b4-699c33c7564a 2024-09-16T03:40:59.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:40:59.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:40:59.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:40:59.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:40:59.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 1 2024-09-16T03:40:59.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/1 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/1' 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/1/journal' 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-09-16T03:40:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:40:59.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:40:59.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:40:59.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:40:59.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:40:59.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:40:59.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:40:59.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:40:59.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/1 2024-09-16T03:40:59.814 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:40:59.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4793ab4d-ba56-4916-9d96-3f2c1f081918 2024-09-16T03:40:59.814 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 4793ab4d-ba56-4916-9d96-3f2c1f081918 2024-09-16T03:40:59.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 4793ab4d-ba56-4916-9d96-3f2c1f081918' 2024-09-16T03:40:59.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:40:59.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDLqOdmxHV7MRAAogyGfrZLpCorNKAHS+o2Ig== 2024-09-16T03:40:59.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDLqOdmxHV7MRAAogyGfrZLpCorNKAHS+o2Ig=="}' 2024-09-16T03:40:59.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4793ab4d-ba56-4916-9d96-3f2c1f081918 -i td/osd-backfill-recovery-log/1/new.json 2024-09-16T03:41:00.314 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:41:00.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/1/new.json 2024-09-16T03:41:00.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDLqOdmxHV7MRAAogyGfrZLpCorNKAHS+o2Ig== --osd-uuid 4793ab4d-ba56-4916-9d96-3f2c1f081918 2024-09-16T03:41:00.361 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:00.360+0000 7f05c87c1640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:41:00.363 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:00.362+0000 7f05c87c1640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:41:00.364 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:00.363+0000 7f05c87c1640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:41:00.365 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:00.363+0000 7f05c87c1640 -1 bdev(0x5623dcd8bc00 td/osd-backfill-recovery-log/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:41:00.365 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:00.363+0000 7f05c87c1640 -1 bluestore(td/osd-backfill-recovery-log/1) _read_fsid unparsable uuid 2024-09-16T03:41:05.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/1/keyring 2024-09-16T03:41:05.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:41:05.774 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T03:41:05.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:41:05.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:41:06.335 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T03:41:06.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:41:06.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:41:06.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:41:06.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:41:06.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:41:06.369 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:06.366+0000 7f3f6a83b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:41:06.370 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:06.368+0000 7f3f6a83b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:41:06.372 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:06.369+0000 7f3f6a83b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:41:06.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:41:06.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:41:06.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:41:06.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:41:06.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:41:06.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:06.783 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:41:06.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:41:06.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:06.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:07.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:07.960 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:07.957+0000 7f3f6a83b640 -1 Falling back to public interface 2024-09-16T03:41:08.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:08.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:08.235 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:41:08.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:41:08.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:08.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:08.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:09.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:09.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:09.686 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:41:09.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:41:09.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:09.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:10.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:11.133 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:11.130+0000 7f3f6a83b640 -1 osd.1 0 log_to_monitors true 2024-09-16T03:41:11.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:11.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:11.139 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:41:11.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:41:11.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:11.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:11.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:12.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:12.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:12.636 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:41:12.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:41:12.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:12.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:13.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:14.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:14.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:14.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:41:14.166 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:41:14.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:14.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:14.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:15.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:15.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:15.597 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:41:15.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:41:15.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:15.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:16.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:17.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:17.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:17.070 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:41:17.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:41:17.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:17.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:17.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:18.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:18.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:18.487 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:41:18.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:41:18.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:18.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:19.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:20.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:20.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:20.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:41:20.008 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:41:20.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:20.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:20.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:21.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:21.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:21.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:41:21.430 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:41:21.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:21.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:22.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:23.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:23.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:23.005 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:41:23.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:41:23.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:23.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:24.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:25.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:25.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:25.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:41:25.050 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:41:25.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:25.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:25.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:26.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:26.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:26.772 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:41:26.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:41:26.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:26.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:27.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:28.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:28.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:28.196 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:41:28.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:41:28.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:28.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:29.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:30.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:30.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:30.065 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:41:30.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:41:30.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:30.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:30.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:31.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:31.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:31.765 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:41:31.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:41:31.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:31.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:32.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:33.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:33.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:33.424 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:41:33.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:41:33.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:33.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:41:33.842 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3139714651,v1:127.0.0.1:6811/3139714651] [v2:127.0.0.1:6812/3139714651,v1:127.0.0.1:6813/3139714651] exists,up 4793ab4d-ba56-4916-9d96-3f2c1f081918 2024-09-16T03:41:33.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:41:33.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:41:33.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:41:33.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:41:33.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 2 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/2 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/2' 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/2/journal' 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:41:33.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:41:33.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:41:33.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:41:33.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:41:33.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:41:33.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:41:33.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:41:33.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:41:33.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:41:33.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/2 2024-09-16T03:41:33.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:41:33.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6d1c950e-2690-4444-b5eb-1050b1486501 2024-09-16T03:41:33.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 6d1c950e-2690-4444-b5eb-1050b1486501' 2024-09-16T03:41:33.853 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 6d1c950e-2690-4444-b5eb-1050b1486501 2024-09-16T03:41:33.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:41:33.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDtqOdmPXiQMxAArVjEB3NUq9pkktHSkDuZJg== 2024-09-16T03:41:33.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDtqOdmPXiQMxAArVjEB3NUq9pkktHSkDuZJg=="}' 2024-09-16T03:41:33.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6d1c950e-2690-4444-b5eb-1050b1486501 -i td/osd-backfill-recovery-log/2/new.json 2024-09-16T03:41:34.386 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:41:34.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/2/new.json 2024-09-16T03:41:34.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDtqOdmPXiQMxAArVjEB3NUq9pkktHSkDuZJg== --osd-uuid 6d1c950e-2690-4444-b5eb-1050b1486501 2024-09-16T03:41:34.433 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:34.431+0000 7fa0c8a33640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:41:34.435 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:34.433+0000 7fa0c8a33640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:41:34.436 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:34.434+0000 7fa0c8a33640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:41:34.437 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:34.435+0000 7fa0c8a33640 -1 bdev(0x556d401dbc00 td/osd-backfill-recovery-log/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:41:34.437 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:34.435+0000 7fa0c8a33640 -1 bluestore(td/osd-backfill-recovery-log/2) _read_fsid unparsable uuid 2024-09-16T03:41:40.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/2/keyring 2024-09-16T03:41:40.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:41:40.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:41:40.063 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T03:41:40.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:41:40.630 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T03:41:40.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:41:40.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:41:40.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:41:40.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:41:40.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:41:40.664 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:40.663+0000 7f071c334640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:41:40.671 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:40.669+0000 7f071c334640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:41:40.672 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:40.670+0000 7f071c334640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:41:41.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:41:41.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:41:41.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:41:41.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:41:41.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:41:41.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:41.061 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:41:41.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:41:41.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:41.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:41:41.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:41.511 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:41.510+0000 7f071c334640 -1 Falling back to public interface 2024-09-16T03:41:42.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:42.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:42.487 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:41:42.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:41:42.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:42.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:41:42.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:43.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:43.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:43.903 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:41:43.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:41:43.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:43.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:41:44.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:44.324 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:41:44.322+0000 7f071c334640 -1 osd.2 0 log_to_monitors true 2024-09-16T03:41:45.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:45.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:45.320 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:41:45.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:41:45.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:45.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:41:45.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:46.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:46.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:46.754 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:41:46.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:41:46.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:46.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:41:47.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:48.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:48.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:48.231 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:41:48.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:41:48.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:48.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:41:48.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:49.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:49.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:49.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:41:49.662 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:41:49.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:49.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:41:50.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:51.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:51.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:51.100 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:41:51.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:41:51.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:51.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:41:51.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:52.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:52.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:52.556 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:41:52.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:41:52.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:52.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:41:53.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:54.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:54.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:54.022 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:41:54.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:41:54.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:54.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:41:54.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:55.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:55.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:55.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:41:55.449 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:41:55.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:55.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:41:55.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:56.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:56.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:56.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:41:56.966 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:41:56.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:56.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:41:57.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:41:58.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:41:58.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:41:58.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:41:58.940 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:41:58.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:41:58.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:42:00.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:01.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:01.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:01.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:42:01.111 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:42:01.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:01.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:42:01.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:02.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:02.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:02.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:42:02.857 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:42:02.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:02.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:42:03.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:04.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:04.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:04.500 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:42:04.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:42:04.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:04.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:42:05.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:06.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:06.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:06.259 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:42:06.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:42:06.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:06.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:42:06.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:07.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:07.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:07.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:42:07.955 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:42:07.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:07.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:42:08.374 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/151743610,v1:127.0.0.1:6819/151743610] [v2:127.0.0.1:6820/151743610,v1:127.0.0.1:6821/151743610] exists,up 6d1c950e-2690-4444-b5eb-1050b1486501 2024-09-16T03:42:08.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:42:08.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:42:08.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:42:08.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:42:08.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 3 2024-09-16T03:42:08.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:42:08.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:42:08.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T03:42:08.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:42:08.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/3 2024-09-16T03:42:08.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:42:08.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:42:08.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:42:08.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:42:08.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/3' 2024-09-16T03:42:08.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/3/journal' 2024-09-16T03:42:08.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:42:08.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-09-16T03:42:08.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:42:08.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:42:08.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:42:08.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:42:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:42:08.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:42:08.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:42:08.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/3 2024-09-16T03:42:08.383 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:42:08.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3b20e66c-6ac8-498f-a684-4c3b9e525a32 2024-09-16T03:42:08.383 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 3b20e66c-6ac8-498f-a684-4c3b9e525a32 2024-09-16T03:42:08.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 3b20e66c-6ac8-498f-a684-4c3b9e525a32' 2024-09-16T03:42:08.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:42:08.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAQqedmpuCfFxAAAmIs8i0UW8UceJ6vv5MGDg== 2024-09-16T03:42:08.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAQqedmpuCfFxAAAmIs8i0UW8UceJ6vv5MGDg=="}' 2024-09-16T03:42:08.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3b20e66c-6ac8-498f-a684-4c3b9e525a32 -i td/osd-backfill-recovery-log/3/new.json 2024-09-16T03:42:08.915 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:42:08.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/3/new.json 2024-09-16T03:42:08.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAQqedmpuCfFxAAAmIs8i0UW8UceJ6vv5MGDg== --osd-uuid 3b20e66c-6ac8-498f-a684-4c3b9e525a32 2024-09-16T03:42:08.963 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:08.961+0000 7f7ff0a3b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:08.973 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:08.972+0000 7f7ff0a3b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:08.974 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:08.973+0000 7f7ff0a3b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:08.975 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:08.973+0000 7f7ff0a3b640 -1 bdev(0x55d379e35c00 td/osd-backfill-recovery-log/3/block) open stat got: (1) Operation not permitted 2024-09-16T03:42:08.975 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:08.973+0000 7f7ff0a3b640 -1 bluestore(td/osd-backfill-recovery-log/3) _read_fsid unparsable uuid 2024-09-16T03:42:15.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/3/keyring 2024-09-16T03:42:15.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:42:15.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T03:42:15.110 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T03:42:15.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:42:15.687 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T03:42:15.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T03:42:15.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:42:15.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:42:15.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:42:15.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:42:15.720 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:15.717+0000 7f447d239640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:15.722 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:15.719+0000 7f447d239640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:15.723 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:15.721+0000 7f447d239640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:16.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T03:42:16.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:42:16.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T03:42:16.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:42:16.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:42:16.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:16.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:42:16.139 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:42:16.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:16.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:16.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:17.080 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:17.077+0000 7f447d239640 -1 Falling back to public interface 2024-09-16T03:42:17.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:17.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:17.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:42:17.566 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:42:17.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:17.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:18.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:19.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:19.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:42:19.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:42:19.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:19.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:19.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:20.131 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:20.128+0000 7f447d239640 -1 osd.3 0 log_to_monitors true 2024-09-16T03:42:20.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:20.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:20.469 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:42:20.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:42:20.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:20.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:20.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:21.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:21.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:21.902 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:42:21.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:42:21.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:21.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:22.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:23.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:23.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:23.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:42:23.333 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:42:23.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:23.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:23.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:24.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:24.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:24.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:42:24.891 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:42:24.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:24.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:25.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:26.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:26.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:26.315 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:42:26.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:42:26.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:26.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:26.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:27.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:27.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:27.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:42:27.734 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:42:27.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:27.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:28.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:29.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:29.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:29.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:42:29.276 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:42:29.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:29.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:29.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:30.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:30.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:30.731 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:42:30.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:42:30.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:30.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:31.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:32.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:32.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:32.309 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:42:32.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:42:32.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:32.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:32.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:33.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:33.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:33.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:42:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:42:33.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:33.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:34.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:35.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:35.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:35.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:42:35.637 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:42:35.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:35.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:36.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:37.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:37.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:37.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:42:37.404 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:42:37.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:37.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:38.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:39.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:39.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:39.157 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:42:39.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:42:39.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:39.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:39.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:40.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:40.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:40.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:42:40.943 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:42:40.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:40.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:42.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:43.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:43.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:43.260 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:42:43.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:42:43.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:43.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:42:43.717 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2421926228,v1:127.0.0.1:6827/2421926228] [v2:127.0.0.1:6828/2421926228,v1:127.0.0.1:6829/2421926228] exists,up 3b20e66c-6ac8-498f-a684-4c3b9e525a32 2024-09-16T03:42:43.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:42:43.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 4 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/4 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:42:43.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/4' 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/4/journal' 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:42:43.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:42:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:42:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:42:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:42:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:42:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:42:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:42:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:42:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:42:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:42:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/4 2024-09-16T03:42:43.723 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:42:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=36410a93-9e5c-4123-8ec1-842c4857b6fc 2024-09-16T03:42:43.724 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 36410a93-9e5c-4123-8ec1-842c4857b6fc 2024-09-16T03:42:43.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 36410a93-9e5c-4123-8ec1-842c4857b6fc' 2024-09-16T03:42:43.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:42:43.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAzqedmz4wPLBAAOFjIOZdz/rQ/6M+qlJsm6A== 2024-09-16T03:42:43.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAzqedmz4wPLBAAOFjIOZdz/rQ/6M+qlJsm6A=="}' 2024-09-16T03:42:43.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 36410a93-9e5c-4123-8ec1-842c4857b6fc -i td/osd-backfill-recovery-log/4/new.json 2024-09-16T03:42:44.282 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:42:44.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/4/new.json 2024-09-16T03:42:44.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAzqedmz4wPLBAAOFjIOZdz/rQ/6M+qlJsm6A== --osd-uuid 36410a93-9e5c-4123-8ec1-842c4857b6fc 2024-09-16T03:42:44.329 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:44.327+0000 7f5a4a012640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:44.331 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:44.329+0000 7f5a4a012640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:44.332 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:44.330+0000 7f5a4a012640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:44.332 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:44.331+0000 7f5a4a012640 -1 bdev(0x560e2e6e9c00 td/osd-backfill-recovery-log/4/block) open stat got: (1) Operation not permitted 2024-09-16T03:42:44.332 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:44.331+0000 7f5a4a012640 -1 bluestore(td/osd-backfill-recovery-log/4) _read_fsid unparsable uuid 2024-09-16T03:42:50.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/4/keyring 2024-09-16T03:42:50.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:42:50.357 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T03:42:50.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T03:42:50.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:42:50.934 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T03:42:50.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T03:42:50.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:42:50.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:42:50.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:42:50.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:42:50.967 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:50.966+0000 7fbd6b842640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:50.969 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:50.968+0000 7fbd6b842640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:50.970 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:50.969+0000 7fbd6b842640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:42:51.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T03:42:51.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:42:51.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T03:42:51.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:42:51.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:42:51.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:51.369 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:42:51.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:42:51.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:51.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:42:51.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:52.070 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:52.069+0000 7fbd6b842640 -1 Falling back to public interface 2024-09-16T03:42:52.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:52.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:52.812 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:42:52.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:42:52.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:52.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:42:53.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:54.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:54.255 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:42:54.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:54.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:42:54.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:54.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:42:54.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:54.817 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:42:54.815+0000 7fbd6b842640 -1 osd.4 0 log_to_monitors true 2024-09-16T03:42:55.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:55.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:55.671 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:42:55.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:42:55.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:55.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:42:56.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:57.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:57.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:57.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:42:57.100 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:42:57.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:57.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:42:57.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:42:58.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:42:58.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:42:58.590 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:42:58.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:42:58.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:42:58.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:42:59.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:00.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:00.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:00.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:43:00.045 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:43:00.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:00.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:43:00.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:01.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:01.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:01.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:43:01.599 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:43:01.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:01.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:43:02.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:03.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:03.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:03.123 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:43:03.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:43:03.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:03.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:43:03.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:04.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:04.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:04.611 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:43:04.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:43:04.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:04.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:43:05.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:06.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:06.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:06.028 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:43:06.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:43:06.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:06.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:43:06.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:07.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:07.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:07.605 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:43:07.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:43:07.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:07.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:43:08.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:09.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:09.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:09.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:43:09.393 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:43:09.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:09.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:43:10.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:11.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:11.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:11.300 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:43:11.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:43:11.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:11.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:43:12.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:13.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:13.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:13.061 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:43:13.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:43:13.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:13.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:43:13.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:14.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:14.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:14.842 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:43:14.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:43:14.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:14.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:43:15.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:16.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:16.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:16.621 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:43:16.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:43:16.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:16.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:43:17.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:18.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:18.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:18.477 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:43:18.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:43:18.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:18.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:43:18.891 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2670326200,v1:127.0.0.1:6835/2670326200] [v2:127.0.0.1:6836/2670326200,v1:127.0.0.1:6837/2670326200] exists,up 36410a93-9e5c-4123-8ec1-842c4857b6fc 2024-09-16T03:43:18.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 5 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/5 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:43:18.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:43:18.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/5' 2024-09-16T03:43:18.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/5/journal' 2024-09-16T03:43:18.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:43:18.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10' 2024-09-16T03:43:18.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:43:18.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:43:18.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:43:18.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:43:18.897 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:43:18.897 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:43:18.897 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:43:18.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/5 2024-09-16T03:43:18.899 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:43:18.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=17eceb3a-3c38-4b50-a85e-d9c1fad8ec84 2024-09-16T03:43:18.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 17eceb3a-3c38-4b50-a85e-d9c1fad8ec84' 2024-09-16T03:43:18.899 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 17eceb3a-3c38-4b50-a85e-d9c1fad8ec84 2024-09-16T03:43:18.899 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:43:18.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBWqedmh8Z9NhAATsmswW5NzD+D2Gg5vvrGfA== 2024-09-16T03:43:18.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBWqedmh8Z9NhAATsmswW5NzD+D2Gg5vvrGfA=="}' 2024-09-16T03:43:18.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 17eceb3a-3c38-4b50-a85e-d9c1fad8ec84 -i td/osd-backfill-recovery-log/5/new.json 2024-09-16T03:43:19.386 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:43:19.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/5/new.json 2024-09-16T03:43:19.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBWqedmh8Z9NhAATsmswW5NzD+D2Gg5vvrGfA== --osd-uuid 17eceb3a-3c38-4b50-a85e-d9c1fad8ec84 2024-09-16T03:43:19.433 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:43:19.430+0000 7f9cf0b1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:19.457 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:43:19.454+0000 7f9cf0b1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:19.458 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:43:19.455+0000 7f9cf0b1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:19.458 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:43:19.456+0000 7f9cf0b1e640 -1 bdev(0x55dbddd9dc00 td/osd-backfill-recovery-log/5/block) open stat got: (1) Operation not permitted 2024-09-16T03:43:19.458 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:43:19.456+0000 7f9cf0b1e640 -1 bluestore(td/osd-backfill-recovery-log/5) _read_fsid unparsable uuid 2024-09-16T03:43:25.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/5/keyring 2024-09-16T03:43:25.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:43:25.159 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T03:43:25.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T03:43:25.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:43:25.723 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T03:43:25.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T03:43:25.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:43:25.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:43:25.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:43:25.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:43:25.756 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:43:25.753+0000 7fd9df81c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:25.763 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:43:25.760+0000 7fd9df81c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:25.765 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:43:25.762+0000 7fd9df81c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:43:26.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T03:43:26.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:43:26.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T03:43:26.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:43:26.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:43:26.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:26.168 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:43:26.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:43:26.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:26.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:26.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:27.109 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:43:27.106+0000 7fd9df81c640 -1 Falling back to public interface 2024-09-16T03:43:27.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:27.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:27.605 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:43:27.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:43:27.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:27.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:28.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:29.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:29.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:29.068 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:43:29.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:43:29.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:29.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:29.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:29.561 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:43:29.558+0000 7fd9df81c640 -1 osd.5 0 log_to_monitors true 2024-09-16T03:43:30.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:30.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:30.486 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:43:30.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:43:30.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:30.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:30.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:31.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:31.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:31.919 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:43:31.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:43:31.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:31.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:32.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:33.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:33.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:33.369 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:43:33.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:43:33.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:33.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:33.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:34.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:34.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:34.790 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:43:34.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:43:34.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:34.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:35.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:36.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:36.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:36.374 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:43:36.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:43:36.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:36.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:36.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:37.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:37.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:37.788 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:43:37.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:43:37.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:37.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:38.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:39.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:39.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:39.211 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:43:39.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:43:39.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:39.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:39.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:40.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:40.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:40.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:43:40.668 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:43:40.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:40.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:41.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:42.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:42.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:43:42.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:43:42.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:42.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:42.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:43.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:43.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:43.645 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:43:43.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:43:43.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:43.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:44.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:45.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:45.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:45.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:43:45.192 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:43:45.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:45.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:46.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:47.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:47.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:47.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:43:47.348 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:43:47.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:47.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:48.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:49.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:49.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:49.184 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:43:49.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:43:49.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:49.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:49.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:50.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:50.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:50.988 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:43:50.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:43:50.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:50.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:51.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:43:52.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:43:52.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:43:52.940 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:43:52.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:43:52.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:43:52.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:43:53.386 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 29 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3884073305,v1:127.0.0.1:6843/3884073305] [v2:127.0.0.1:6844/3884073305,v1:127.0.0.1:6845/3884073305] exists,up 17eceb3a-3c38-4b50-a85e-d9c1fad8ec84 2024-09-16T03:43:53.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:43:53.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:43:53.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:43:53.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:60: _common_test: create_pool test 1 1 2024-09-16T03:43:53.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2024-09-16T03:43:53.985 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T03:43:53.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:43:54.997 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: seq 1 40 2024-09-16T03:43:54.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:54.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-1 /etc/passwd 2024-09-16T03:43:55.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:55.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-2 /etc/passwd 2024-09-16T03:43:55.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:55.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-3 /etc/passwd 2024-09-16T03:43:55.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:55.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-4 /etc/passwd 2024-09-16T03:43:55.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:56.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-5 /etc/passwd 2024-09-16T03:43:56.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:56.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-6 /etc/passwd 2024-09-16T03:43:56.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:56.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-7 /etc/passwd 2024-09-16T03:43:56.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:56.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-8 /etc/passwd 2024-09-16T03:43:56.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:56.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-9 /etc/passwd 2024-09-16T03:43:56.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:56.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-10 /etc/passwd 2024-09-16T03:43:56.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:56.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-11 /etc/passwd 2024-09-16T03:43:57.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:57.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-12 /etc/passwd 2024-09-16T03:43:57.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:57.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-13 /etc/passwd 2024-09-16T03:43:57.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:57.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-14 /etc/passwd 2024-09-16T03:43:57.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:57.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-15 /etc/passwd 2024-09-16T03:43:57.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:57.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-16 /etc/passwd 2024-09-16T03:43:57.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:57.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-17 /etc/passwd 2024-09-16T03:43:57.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:57.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-18 /etc/passwd 2024-09-16T03:43:58.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:58.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-19 /etc/passwd 2024-09-16T03:43:58.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:58.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-20 /etc/passwd 2024-09-16T03:43:58.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:58.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-21 /etc/passwd 2024-09-16T03:43:58.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:58.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-22 /etc/passwd 2024-09-16T03:43:58.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:58.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-23 /etc/passwd 2024-09-16T03:43:58.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:58.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-24 /etc/passwd 2024-09-16T03:43:59.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:59.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-25 /etc/passwd 2024-09-16T03:43:59.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:59.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-26 /etc/passwd 2024-09-16T03:43:59.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:59.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-27 /etc/passwd 2024-09-16T03:43:59.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:59.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-28 /etc/passwd 2024-09-16T03:43:59.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:59.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-29 /etc/passwd 2024-09-16T03:43:59.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:59.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-30 /etc/passwd 2024-09-16T03:43:59.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:59.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-31 /etc/passwd 2024-09-16T03:43:59.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:43:59.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-32 /etc/passwd 2024-09-16T03:44:00.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:44:00.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-33 /etc/passwd 2024-09-16T03:44:00.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:44:00.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-34 /etc/passwd 2024-09-16T03:44:00.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:44:00.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-35 /etc/passwd 2024-09-16T03:44:00.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:44:00.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-36 /etc/passwd 2024-09-16T03:44:00.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:44:00.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-37 /etc/passwd 2024-09-16T03:44:00.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:44:00.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-38 /etc/passwd 2024-09-16T03:44:01.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:44:01.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-39 /etc/passwd 2024-09-16T03:44:01.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:44:01.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-40 /etc/passwd 2024-09-16T03:44:01.299 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph pg dump pgs --format=json 2024-09-16T03:44:01.299 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: jq '.pg_stats[0].up[]' 2024-09-16T03:44:01.687 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:44:01.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph osd out 1 0 2 2024-09-16T03:44:02.201 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. osd.0 is already out. osd.2 is already out. 2024-09-16T03:44:02.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:69: _common_test: '[' 0 '!=' 0 ']' 2024-09-16T03:44:02.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:75: _common_test: sleep 1 2024-09-16T03:44:03.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:76: _common_test: wait_for_clean 2024-09-16T03:44:03.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:44:03.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:44:03.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:44:03.214 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:44:03.215 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:44:03.215 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:44:03.215 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:44:03.215 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:44:03.215 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:44:03.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:44:03.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:44:03.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:44:03.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:44:03.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:44:03.318 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:44:03.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:44:03.730 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:44:03.730 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:44:03.730 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:44:03.730 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T03:44:03.731 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T03:44:03.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:44:03.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:44:03.731 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:44:03.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836520 2024-09-16T03:44:03.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836520 2024-09-16T03:44:03.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836520' 2024-09-16T03:44:03.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:44:03.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:44:03.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672994 2024-09-16T03:44:03.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672994 2024-09-16T03:44:03.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836520 1-42949672994' 2024-09-16T03:44:03.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:44:03.991 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:44:04.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509470 2024-09-16T03:44:04.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509470 2024-09-16T03:44:04.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836520 1-42949672994 2-64424509470' 2024-09-16T03:44:04.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:44:04.111 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:44:04.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345944 2024-09-16T03:44:04.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345944 2024-09-16T03:44:04.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836520 1-42949672994 2-64424509470 3-85899345944' 2024-09-16T03:44:04.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:44:04.229 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:44:04.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=103079215124 2024-09-16T03:44:04.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 103079215124 2024-09-16T03:44:04.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836520 1-42949672994 2-64424509470 3-85899345944 4-103079215124' 2024-09-16T03:44:04.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:44:04.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T03:44:04.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=124554051593 2024-09-16T03:44:04.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 124554051593 2024-09-16T03:44:04.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836520 1-42949672994 2-64424509470 3-85899345944 4-103079215124 5-124554051593' 2024-09-16T03:44:04.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:44:04.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836520 2024-09-16T03:44:04.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:44:04.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:44:04.467 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836520 2024-09-16T03:44:04.467 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:44:04.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836520 2024-09-16T03:44:04.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836520' 2024-09-16T03:44:04.469 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836520 2024-09-16T03:44:04.469 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:44:04.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 0 -lt 21474836520 2024-09-16T03:44:04.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:44:05.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:44:05.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:44:06.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836521 -lt 21474836520 2024-09-16T03:44:06.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:44:06.293 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672994 2024-09-16T03:44:06.293 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:44:06.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:44:06.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672994 2024-09-16T03:44:06.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:44:06.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672994 2024-09-16T03:44:06.295 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672994 2024-09-16T03:44:06.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672994' 2024-09-16T03:44:06.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:44:06.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672995 -lt 42949672994 2024-09-16T03:44:06.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:44:06.718 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509470 2024-09-16T03:44:06.718 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:44:06.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:44:06.719 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509470 2024-09-16T03:44:06.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:44:06.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509470 2024-09-16T03:44:06.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509470' 2024-09-16T03:44:06.721 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509470 2024-09-16T03:44:06.721 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:44:07.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509470 -lt 64424509470 2024-09-16T03:44:07.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:44:07.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345944 2024-09-16T03:44:07.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:44:07.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:44:07.173 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345944 2024-09-16T03:44:07.173 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:44:07.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345944 2024-09-16T03:44:07.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345944' 2024-09-16T03:44:07.175 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345944 2024-09-16T03:44:07.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:44:07.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345944 -lt 85899345944 2024-09-16T03:44:07.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:44:07.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-103079215124 2024-09-16T03:44:07.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:44:07.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:44:07.697 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-103079215124 2024-09-16T03:44:07.697 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:44:07.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=103079215124 2024-09-16T03:44:07.698 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 103079215124 2024-09-16T03:44:07.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 103079215124' 2024-09-16T03:44:07.698 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:44:08.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 103079215124 -lt 103079215124 2024-09-16T03:44:08.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:44:08.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-124554051593 2024-09-16T03:44:08.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:44:08.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T03:44:08.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-124554051593 2024-09-16T03:44:08.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:44:08.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=124554051593 2024-09-16T03:44:08.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 124554051593' 2024-09-16T03:44:08.134 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 124554051593 2024-09-16T03:44:08.134 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T03:44:08.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 124554051593 -lt 124554051593 2024-09-16T03:44:08.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:44:08.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:44:08.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:44:09.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T03:44:09.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:44:09.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:44:09.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:44:09.161 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:44:09.161 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:44:09.161 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:44:09.161 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:44:09.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:44:09.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:44:09.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:44:09.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:44:10.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:44:10.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T03:44:10.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T03:44:10.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T03:44:10.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:44:10.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:44:10.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:44:10.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:44:10.303 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:44:10.303 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:44:10.303 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:44:10.303 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:44:10.303 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:44:10.304 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:44:10.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:44:10.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:44:10.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:44:10.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:44:11.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:44:11.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:44:11.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:44:11.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:44:11.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:44:11.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:44:11.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:44:11.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:44:11.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:44:12.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=32683 2024-09-16T03:44:12.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 32683 '!=' null 2024-09-16T03:44:12.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:44:12.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:44:12.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:44:12.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:44:12.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:44:12.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:44:12.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:44:12.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:44:12.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:44:12.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:44:12.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:44:12.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:44:12.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:44:12.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:44:12.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:44:13.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:44:13.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:44:13.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:44:13.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:44:13.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:44:13.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:44:13.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:44:13.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:44:13.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:44:13.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=28322 2024-09-16T03:44:13.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 28322 '!=' null 2024-09-16T03:44:13.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:44:13.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:44:13.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:44:13.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:44:13.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:44:13.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:44:14.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:44:14.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:44:14.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:44:14.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:44:14.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:44:14.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:44:14.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:44:14.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:44:14.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:44:14.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:44:14.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:44:14.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:44:14.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:44:15.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=43082 2024-09-16T03:44:15.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 43082 '!=' null 2024-09-16T03:44:15.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:44:15.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:44:15.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:44:15.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:44:15.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:44:15.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:44:15.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:44:15.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:44:15.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:44:15.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:44:15.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:44:15.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:44:15.751 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:44:15.751 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:44:15.752 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:44:16.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T03:44:16.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:44:16.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:44:16.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:78: _common_test: flush_pg_stats 2024-09-16T03:44:16.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:44:16.304 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:44:16.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:44:16.765 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:44:16.765 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:44:16.765 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:44:16.765 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T03:44:16.765 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T03:44:16.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:44:16.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:44:16.765 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:44:16.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836525 2024-09-16T03:44:16.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836525 2024-09-16T03:44:16.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836525' 2024-09-16T03:44:16.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:44:16.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:44:17.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672999 2024-09-16T03:44:17.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672999 2024-09-16T03:44:17.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836525 1-42949672999' 2024-09-16T03:44:17.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:44:17.006 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:44:17.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509474 2024-09-16T03:44:17.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509474 2024-09-16T03:44:17.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836525 1-42949672999 2-64424509474' 2024-09-16T03:44:17.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:44:17.124 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:44:17.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345948 2024-09-16T03:44:17.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345948 2024-09-16T03:44:17.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836525 1-42949672999 2-64424509474 3-85899345948' 2024-09-16T03:44:17.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:44:17.243 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:44:17.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=103079215128 2024-09-16T03:44:17.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 103079215128 2024-09-16T03:44:17.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836525 1-42949672999 2-64424509474 3-85899345948 4-103079215128' 2024-09-16T03:44:17.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:44:17.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T03:44:17.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=124554051597 2024-09-16T03:44:17.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 124554051597 2024-09-16T03:44:17.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836525 1-42949672999 2-64424509474 3-85899345948 4-103079215128 5-124554051597' 2024-09-16T03:44:17.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:44:17.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836525 2024-09-16T03:44:17.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:44:17.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:44:17.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836525 2024-09-16T03:44:17.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:44:17.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836525 2024-09-16T03:44:17.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836525' 2024-09-16T03:44:17.484 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836525 2024-09-16T03:44:17.484 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:44:17.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836523 -lt 21474836525 2024-09-16T03:44:17.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:44:18.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:44:18.893 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:44:19.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836525 -lt 21474836525 2024-09-16T03:44:19.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:44:19.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672999 2024-09-16T03:44:19.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:44:19.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:44:19.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672999 2024-09-16T03:44:19.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:44:19.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672999 2024-09-16T03:44:19.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672999' 2024-09-16T03:44:19.318 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672999 2024-09-16T03:44:19.318 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:44:19.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672999 -lt 42949672999 2024-09-16T03:44:19.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:44:19.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509474 2024-09-16T03:44:19.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:44:19.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:44:19.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509474 2024-09-16T03:44:19.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:44:19.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509474 2024-09-16T03:44:19.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509474' 2024-09-16T03:44:19.756 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509474 2024-09-16T03:44:19.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:44:20.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509475 -lt 64424509474 2024-09-16T03:44:20.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:44:20.187 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345948 2024-09-16T03:44:20.187 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:44:20.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:44:20.189 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345948 2024-09-16T03:44:20.189 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:44:20.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345948 2024-09-16T03:44:20.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345948' 2024-09-16T03:44:20.190 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345948 2024-09-16T03:44:20.190 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:44:20.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345949 -lt 85899345948 2024-09-16T03:44:20.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:44:20.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-103079215128 2024-09-16T03:44:20.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:44:20.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:44:20.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-103079215128 2024-09-16T03:44:20.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:44:20.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=103079215128 2024-09-16T03:44:20.633 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 103079215128 2024-09-16T03:44:20.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 103079215128' 2024-09-16T03:44:20.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:44:21.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 103079215129 -lt 103079215128 2024-09-16T03:44:21.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:44:21.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-124554051597 2024-09-16T03:44:21.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:44:21.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T03:44:21.039 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-124554051597 2024-09-16T03:44:21.039 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:44:21.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=124554051597 2024-09-16T03:44:21.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 124554051597' 2024-09-16T03:44:21.041 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 124554051597 2024-09-16T03:44:21.041 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T03:44:21.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 124554051598 -lt 124554051597 2024-09-16T03:44:21.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: ceph pg dump pgs --format=json 2024-09-16T03:44:21.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: jq '.pg_stats[0].up_primary' 2024-09-16T03:44:21.861 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:44:21.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: newprimary=4 2024-09-16T03:44:21.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:81: _common_test: kill_daemons 2024-09-16T03:44:21.873 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:44:21.874 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:44:21.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:44:21.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:44:21.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:44:27.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:44:27.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:83: _common_test: ERRORS=0 2024-09-16T03:44:27.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: _objectstore_tool_nodown td/osd-backfill-recovery-log 4 --no-mon-config --pgid 1.0 --op log 2024-09-16T03:44:27.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: tee td/osd-backfill-recovery-log/result.log 2024-09-16T03:44:27.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:44:27.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2024-09-16T03:44:27.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=4 2024-09-16T03:44:27.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2024-09-16T03:44:27.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-backfill-recovery-log/4 2024-09-16T03:44:27.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-recovery-log/4 --no-mon-config --pgid 1.0 --op log 2024-09-16T03:44:28.486 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:44:28.487 INFO:tasks.workunit.client.0.smithi026.stdout: "pg_log_t": { 2024-09-16T03:44:28.487 INFO:tasks.workunit.client.0.smithi026.stdout: "head": "32'40", 2024-09-16T03:44:28.487 INFO:tasks.workunit.client.0.smithi026.stdout: "tail": "0'0", 2024-09-16T03:44:28.487 INFO:tasks.workunit.client.0.smithi026.stdout: "log": [ 2024-09-16T03:44:28.487 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.487 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.487 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:c00128d9:::obj-1:head", 2024-09-16T03:44:28.487 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "31'1", 2024-09-16T03:44:28.487 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.487 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4381.0:1", 2024-09-16T03:44:28.487 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:55.080922+0000", 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.488 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:d7942fc0:::obj-2:head", 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'2", 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4384.0:1", 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:55.364093+0000", 2024-09-16T03:44:28.489 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.490 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.491 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.491 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.491 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.491 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.491 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1dda57ab:::obj-3:head", 2024-09-16T03:44:28.491 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'3", 2024-09-16T03:44:28.491 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.491 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4387.0:1", 2024-09-16T03:44:28.491 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.491 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:55.741179+0000", 2024-09-16T03:44:28.492 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.492 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.492 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.492 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.492 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.492 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.492 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.492 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.493 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.493 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.493 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.493 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.493 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.493 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.493 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.493 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.493 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.493 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.493 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:ba1802d0:::obj-4:head", 2024-09-16T03:44:28.494 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'4", 2024-09-16T03:44:28.494 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.494 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4390.0:1", 2024-09-16T03:44:28.494 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.494 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:55.881558+0000", 2024-09-16T03:44:28.494 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.494 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.494 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.494 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.494 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.494 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.495 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.495 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.495 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.495 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.495 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.495 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.495 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.495 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.495 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.495 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.495 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.496 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.496 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:d5d4a582:::obj-5:head", 2024-09-16T03:44:28.496 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'5", 2024-09-16T03:44:28.497 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.497 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4393.0:1", 2024-09-16T03:44:28.497 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.497 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:56.014995+0000", 2024-09-16T03:44:28.497 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.497 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.498 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.498 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.498 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.498 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.498 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.498 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.498 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.498 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.498 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.498 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.498 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.498 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:25cac09a:::obj-6:head", 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'6", 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4396.0:1", 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:56.148703+0000", 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.499 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.500 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.501 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.501 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:b11b7838:::obj-7:head", 2024-09-16T03:44:28.501 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'7", 2024-09-16T03:44:28.501 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.501 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4399.0:1", 2024-09-16T03:44:28.501 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.501 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:56.324159+0000", 2024-09-16T03:44:28.501 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.501 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.501 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.501 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.501 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.502 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.502 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.502 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.502 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.502 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.502 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.502 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.502 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.502 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.502 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.502 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.503 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.503 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.503 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:a0f702de:::obj-8:head", 2024-09-16T03:44:28.503 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'8", 2024-09-16T03:44:28.503 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.503 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4402.0:1", 2024-09-16T03:44:28.503 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.503 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:56.509519+0000", 2024-09-16T03:44:28.503 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.503 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.503 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.503 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.504 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.504 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.504 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.504 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.504 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.504 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.504 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.504 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.504 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.504 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1e5c3677:::obj-9:head", 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'9", 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4405.0:1", 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:56.651849+0000", 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.505 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.506 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.506 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.506 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.506 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.506 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.506 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.506 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.506 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.506 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.506 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.506 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.506 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.507 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.507 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.507 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:86dc045c:::obj-10:head", 2024-09-16T03:44:28.507 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'10", 2024-09-16T03:44:28.507 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.507 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4408.0:1", 2024-09-16T03:44:28.507 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.507 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:56.794625+0000", 2024-09-16T03:44:28.507 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.507 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.507 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.507 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.508 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.508 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.508 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.508 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.508 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.508 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.508 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.508 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.508 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.508 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.508 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1e6eca61:::obj-11:head", 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'11", 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4411.0:1", 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:56.944624+0000", 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.509 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.510 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.510 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.510 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.510 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.510 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.510 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.510 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.510 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.510 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.510 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.510 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:18dee445:::obj-12:head", 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'12", 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4414.0:1", 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:57.095085+0000", 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.511 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.512 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.512 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.512 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.512 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.512 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.512 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.512 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.512 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.512 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.512 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.512 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.512 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:283c5c90:::obj-13:head", 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'13", 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4417.0:1", 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:57.229460+0000", 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.513 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:cc896bf0:::obj-14:head", 2024-09-16T03:44:28.514 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'14", 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4420.0:1", 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:57.371256+0000", 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.515 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:a581f807:::obj-15:head", 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'15", 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.516 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4423.0:1", 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:57.513077+0000", 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.517 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:c902ca7c:::obj-16:head", 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'16", 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4426.0:1", 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:57.664211+0000", 2024-09-16T03:44:28.518 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.519 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.519 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.519 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.519 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.519 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.519 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.519 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.519 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.519 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.519 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.519 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.519 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:655283c8:::obj-17:head", 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'17", 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4429.0:1", 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:57.830514+0000", 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.520 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.521 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:d759d762:::obj-18:head", 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'18", 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4432.0:1", 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:57.975234+0000", 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.522 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.523 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1b934a2d:::obj-19:head", 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'19", 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4435.0:1", 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:58.150600+0000", 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.524 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1d0ea2ca:::obj-20:head", 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'20", 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.525 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4438.0:1", 2024-09-16T03:44:28.526 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.526 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:58.293045+0000", 2024-09-16T03:44:28.526 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.526 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.526 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.526 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.526 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.526 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.526 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.526 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.527 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.527 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.527 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.527 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.527 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.527 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.527 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.527 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.527 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.527 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:ab396690:::obj-21:head", 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'21", 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4441.0:1", 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:58.444337+0000", 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.528 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.529 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.529 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.529 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.529 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.529 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.529 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.529 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.529 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.529 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.529 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.529 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.529 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:254983db:::obj-22:head", 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'22", 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4444.0:1", 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:58.578396+0000", 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.530 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:e656299f:::obj-23:head", 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'23", 2024-09-16T03:44:28.531 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4447.0:1", 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:58.737131+0000", 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.532 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:5cdf412b:::obj-24:head", 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'24", 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4450.0:1", 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.533 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:58.880780+0000", 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.534 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:cacae143:::obj-25:head", 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'25", 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4453.0:1", 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:59.039734+0000", 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.535 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.536 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:34b5bff6:::obj-26:head", 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'26", 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4456.0:1", 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:59.182271+0000", 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.537 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.538 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:a354f8f6:::obj-27:head", 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'27", 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4459.0:1", 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:59.324025+0000", 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.539 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:7421db49:::obj-28:head", 2024-09-16T03:44:28.540 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'28", 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4462.0:1", 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:59.458653+0000", 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.541 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:54bc79ba:::obj-29:head", 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'29", 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4465.0:1", 2024-09-16T03:44:28.542 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:59.592962+0000", 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.543 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:01b15595:::obj-30:head", 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'30", 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4468.0:1", 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:59.735162+0000", 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.544 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.545 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:f9a0a8a2:::obj-31:head", 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'31", 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4471.0:1", 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:43:59.878448+0000", 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.546 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.547 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1bf2562f:::obj-32:head", 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'32", 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4474.0:1", 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:44:00.012163+0000", 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.548 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:b982ae22:::obj-33:head", 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'33", 2024-09-16T03:44:28.549 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4477.0:1", 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:44:00.146160+0000", 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.550 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1ad9f98e:::obj-34:head", 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'34", 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4480.0:1", 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.551 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:44:00.288245+0000", 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.552 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:941f43ff:::obj-35:head", 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'35", 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4483.0:1", 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:44:00.431148+0000", 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.553 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.554 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.554 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.554 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.554 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.554 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.554 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.554 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.554 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.554 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.554 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.554 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.554 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:24ebabe9:::obj-36:head", 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'36", 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4486.0:1", 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:44:00.582022+0000", 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.555 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:5f3a5398:::obj-37:head", 2024-09-16T03:44:28.556 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'37", 2024-09-16T03:44:28.747 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.748 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4489.0:1", 2024-09-16T03:44:28.748 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.748 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:44:00.724445+0000", 2024-09-16T03:44:28.748 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.748 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.748 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.748 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.748 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.748 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.748 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.748 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.748 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.749 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.749 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.749 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.749 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.749 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.749 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.749 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.749 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.749 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.749 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:c96cb37e:::obj-38:head", 2024-09-16T03:44:28.749 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'38", 2024-09-16T03:44:28.749 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4492.0:1", 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:44:00.901044+0000", 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.750 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:69e36996:::obj-39:head", 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'39", 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4495.0:1", 2024-09-16T03:44:28.751 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:44:01.051943+0000", 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.752 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:9f75773e:::obj-40:head", 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "32'40", 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4498.0:1", 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:44:01.193956+0000", 2024-09-16T03:44:28.753 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:44:28.754 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.755 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.755 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.755 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:44:28.755 INFO:tasks.workunit.client.0.smithi026.stdout: "dups": [] 2024-09-16T03:44:28.755 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:44:28.755 INFO:tasks.workunit.client.0.smithi026.stdout: "pg_missing_t": { 2024-09-16T03:44:28.755 INFO:tasks.workunit.client.0.smithi026.stdout: "missing": [], 2024-09-16T03:44:28.755 INFO:tasks.workunit.client.0.smithi026.stdout: "may_include_deletes": true 2024-09-16T03:44:28.755 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:44:28.756 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:44:28.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: jq '.pg_log_t.log | length' td/osd-backfill-recovery-log/result.log 2024-09-16T03:44:28.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: LOGLEN=40 2024-09-16T03:44:28.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:86: _common_test: '[' 40 '!=' 40 ']' 2024-09-16T03:44:28.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: jq '.pg_log_t.dups | length' td/osd-backfill-recovery-log/result.log 2024-09-16T03:44:28.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: DUPSLEN=0 2024-09-16T03:44:28.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:91: _common_test: '[' 0 '!=' 0 ']' 2024-09-16T03:44:28.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:95: _common_test: grep 'copy_up_to\|copy_after' td/osd-backfill-recovery-log/osd.0.log td/osd-backfill-recovery-log/osd.1.log td/osd-backfill-recovery-log/osd.2.log td/osd-backfill-recovery-log/osd.3.log td/osd-backfill-recovery-log/osd.4.log td/osd-backfill-recovery-log/osd.5.log 2024-09-16T03:44:28.761 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after v 0'0 dups.size()=0 other.dups.size()=0 2024-09-16T03:44:28.761 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'40 2024-09-16T03:44:28.761 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'39 2024-09-16T03:44:28.761 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'38 2024-09-16T03:44:28.761 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'37 2024-09-16T03:44:28.761 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'36 2024-09-16T03:44:28.761 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'35 2024-09-16T03:44:28.761 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'34 2024-09-16T03:44:28.761 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'33 2024-09-16T03:44:28.761 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'32 2024-09-16T03:44:28.761 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'31 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'30 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'29 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'28 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'27 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'26 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'25 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'24 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'23 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'22 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'21 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'20 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'19 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'18 2024-09-16T03:44:28.762 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'17 2024-09-16T03:44:28.763 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'16 2024-09-16T03:44:28.763 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'15 2024-09-16T03:44:28.763 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'14 2024-09-16T03:44:28.763 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'13 2024-09-16T03:44:28.763 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'12 2024-09-16T03:44:28.763 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'11 2024-09-16T03:44:28.763 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'10 2024-09-16T03:44:28.763 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'9 2024-09-16T03:44:28.763 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'8 2024-09-16T03:44:28.769 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'7 2024-09-16T03:44:28.769 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'6 2024-09-16T03:44:28.769 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'5 2024-09-16T03:44:28.769 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'4 2024-09-16T03:44:28.769 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'3 2024-09-16T03:44:28.770 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 32'2 2024-09-16T03:44:28.770 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after copy log version 31'1 2024-09-16T03:44:28.770 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:44:02.460+0000 7f248d4fb640 20 copy_after END v 0'0 dups.size()=0 other.dups.size()=0 2024-09-16T03:44:28.770 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after v 0'0 dups.size()=0 other.dups.size()=0 2024-09-16T03:44:28.770 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'40 2024-09-16T03:44:28.770 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'39 2024-09-16T03:44:28.771 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'38 2024-09-16T03:44:28.771 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'37 2024-09-16T03:44:28.771 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'36 2024-09-16T03:44:28.771 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'35 2024-09-16T03:44:28.771 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'34 2024-09-16T03:44:28.771 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'33 2024-09-16T03:44:28.772 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'32 2024-09-16T03:44:28.772 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'31 2024-09-16T03:44:28.772 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'30 2024-09-16T03:44:28.772 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'29 2024-09-16T03:44:28.772 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'28 2024-09-16T03:44:28.772 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'27 2024-09-16T03:44:28.772 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'26 2024-09-16T03:44:28.772 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'25 2024-09-16T03:44:28.772 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'24 2024-09-16T03:44:28.772 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'23 2024-09-16T03:44:28.772 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'22 2024-09-16T03:44:28.773 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'21 2024-09-16T03:44:28.773 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'20 2024-09-16T03:44:28.773 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'19 2024-09-16T03:44:28.773 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'18 2024-09-16T03:44:28.773 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'17 2024-09-16T03:44:28.773 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'16 2024-09-16T03:44:28.773 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'15 2024-09-16T03:44:28.773 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'14 2024-09-16T03:44:28.773 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'13 2024-09-16T03:44:28.773 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'12 2024-09-16T03:44:28.773 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'11 2024-09-16T03:44:28.773 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'10 2024-09-16T03:44:28.774 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'9 2024-09-16T03:44:28.774 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'8 2024-09-16T03:44:28.774 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'7 2024-09-16T03:44:28.774 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'6 2024-09-16T03:44:28.774 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'5 2024-09-16T03:44:28.774 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'4 2024-09-16T03:44:28.774 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'3 2024-09-16T03:44:28.774 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'2 2024-09-16T03:44:28.774 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 31'1 2024-09-16T03:44:28.774 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after END v 0'0 dups.size()=0 other.dups.size()=0 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after v 0'0 dups.size()=0 other.dups.size()=0 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'40 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'39 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'38 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'37 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'36 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'35 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'34 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'33 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'32 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'31 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'30 2024-09-16T03:44:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'29 2024-09-16T03:44:28.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'28 2024-09-16T03:44:28.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'27 2024-09-16T03:44:28.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'26 2024-09-16T03:44:28.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'25 2024-09-16T03:44:28.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'24 2024-09-16T03:44:28.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'23 2024-09-16T03:44:28.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'22 2024-09-16T03:44:28.776 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'21 2024-09-16T03:44:28.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'20 2024-09-16T03:44:28.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'19 2024-09-16T03:44:28.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'18 2024-09-16T03:44:28.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'17 2024-09-16T03:44:28.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'16 2024-09-16T03:44:28.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'15 2024-09-16T03:44:28.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'14 2024-09-16T03:44:28.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'13 2024-09-16T03:44:28.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'12 2024-09-16T03:44:28.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'11 2024-09-16T03:44:28.777 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'10 2024-09-16T03:44:28.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'9 2024-09-16T03:44:28.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'8 2024-09-16T03:44:28.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'7 2024-09-16T03:44:28.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'6 2024-09-16T03:44:28.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'5 2024-09-16T03:44:28.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'4 2024-09-16T03:44:28.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'3 2024-09-16T03:44:28.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 32'2 2024-09-16T03:44:28.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after copy log version 31'1 2024-09-16T03:44:28.778 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.4.log:2024-09-16T03:44:02.926+0000 7fbd4f7b4640 20 copy_after END v 0'0 dups.size()=0 other.dups.size()=0 2024-09-16T03:44:28.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:96: _common_test: rm -f td/osd-backfill-recovery-log/result.log 2024-09-16T03:44:28.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:97: _common_test: '[' 0 '!=' 0 ']' 2024-09-16T03:44:28.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:35: run: teardown td/osd-backfill-recovery-log 2024-09-16T03:44:28.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:44:28.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:44:28.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-09-16T03:44:28.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:44:28.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:44:28.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:44:28.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:44:28.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:44:28.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:44:28.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:44:28.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:44:28.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:44:28.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:44:28.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:44:28.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:44:28.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:44:28.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:44:28.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:44:28.789 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:44:28.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:44:28.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:44:28.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-recovery-log 2024-09-16T03:44:28.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:44:28.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:44:28.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:44:28.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.53196 2024-09-16T03:44:28.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:44:28.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:44:28.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:32: run: for func in $funcs 2024-09-16T03:44:28.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:33: run: setup td/osd-backfill-recovery-log 2024-09-16T03:44:28.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-recovery-log 2024-09-16T03:44:28.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-recovery-log 2024-09-16T03:44:28.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:44:28.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:44:28.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-09-16T03:44:28.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:44:28.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:44:28.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:44:28.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:44:28.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:44:28.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:44:28.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:44:28.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:44:28.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:44:28.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:44:28.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:44:28.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:44:28.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:44:28.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:44:28.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:44:28.830 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:44:28.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:44:28.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:44:28.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-recovery-log 2024-09-16T03:44:28.833 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:44:28.833 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:44:28.833 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:44:28.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.53196 2024-09-16T03:44:28.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:44:28.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:44:28.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-recovery-log 2024-09-16T03:44:28.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:44:28.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:44:28.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:44:28.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.53196 2024-09-16T03:44:28.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:44:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:44:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:44:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-recovery-log 1' TERM HUP INT 2024-09-16T03:44:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:34: run: TEST_recovery_2 td/osd-backfill-recovery-log 2024-09-16T03:44:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:130: TEST_recovery_2: local dir=td/osd-backfill-recovery-log 2024-09-16T03:44:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:132: TEST_recovery_2: _common_test td/osd-backfill-recovery-log '--osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 151 10 141 20 2024-09-16T03:44:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:41: _common_test: local dir=td/osd-backfill-recovery-log 2024-09-16T03:44:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:42: _common_test: local 'extra_opts=--osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-09-16T03:44:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:43: _common_test: local loglen=151 2024-09-16T03:44:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:44: _common_test: local dupslen=10 2024-09-16T03:44:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:45: _common_test: local objects=141 2024-09-16T03:44:28.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:46: _common_test: local moreobjects=20 2024-09-16T03:44:28.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:48: _common_test: local OSDS=6 2024-09-16T03:44:28.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:50: _common_test: run_mon td/osd-backfill-recovery-log a 2024-09-16T03:44:28.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-recovery-log 2024-09-16T03:44:28.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:44:28.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:44:28.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:44:28.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-recovery-log/a 2024-09-16T03:44:28.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-recovery-log/a --run-dir=td/osd-backfill-recovery-log 2024-09-16T03:44:29.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:44:29.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:44:29.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:44:29.237 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:44:29.237 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:44:29.237 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:44:29.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:44:29.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-recovery-log/a '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-recovery-log/log --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:44:29.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:44:29.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:44:29.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:44:29.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:44:29.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:44:29.446 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:44:29.446 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:44:29.446 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:44:29.446 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:44:29.447 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:44:29.447 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:44:29.447 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:44:29.447 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.53196/ceph-mon.a.asok 2024-09-16T03:44:29.448 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:44:29.448 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.53196/ceph-mon.a.asok config get fsid 2024-09-16T03:44:29.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:44:29.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:44:29.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:44:29.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:44:29.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:44:29.541 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:44:29.542 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:44:29.542 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:44:29.542 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:44:29.542 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:44:29.542 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:44:29.542 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.53196/ceph-mon.a.asok 2024-09-16T03:44:29.542 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:44:29.543 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.53196/ceph-mon.a.asok config get mon_host 2024-09-16T03:44:29.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:51: _common_test: run_mgr td/osd-backfill-recovery-log x 2024-09-16T03:44:29.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-recovery-log 2024-09-16T03:44:29.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:44:29.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:44:29.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:44:29.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-recovery-log/x 2024-09-16T03:44:29.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:44:30.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:44:30.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:44:30.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:44:30.492 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:44:30.492 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:44:30.492 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:44:30.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:44:30.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:44:30.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd_min_pg_log_entries=50 --osd_max_pg_log_entries=50 --osd_pg_log_dups_tracked=60 --osd_pg_log_trim_min=10 --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-recovery-log/x '--log-file=td/osd-backfill-recovery-log/$name.log' '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --run-dir=td/osd-backfill-recovery-log '--pid-file=td/osd-backfill-recovery-log/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:44:30.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:52: _common_test: export CEPH_ARGS 2024-09-16T03:44:30.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: export 'EXTRA_OPTS= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-09-16T03:44:30.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:53: _common_test: EXTRA_OPTS=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-09-16T03:44:30.526 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: expr 6 - 1 2024-09-16T03:44:30.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: seq 0 5 2024-09-16T03:44:30.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:44:30.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 0 2024-09-16T03:44:30.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:44:30.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:44:30.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:44:30.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:44:30.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/0 2024-09-16T03:44:30.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:44:30.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:44:30.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:44:30.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:44:30.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/0' 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/0/journal' 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:44:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:44:30.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:44:30.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:44:30.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:44:30.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:44:30.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:44:30.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:44:30.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:44:30.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:44:30.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:44:30.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/0 2024-09-16T03:44:30.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:44:30.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a3bfeeab-66ea-44a2-af4d-b926fffde0b1 2024-09-16T03:44:30.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a3bfeeab-66ea-44a2-af4d-b926fffde0b1' 2024-09-16T03:44:30.535 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 a3bfeeab-66ea-44a2-af4d-b926fffde0b1 2024-09-16T03:44:30.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:44:30.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCeqedm2u/YIBAAfgWuOFe+/QB3GaC3Le+HQA== 2024-09-16T03:44:30.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCeqedm2u/YIBAAfgWuOFe+/QB3GaC3Le+HQA=="}' 2024-09-16T03:44:30.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a3bfeeab-66ea-44a2-af4d-b926fffde0b1 -i td/osd-backfill-recovery-log/0/new.json 2024-09-16T03:44:30.817 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:44:30.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/0/new.json 2024-09-16T03:44:30.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCeqedm2u/YIBAAfgWuOFe+/QB3GaC3Le+HQA== --osd-uuid a3bfeeab-66ea-44a2-af4d-b926fffde0b1 2024-09-16T03:44:30.863 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:44:30.860+0000 7f148441c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:44:30.886 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:44:30.883+0000 7f148441c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:44:30.887 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:44:30.885+0000 7f148441c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:44:30.888 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:44:30.885+0000 7f148441c640 -1 bdev(0x556db094dc00 td/osd-backfill-recovery-log/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:44:30.888 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:44:30.885+0000 7f148441c640 -1 bluestore(td/osd-backfill-recovery-log/0) _read_fsid unparsable uuid 2024-09-16T03:44:36.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/0/keyring 2024-09-16T03:44:36.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:44:36.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:44:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T03:44:36.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:44:36.921 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T03:44:36.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:44:36.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/0 --osd-journal=td/osd-backfill-recovery-log/0/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:44:36.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:44:36.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:44:36.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:44:36.955 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:44:36.952+0000 7f2c7b6b6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:44:36.957 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:44:36.954+0000 7f2c7b6b6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:44:36.958 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:44:36.955+0000 7f2c7b6b6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:44:37.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:44:37.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:44:37.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:44:37.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:44:37.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:44:37.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:37.357 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:44:37.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:44:37.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:37.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:37.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:38.054 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:44:38.052+0000 7f2c7b6b6640 -1 Falling back to public interface 2024-09-16T03:44:38.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:38.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:38.760 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:44:38.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:44:38.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:38.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:39.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:40.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:40.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:40.209 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:44:40.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:44:40.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:40.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:40.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:40.761 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:44:40.759+0000 7f2c7b6b6640 -1 osd.0 0 log_to_monitors true 2024-09-16T03:44:41.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:41.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:41.630 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:44:41.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:44:41.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:41.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:42.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:43.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:43.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:43.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:44:43.084 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:44:43.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:43.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:43.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:44.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:44.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:44.563 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:44:44.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:44:44.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:44.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:44.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:45.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:45.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:45.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:44:45.994 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:44:45.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:45.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:46.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:47.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:47.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:47.417 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:44:47.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:44:47.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:47.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:47.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:48.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:48.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:48.901 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:44:48.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:44:48.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:48.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:49.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:50.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:50.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:50.337 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:44:50.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:44:50.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:50.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:50.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:51.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:51.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:51.766 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:44:51.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:44:51.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:51.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:52.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:53.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:53.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:53.183 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:44:53.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:44:53.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:53.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:53.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:54.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:54.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:54.601 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:44:54.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:44:54.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:54.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:55.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:56.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:56.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:56.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:44:56.421 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:44:56.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:56.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:57.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:58.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:58.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:58.172 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:44:58.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:44:58.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:58.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:44:58.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:44:59.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:44:59.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:44:59.900 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:44:59.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:44:59.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:44:59.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:00.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:01.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:01.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:01.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:45:01.758 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:45:01.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:01.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:02.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:03.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:03.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:03.777 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:45:03.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:45:03.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:03.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:45:04.344 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2701394455,v1:127.0.0.1:6803/2701394455] [v2:127.0.0.1:6804/2701394455,v1:127.0.0.1:6805/2701394455] exists,up a3bfeeab-66ea-44a2-af4d-b926fffde0b1 2024-09-16T03:45:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:45:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:45:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:45:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:45:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 1 2024-09-16T03:45:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:45:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:45:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:45:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:45:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/1 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/1' 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/1/journal' 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:45:04.349 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:45:04.350 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:04.350 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:45:04.350 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:45:04.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:45:04.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:45:04.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:45:04.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:45:04.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:45:04.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:45:04.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:45:04.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:45:04.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:45:04.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:45:04.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:45:04.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:45:04.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/1 2024-09-16T03:45:04.351 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:45:04.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ff9fb293-27b2-4fde-9c7d-fad99544a2ba 2024-09-16T03:45:04.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ff9fb293-27b2-4fde-9c7d-fad99544a2ba' 2024-09-16T03:45:04.351 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 ff9fb293-27b2-4fde-9c7d-fad99544a2ba 2024-09-16T03:45:04.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:45:04.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDAqedmsx3ZFRAAmR3O6o3M66Ib+eoVNy5JOg== 2024-09-16T03:45:04.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDAqedmsx3ZFRAAmR3O6o3M66Ib+eoVNy5JOg=="}' 2024-09-16T03:45:04.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ff9fb293-27b2-4fde-9c7d-fad99544a2ba -i td/osd-backfill-recovery-log/1/new.json 2024-09-16T03:45:04.935 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:45:04.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/1/new.json 2024-09-16T03:45:04.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDAqedmsx3ZFRAAmR3O6o3M66Ib+eoVNy5JOg== --osd-uuid ff9fb293-27b2-4fde-9c7d-fad99544a2ba 2024-09-16T03:45:04.982 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:04.981+0000 7f9feda24640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:04.984 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:04.983+0000 7f9feda24640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:04.985 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:04.984+0000 7f9feda24640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:04.986 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:04.984+0000 7f9feda24640 -1 bdev(0x55cb20ce3c00 td/osd-backfill-recovery-log/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:45:04.986 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:04.984+0000 7f9feda24640 -1 bluestore(td/osd-backfill-recovery-log/1) _read_fsid unparsable uuid 2024-09-16T03:45:10.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/1/keyring 2024-09-16T03:45:10.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:45:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T03:45:10.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:45:10.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:45:11.247 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T03:45:11.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:45:11.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/1 --osd-journal=td/osd-backfill-recovery-log/1/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:45:11.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:45:11.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:45:11.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:45:11.281 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:11.279+0000 7f9abcdc5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:11.283 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:11.281+0000 7f9abcdc5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:11.284 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:11.282+0000 7f9abcdc5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:11.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:45:11.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:45:11.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:45:11.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:45:11.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:45:11.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:11.705 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:45:11.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:45:11.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:11.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:12.122 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:12.121+0000 7f9abcdc5640 -1 Falling back to public interface 2024-09-16T03:45:12.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:13.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:13.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:13.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:45:13.190 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:45:13.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:13.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:13.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:14.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:14.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:14.641 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:45:14.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:45:14.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:14.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:14.817 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:14.815+0000 7f9abcdc5640 -1 osd.1 0 log_to_monitors true 2024-09-16T03:45:15.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:16.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:16.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:16.119 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:45:16.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:45:16.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:16.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:16.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:17.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:17.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:17.541 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:45:17.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:45:17.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:17.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:18.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:19.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:19.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:19.165 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:45:19.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:45:19.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:19.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:19.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:20.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:20.743 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:45:20.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:20.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:45:20.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:20.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:21.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:22.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:22.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:22.168 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:45:22.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:45:22.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:22.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:22.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:23.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:23.705 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:45:23.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:23.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:45:23.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:23.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:24.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:25.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:25.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:25.208 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:45:25.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:45:25.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:25.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:25.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:26.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:26.745 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:45:26.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:26.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:45:26.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:26.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:27.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:28.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:28.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:28.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:45:28.274 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:45:28.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:28.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:28.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:29.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:29.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:29.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:45:29.818 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:45:29.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:29.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:30.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:31.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:31.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:31.491 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:45:31.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:45:31.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:31.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:32.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:33.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:33.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:33.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:45:33.435 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:45:33.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:33.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:34.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:35.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:35.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:35.272 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:45:35.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:45:35.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:35.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:36.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:37.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:37.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:37.049 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:45:37.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:45:37.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:37.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:37.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:38.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:38.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:38.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:45:38.616 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:45:38.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:38.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:45:39.045 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/320462448,v1:127.0.0.1:6811/320462448] [v2:127.0.0.1:6812/320462448,v1:127.0.0.1:6813/320462448] exists,up ff9fb293-27b2-4fde-9c7d-fad99544a2ba 2024-09-16T03:45:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:45:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:45:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:45:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:45:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 2 2024-09-16T03:45:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:45:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:45:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:45:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:45:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/2 2024-09-16T03:45:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/2' 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/2/journal' 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:45:39.051 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:45:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:45:39.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/2 2024-09-16T03:45:39.053 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:45:39.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=649794f8-9131-41c0-ab23-97adeff10ab6 2024-09-16T03:45:39.053 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 649794f8-9131-41c0-ab23-97adeff10ab6 2024-09-16T03:45:39.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 649794f8-9131-41c0-ab23-97adeff10ab6' 2024-09-16T03:45:39.053 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:45:39.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDjqedmsmkTBBAAf50RevKnZkd0rExvZLPheQ== 2024-09-16T03:45:39.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDjqedmsmkTBBAAf50RevKnZkd0rExvZLPheQ=="}' 2024-09-16T03:45:39.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 649794f8-9131-41c0-ab23-97adeff10ab6 -i td/osd-backfill-recovery-log/2/new.json 2024-09-16T03:45:39.550 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:45:39.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/2/new.json 2024-09-16T03:45:39.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDjqedmsmkTBBAAf50RevKnZkd0rExvZLPheQ== --osd-uuid 649794f8-9131-41c0-ab23-97adeff10ab6 2024-09-16T03:45:39.597 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:39.595+0000 7faf1781e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:39.599 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:39.596+0000 7faf1781e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:39.600 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:39.598+0000 7faf1781e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:39.601 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:39.598+0000 7faf1781e640 -1 bdev(0x5600cd677c00 td/osd-backfill-recovery-log/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:45:39.601 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:39.598+0000 7faf1781e640 -1 bluestore(td/osd-backfill-recovery-log/2) _read_fsid unparsable uuid 2024-09-16T03:45:45.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/2/keyring 2024-09-16T03:45:45.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:45:45.299 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T03:45:45.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:45:45.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:45:45.888 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T03:45:45.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:45:45.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/2 --osd-journal=td/osd-backfill-recovery-log/2/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:45:45.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:45:45.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:45:45.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:45:45.922 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:45.919+0000 7f5f30eef640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:45.924 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:45.921+0000 7f5f30eef640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:45.925 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:45.922+0000 7f5f30eef640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:45:46.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:45:46.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:45:46.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:45:46.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:45:46.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:45:46.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:46.337 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:45:46.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:45:46.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:46.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:45:46.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:47.268 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:47.265+0000 7f5f30eef640 -1 Falling back to public interface 2024-09-16T03:45:47.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:47.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:47.782 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:45:47.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:45:47.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:47.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:45:48.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:49.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:49.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:49.233 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:45:49.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:45:49.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:49.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:45:49.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:50.135 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:45:50.132+0000 7f5f30eef640 -1 osd.2 0 log_to_monitors true 2024-09-16T03:45:50.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:50.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:50.646 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:45:50.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:45:50.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:50.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:45:51.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:52.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:52.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:52.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:45:52.209 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:45:52.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:52.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:45:52.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:53.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:53.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:53.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:45:53.631 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:45:53.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:53.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:45:54.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:55.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:55.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:55.192 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:45:55.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:45:55.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:55.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:45:55.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:56.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:56.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:56.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:45:56.627 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:45:56.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:56.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:45:57.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:58.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:58.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:58.145 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:45:58.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:45:58.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:58.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:45:58.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:45:59.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:45:59.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:45:59.571 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:45:59.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:45:59.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:45:59.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:46:00.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:01.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:01.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:01.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:46:01.040 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:46:01.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:01.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:46:01.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:02.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:02.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:02.456 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:46:02.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:46:02.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:02.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:46:03.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:04.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:04.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:04.372 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:46:04.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:46:04.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:04.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:46:05.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:06.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:06.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:06.116 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:46:06.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:46:06.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:06.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:46:07.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:08.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:08.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:08.019 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:46:08.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:46:08.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:08.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:46:08.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:09.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:09.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:09.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:46:09.925 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:46:09.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:09.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:46:10.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:11.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:11.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:11.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:46:11.662 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:46:11.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:11.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:46:12.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:13.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:13.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:13.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:46:13.394 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:46:13.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:13.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:46:13.815 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3588353352,v1:127.0.0.1:6819/3588353352] [v2:127.0.0.1:6820/3588353352,v1:127.0.0.1:6821/3588353352] exists,up 649794f8-9131-41c0-ab23-97adeff10ab6 2024-09-16T03:46:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:46:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:46:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:46:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:46:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 3 2024-09-16T03:46:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:46:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:46:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T03:46:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:46:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/3 2024-09-16T03:46:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:46:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:46:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:46:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:46:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/3' 2024-09-16T03:46:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/3/journal' 2024-09-16T03:46:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:46:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-09-16T03:46:13.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:46:13.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:46:13.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:46:13.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:46:13.821 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:46:13.821 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:13.821 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:46:13.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:46:13.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:46:13.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:46:13.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:46:13.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:46:13.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:46:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:46:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:46:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:46:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:46:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:46:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:46:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:46:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/3 2024-09-16T03:46:13.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:46:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c5f300aa-5648-4ab9-b9da-61cc6d780d95 2024-09-16T03:46:13.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 c5f300aa-5648-4ab9-b9da-61cc6d780d95' 2024-09-16T03:46:13.823 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 c5f300aa-5648-4ab9-b9da-61cc6d780d95 2024-09-16T03:46:13.823 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:46:13.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAFqudmv/TvMRAA+yqBh4UbY/QadCzOIv+kCw== 2024-09-16T03:46:13.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAFqudmv/TvMRAA+yqBh4UbY/QadCzOIv+kCw=="}' 2024-09-16T03:46:13.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c5f300aa-5648-4ab9-b9da-61cc6d780d95 -i td/osd-backfill-recovery-log/3/new.json 2024-09-16T03:46:14.355 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:46:14.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/3/new.json 2024-09-16T03:46:14.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAFqudmv/TvMRAA+yqBh4UbY/QadCzOIv+kCw== --osd-uuid c5f300aa-5648-4ab9-b9da-61cc6d780d95 2024-09-16T03:46:14.403 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:14.401+0000 7f3690c12640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:14.421 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:14.419+0000 7f3690c12640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:14.422 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:14.420+0000 7f3690c12640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:14.423 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:14.421+0000 7f3690c12640 -1 bdev(0x564bd7cebc00 td/osd-backfill-recovery-log/3/block) open stat got: (1) Operation not permitted 2024-09-16T03:46:14.423 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:14.421+0000 7f3690c12640 -1 bluestore(td/osd-backfill-recovery-log/3) _read_fsid unparsable uuid 2024-09-16T03:46:20.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/3/keyring 2024-09-16T03:46:20.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:46:20.445 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T03:46:20.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T03:46:20.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:46:21.012 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T03:46:21.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T03:46:21.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/3 --osd-journal=td/osd-backfill-recovery-log/3/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:46:21.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:46:21.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:46:21.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:46:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:21.044+0000 7fbf96c19640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:21.046+0000 7fbf96c19640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:21.049 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:21.047+0000 7fbf96c19640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:21.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T03:46:21.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:46:21.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T03:46:21.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:46:21.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:46:21.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:21.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:46:21.475 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:46:21.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:21.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:21.894 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:21.893+0000 7fbf96c19640 -1 Falling back to public interface 2024-09-16T03:46:21.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:22.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:22.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:22.927 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:46:22.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:46:22.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:22.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:23.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:24.248 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:24.247+0000 7fbf96c19640 -1 osd.3 0 log_to_monitors true 2024-09-16T03:46:24.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:24.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:24.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:46:24.379 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:46:24.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:24.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:24.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:25.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:25.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:25.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:46:25.963 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:46:25.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:25.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:26.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:27.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:27.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:27.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:46:27.403 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:46:27.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:27.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:27.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:28.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:28.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:28.852 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:46:28.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:46:28.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:28.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:29.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:30.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:30.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:30.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:46:30.273 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:46:30.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:30.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:30.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:31.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:31.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:31.697 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:46:31.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:46:31.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:31.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:32.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:33.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:33.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:33.206 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:46:33.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:46:33.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:33.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:33.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:34.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:34.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:34.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:46:34.643 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:46:34.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:34.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:35.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:36.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:36.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:36.076 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:46:36.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:46:36.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:36.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:36.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:37.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:37.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:37.702 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:46:37.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:46:37.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:37.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:38.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:39.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:39.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:39.405 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:46:39.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:46:39.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:39.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:40.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:41.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:41.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:41.215 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:46:41.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:46:41.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:41.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:41.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:42.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:42.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:42.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:46:42.904 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:46:42.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:42.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:44.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:45.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:45.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:45.052 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:46:45.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:46:45.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:45.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:45.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:46.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:46.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:46.854 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:46:46.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:46:46.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:46.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T03:46:47.307 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/783726545,v1:127.0.0.1:6827/783726545] [v2:127.0.0.1:6828/783726545,v1:127.0.0.1:6829/783726545] exists,up c5f300aa-5648-4ab9-b9da-61cc6d780d95 2024-09-16T03:46:47.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:46:47.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:46:47.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:46:47.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:46:47.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 4 2024-09-16T03:46:47.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:46:47.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:46:47.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/4 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/4' 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/4/journal' 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:46:47.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:46:47.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:46:47.315 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:46:47.315 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:46:47.315 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:46:47.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:46:47.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:46:47.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:46:47.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/4 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3383a617-17ff-4562-9871-e29a5190ab5e 2024-09-16T03:46:47.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 3383a617-17ff-4562-9871-e29a5190ab5e' 2024-09-16T03:46:47.317 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 3383a617-17ff-4562-9871-e29a5190ab5e 2024-09-16T03:46:47.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:46:47.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAnqudmpBKsExAArm5rwLyIAU+gQYsVKYdVUQ== 2024-09-16T03:46:47.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAnqudmpBKsExAArm5rwLyIAU+gQYsVKYdVUQ=="}' 2024-09-16T03:46:47.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3383a617-17ff-4562-9871-e29a5190ab5e -i td/osd-backfill-recovery-log/4/new.json 2024-09-16T03:46:47.888 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:46:47.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/4/new.json 2024-09-16T03:46:47.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAnqudmpBKsExAArm5rwLyIAU+gQYsVKYdVUQ== --osd-uuid 3383a617-17ff-4562-9871-e29a5190ab5e 2024-09-16T03:46:47.936 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:47.933+0000 7feeec3c5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:47.974 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:47.971+0000 7feeec3c5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:47.975 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:47.973+0000 7feeec3c5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:47.976 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:47.973+0000 7feeec3c5640 -1 bdev(0x55651ab47c00 td/osd-backfill-recovery-log/4/block) open stat got: (1) Operation not permitted 2024-09-16T03:46:47.976 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:47.973+0000 7feeec3c5640 -1 bluestore(td/osd-backfill-recovery-log/4) _read_fsid unparsable uuid 2024-09-16T03:46:53.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/4/keyring 2024-09-16T03:46:53.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:46:53.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T03:46:53.889 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T03:46:53.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:46:54.451 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T03:46:54.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T03:46:54.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/4 --osd-journal=td/osd-backfill-recovery-log/4/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:46:54.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:46:54.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:46:54.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:46:54.485 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:54.482+0000 7fc30dc0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:54.488 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:54.485+0000 7fc30dc0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:54.489 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:54.487+0000 7fc30dc0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:46:54.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T03:46:54.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:46:54.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T03:46:54.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:46:54.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:46:54.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:54.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:46:54.929 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:46:54.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:54.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:46:55.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:56.083 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:56.080+0000 7fc30dc0d640 -1 Falling back to public interface 2024-09-16T03:46:56.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:56.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:56.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:46:56.363 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:46:56.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:56.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:46:56.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:57.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:57.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:57.789 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:46:57.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:46:57.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:57.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:46:58.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:46:58.652 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:46:58.650+0000 7fc30dc0d640 -1 osd.4 0 log_to_monitors true 2024-09-16T03:46:59.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:46:59.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:46:59.208 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:46:59.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:46:59.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:46:59.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:46:59.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:00.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:00.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:00.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:47:00.693 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:47:00.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:00.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:01.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:02.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:02.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:02.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:47:02.165 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:47:02.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:02.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:02.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:03.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:03.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:03.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:47:03.632 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:47:03.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:03.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:04.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:05.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:05.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:05.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:47:05.141 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:47:05.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:05.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:05.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:06.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:06.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:06.674 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:47:06.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:47:06.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:06.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:07.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:08.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:08.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:08.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:47:08.174 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:47:08.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:08.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:08.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:09.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:09.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:09.591 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:47:09.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:47:09.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:09.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:10.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:11.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:11.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:11.082 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:47:11.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:47:11.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:11.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:11.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:12.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:12.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:12.595 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:47:12.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:47:12.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:12.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:13.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:14.730 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:47:14.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:14.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:47:14.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:14.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:15.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:16.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:16.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:16.723 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:47:16.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:47:16.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:16.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:17.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:18.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:18.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:18.255 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:47:18.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:47:18.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:18.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:18.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:19.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:19.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:19.949 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:47:19.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:47:19.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:19.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:20.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:21.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:21.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:21.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:47:21.711 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:47:21.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:21.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:22.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:23.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:23.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:23.328 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T03:47:23.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:47:23.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:23.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T03:47:23.755 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1088568587,v1:127.0.0.1:6835/1088568587] [v2:127.0.0.1:6836/1088568587,v1:127.0.0.1:6837/1088568587] exists,up 3383a617-17ff-4562-9871-e29a5190ab5e 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:55: _common_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:57: _common_test: run_osd td/osd-backfill-recovery-log 5 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-recovery-log 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-recovery-log/5 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:47:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:47:23.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:47:23.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-recovery-log/5' 2024-09-16T03:47:23.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-recovery-log/5/journal' 2024-09-16T03:47:23.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:47:23.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+=' --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10' 2024-09-16T03:47:23.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-recovery-log' 2024-09-16T03:47:23.760 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:47:23.760 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:47:23.760 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:47:23.760 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:47:23.760 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:47:23.760 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:47:23.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:47:23.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' 2024-09-16T03:47:23.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:47:23.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:47:23.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:47:23.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-recovery-log/$name.log' 2024-09-16T03:47:23.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-recovery-log/$name.pid' 2024-09-16T03:47:23.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:47:23.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:47:23.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:47:23.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:47:23.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:47:23.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:47:23.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-recovery-log/5 2024-09-16T03:47:23.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:47:23.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8b049b6f-7aac-45c6-8009-e9859e090af8 2024-09-16T03:47:23.762 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 8b049b6f-7aac-45c6-8009-e9859e090af8 2024-09-16T03:47:23.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 8b049b6f-7aac-45c6-8009-e9859e090af8' 2024-09-16T03:47:23.763 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:47:23.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBLqudm8htdLhAACGU0gsFw13Nbv0QPdC3q7g== 2024-09-16T03:47:23.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBLqudm8htdLhAACGU0gsFw13Nbv0QPdC3q7g=="}' 2024-09-16T03:47:23.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8b049b6f-7aac-45c6-8009-e9859e090af8 -i td/osd-backfill-recovery-log/5/new.json 2024-09-16T03:47:24.253 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:47:24.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-recovery-log/5/new.json 2024-09-16T03:47:24.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBLqudm8htdLhAACGU0gsFw13Nbv0QPdC3q7g== --osd-uuid 8b049b6f-7aac-45c6-8009-e9859e090af8 2024-09-16T03:47:24.300 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:47:24.298+0000 7f18c76b4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:47:24.308 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:47:24.306+0000 7f18c76b4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:47:24.309 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:47:24.307+0000 7f18c76b4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:47:24.309 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:47:24.308+0000 7f18c76b4640 -1 bdev(0x55d17411bc00 td/osd-backfill-recovery-log/5/block) open stat got: (1) Operation not permitted 2024-09-16T03:47:24.310 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:47:24.308+0000 7f18c76b4640 -1 bluestore(td/osd-backfill-recovery-log/5) _read_fsid unparsable uuid 2024-09-16T03:47:30.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-recovery-log/5/keyring 2024-09-16T03:47:30.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:47:30.849 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T03:47:30.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T03:47:30.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-recovery-log/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:47:31.415 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T03:47:31.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T03:47:31.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=be2caf07-1f59-44a8-981b-2ea3f9529889 --auth-supported=none --mon-host=127.0.0.1:7129 --osd_max_backfills=1 --debug_reserver=20 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-recovery-log/5 --osd-journal=td/osd-backfill-recovery-log/5/journal --chdir= --osd_min_pg_log_entries=150 --osd_max_pg_log_entries=150 --osd_pg_log_dups_tracked=3000 --osd_pg_log_trim_min=10 --run-dir=td/osd-backfill-recovery-log '--admin-socket=/tmp/ceph-asok.53196/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-recovery-log/$name.log' '--pid-file=td/osd-backfill-recovery-log/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:47:31.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:47:31.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:47:31.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:47:31.448 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:47:31.446+0000 7fa40e81e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:47:31.455 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:47:31.453+0000 7fa40e81e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:47:31.456 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:47:31.455+0000 7fa40e81e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:47:31.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T03:47:31.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:47:31.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T03:47:31.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:47:31.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:47:31.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:31.848 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:47:31.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:47:31.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:31.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:32.297 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:47:32.296+0000 7fa40e81e640 -1 Falling back to public interface 2024-09-16T03:47:32.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:33.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:33.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:33.332 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:47:33.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:47:33.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:33.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:33.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:34.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:34.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:34.752 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:47:34.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:47:34.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:34.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:34.967 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:47:34.965+0000 7fa40e81e640 -1 osd.5 0 log_to_monitors true 2024-09-16T03:47:35.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:36.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:36.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:36.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:47:36.183 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:47:36.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:36.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:36.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:37.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:37.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:37.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:47:37.602 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:47:37.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:37.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:38.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:39.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:39.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:39.180 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:47:39.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:47:39.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:39.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:39.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:40.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:40.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:40.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:47:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:47:40.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:40.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:41.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:42.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:42.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:42.088 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:47:42.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:47:42.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:42.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:42.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:43.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:43.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:43.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:47:43.505 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:47:43.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:43.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:43.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:44.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:44.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:44.922 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:47:44.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:47:44.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:44.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:45.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:46.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:46.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:46.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:47:46.340 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:47:46.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:46.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:47.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:48.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:48.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:48.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:47:48.118 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:47:48.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:48.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:48.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:50.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:50.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:50.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:47:50.001 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:47:50.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:50.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:51.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:52.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:52.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:52.098 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:47:52.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:47:52.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:52.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:52.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:53.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:53.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:53.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:47:53.913 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:47:53.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:53.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:54.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:55.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:55.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:55.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:47:55.695 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:47:55.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:55.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:56.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:47:57.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:47:57.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:47:57.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:47:57.481 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:47:57.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:47:57.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T03:47:57.902 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/4008573673,v1:127.0.0.1:6843/4008573673] [v2:127.0.0.1:6844/4008573673,v1:127.0.0.1:6845/4008573673] exists,up 8b049b6f-7aac-45c6-8009-e9859e090af8 2024-09-16T03:47:57.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:47:57.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:47:57.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:47:57.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:60: _common_test: create_pool test 1 1 2024-09-16T03:47:57.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2024-09-16T03:47:58.540 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T03:47:58.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:47:59.553 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: seq 1 141 2024-09-16T03:47:59.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:47:59.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-1 /etc/passwd 2024-09-16T03:47:59.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:47:59.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-2 /etc/passwd 2024-09-16T03:47:59.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:47:59.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-3 /etc/passwd 2024-09-16T03:48:00.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:00.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-4 /etc/passwd 2024-09-16T03:48:00.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:00.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-5 /etc/passwd 2024-09-16T03:48:00.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:00.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-6 /etc/passwd 2024-09-16T03:48:00.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:00.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-7 /etc/passwd 2024-09-16T03:48:00.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:00.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-8 /etc/passwd 2024-09-16T03:48:00.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:00.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-9 /etc/passwd 2024-09-16T03:48:01.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:01.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-10 /etc/passwd 2024-09-16T03:48:01.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:01.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-11 /etc/passwd 2024-09-16T03:48:01.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:01.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-12 /etc/passwd 2024-09-16T03:48:01.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:01.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-13 /etc/passwd 2024-09-16T03:48:01.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:01.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-14 /etc/passwd 2024-09-16T03:48:01.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:01.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-15 /etc/passwd 2024-09-16T03:48:02.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:02.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-16 /etc/passwd 2024-09-16T03:48:02.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:02.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-17 /etc/passwd 2024-09-16T03:48:02.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:02.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-18 /etc/passwd 2024-09-16T03:48:02.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:02.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-19 /etc/passwd 2024-09-16T03:48:02.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:02.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-20 /etc/passwd 2024-09-16T03:48:02.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:02.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-21 /etc/passwd 2024-09-16T03:48:02.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:02.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-22 /etc/passwd 2024-09-16T03:48:03.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:03.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-23 /etc/passwd 2024-09-16T03:48:03.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:03.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-24 /etc/passwd 2024-09-16T03:48:03.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:03.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-25 /etc/passwd 2024-09-16T03:48:03.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:03.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-26 /etc/passwd 2024-09-16T03:48:03.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:03.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-27 /etc/passwd 2024-09-16T03:48:03.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:03.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-28 /etc/passwd 2024-09-16T03:48:03.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:03.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-29 /etc/passwd 2024-09-16T03:48:04.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:04.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-30 /etc/passwd 2024-09-16T03:48:04.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:04.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-31 /etc/passwd 2024-09-16T03:48:04.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:04.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-32 /etc/passwd 2024-09-16T03:48:04.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:04.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-33 /etc/passwd 2024-09-16T03:48:04.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:04.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-34 /etc/passwd 2024-09-16T03:48:04.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:04.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-35 /etc/passwd 2024-09-16T03:48:04.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:04.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-36 /etc/passwd 2024-09-16T03:48:05.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:05.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-37 /etc/passwd 2024-09-16T03:48:05.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:05.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-38 /etc/passwd 2024-09-16T03:48:05.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:05.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-39 /etc/passwd 2024-09-16T03:48:05.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:05.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-40 /etc/passwd 2024-09-16T03:48:05.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:05.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-41 /etc/passwd 2024-09-16T03:48:05.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:05.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-42 /etc/passwd 2024-09-16T03:48:06.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:06.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-43 /etc/passwd 2024-09-16T03:48:06.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:06.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-44 /etc/passwd 2024-09-16T03:48:06.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:06.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-45 /etc/passwd 2024-09-16T03:48:06.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:06.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-46 /etc/passwd 2024-09-16T03:48:06.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:06.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-47 /etc/passwd 2024-09-16T03:48:06.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:06.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-48 /etc/passwd 2024-09-16T03:48:06.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:06.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-49 /etc/passwd 2024-09-16T03:48:07.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:07.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-50 /etc/passwd 2024-09-16T03:48:07.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:07.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-51 /etc/passwd 2024-09-16T03:48:07.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:07.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-52 /etc/passwd 2024-09-16T03:48:07.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:07.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-53 /etc/passwd 2024-09-16T03:48:07.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:07.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-54 /etc/passwd 2024-09-16T03:48:07.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:07.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-55 /etc/passwd 2024-09-16T03:48:08.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:08.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-56 /etc/passwd 2024-09-16T03:48:08.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:08.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-57 /etc/passwd 2024-09-16T03:48:08.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:08.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-58 /etc/passwd 2024-09-16T03:48:08.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:08.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-59 /etc/passwd 2024-09-16T03:48:08.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:08.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-60 /etc/passwd 2024-09-16T03:48:08.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:08.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-61 /etc/passwd 2024-09-16T03:48:08.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:08.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-62 /etc/passwd 2024-09-16T03:48:09.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:09.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-63 /etc/passwd 2024-09-16T03:48:09.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:09.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-64 /etc/passwd 2024-09-16T03:48:09.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:09.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-65 /etc/passwd 2024-09-16T03:48:09.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:09.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-66 /etc/passwd 2024-09-16T03:48:09.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:09.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-67 /etc/passwd 2024-09-16T03:48:09.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:09.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-68 /etc/passwd 2024-09-16T03:48:10.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:10.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-69 /etc/passwd 2024-09-16T03:48:10.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:10.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-70 /etc/passwd 2024-09-16T03:48:10.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:10.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-71 /etc/passwd 2024-09-16T03:48:10.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:10.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-72 /etc/passwd 2024-09-16T03:48:10.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:10.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-73 /etc/passwd 2024-09-16T03:48:10.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:10.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-74 /etc/passwd 2024-09-16T03:48:10.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:10.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-75 /etc/passwd 2024-09-16T03:48:11.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:11.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-76 /etc/passwd 2024-09-16T03:48:11.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:11.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-77 /etc/passwd 2024-09-16T03:48:11.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:11.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-78 /etc/passwd 2024-09-16T03:48:11.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:11.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-79 /etc/passwd 2024-09-16T03:48:11.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:11.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-80 /etc/passwd 2024-09-16T03:48:11.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:11.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-81 /etc/passwd 2024-09-16T03:48:11.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:11.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-82 /etc/passwd 2024-09-16T03:48:12.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:12.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-83 /etc/passwd 2024-09-16T03:48:12.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:12.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-84 /etc/passwd 2024-09-16T03:48:12.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:12.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-85 /etc/passwd 2024-09-16T03:48:12.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:12.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-86 /etc/passwd 2024-09-16T03:48:12.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:12.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-87 /etc/passwd 2024-09-16T03:48:12.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:12.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-88 /etc/passwd 2024-09-16T03:48:12.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:12.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-89 /etc/passwd 2024-09-16T03:48:13.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:13.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-90 /etc/passwd 2024-09-16T03:48:13.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:13.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-91 /etc/passwd 2024-09-16T03:48:13.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:13.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-92 /etc/passwd 2024-09-16T03:48:13.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:13.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-93 /etc/passwd 2024-09-16T03:48:13.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:13.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-94 /etc/passwd 2024-09-16T03:48:13.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:13.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-95 /etc/passwd 2024-09-16T03:48:13.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:13.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-96 /etc/passwd 2024-09-16T03:48:14.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:14.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-97 /etc/passwd 2024-09-16T03:48:14.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:14.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-98 /etc/passwd 2024-09-16T03:48:14.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:14.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-99 /etc/passwd 2024-09-16T03:48:14.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:14.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-100 /etc/passwd 2024-09-16T03:48:14.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:14.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-101 /etc/passwd 2024-09-16T03:48:14.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:14.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-102 /etc/passwd 2024-09-16T03:48:15.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:15.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-103 /etc/passwd 2024-09-16T03:48:15.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:15.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-104 /etc/passwd 2024-09-16T03:48:15.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:15.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-105 /etc/passwd 2024-09-16T03:48:15.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:15.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-106 /etc/passwd 2024-09-16T03:48:15.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:15.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-107 /etc/passwd 2024-09-16T03:48:15.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:15.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-108 /etc/passwd 2024-09-16T03:48:15.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:15.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-109 /etc/passwd 2024-09-16T03:48:16.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:16.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-110 /etc/passwd 2024-09-16T03:48:16.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:16.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-111 /etc/passwd 2024-09-16T03:48:16.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:16.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-112 /etc/passwd 2024-09-16T03:48:16.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:16.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-113 /etc/passwd 2024-09-16T03:48:16.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:16.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-114 /etc/passwd 2024-09-16T03:48:16.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:16.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-115 /etc/passwd 2024-09-16T03:48:16.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:16.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-116 /etc/passwd 2024-09-16T03:48:17.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:17.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-117 /etc/passwd 2024-09-16T03:48:17.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:17.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-118 /etc/passwd 2024-09-16T03:48:17.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:17.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-119 /etc/passwd 2024-09-16T03:48:17.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:17.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-120 /etc/passwd 2024-09-16T03:48:17.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:17.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-121 /etc/passwd 2024-09-16T03:48:17.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:17.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-122 /etc/passwd 2024-09-16T03:48:18.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:18.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-123 /etc/passwd 2024-09-16T03:48:18.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:18.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-124 /etc/passwd 2024-09-16T03:48:18.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:18.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-125 /etc/passwd 2024-09-16T03:48:18.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:18.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-126 /etc/passwd 2024-09-16T03:48:18.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:18.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-127 /etc/passwd 2024-09-16T03:48:18.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:18.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-128 /etc/passwd 2024-09-16T03:48:18.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:18.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-129 /etc/passwd 2024-09-16T03:48:19.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:19.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-130 /etc/passwd 2024-09-16T03:48:19.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:19.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-131 /etc/passwd 2024-09-16T03:48:19.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:19.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-132 /etc/passwd 2024-09-16T03:48:19.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:19.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-133 /etc/passwd 2024-09-16T03:48:19.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:19.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-134 /etc/passwd 2024-09-16T03:48:19.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:19.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-135 /etc/passwd 2024-09-16T03:48:19.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:19.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-136 /etc/passwd 2024-09-16T03:48:20.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:20.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-137 /etc/passwd 2024-09-16T03:48:20.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:20.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-138 /etc/passwd 2024-09-16T03:48:20.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:20.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-139 /etc/passwd 2024-09-16T03:48:20.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:20.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-140 /etc/passwd 2024-09-16T03:48:20.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:62: _common_test: for j in $(seq 1 $objects) 2024-09-16T03:48:20.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:64: _common_test: rados -p test put obj-141 /etc/passwd 2024-09-16T03:48:20.812 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph pg dump pgs --format=json 2024-09-16T03:48:20.813 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: jq '.pg_stats[0].up[]' 2024-09-16T03:48:21.216 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:48:21.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:68: _common_test: ceph osd out 1 0 2 2024-09-16T03:48:21.755 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. osd.0 is already out. osd.2 is already out. 2024-09-16T03:48:21.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:69: _common_test: '[' 20 '!=' 0 ']' 2024-09-16T03:48:21.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: seq 1 20 2024-09-16T03:48:21.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:21.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-1 /etc/passwd 2024-09-16T03:48:25.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:25.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-2 /etc/passwd 2024-09-16T03:48:26.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:26.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-3 /etc/passwd 2024-09-16T03:48:26.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:26.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-4 /etc/passwd 2024-09-16T03:48:26.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:26.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-5 /etc/passwd 2024-09-16T03:48:26.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:26.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-6 /etc/passwd 2024-09-16T03:48:27.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:27.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-7 /etc/passwd 2024-09-16T03:48:27.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:27.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-8 /etc/passwd 2024-09-16T03:48:27.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:27.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-9 /etc/passwd 2024-09-16T03:48:27.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:27.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-10 /etc/passwd 2024-09-16T03:48:28.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:28.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-11 /etc/passwd 2024-09-16T03:48:28.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:28.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-12 /etc/passwd 2024-09-16T03:48:28.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:28.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-13 /etc/passwd 2024-09-16T03:48:28.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:28.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-14 /etc/passwd 2024-09-16T03:48:29.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:29.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-15 /etc/passwd 2024-09-16T03:48:29.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:29.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-16 /etc/passwd 2024-09-16T03:48:29.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:29.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-17 /etc/passwd 2024-09-16T03:48:29.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:29.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-18 /etc/passwd 2024-09-16T03:48:30.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:30.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-19 /etc/passwd 2024-09-16T03:48:30.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:70: _common_test: for j in $(seq 1 $moreobjects) 2024-09-16T03:48:30.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:72: _common_test: rados -p test put obj-more-20 /etc/passwd 2024-09-16T03:48:30.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:75: _common_test: sleep 1 2024-09-16T03:48:31.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:76: _common_test: wait_for_clean 2024-09-16T03:48:31.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:48:31.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:48:31.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:48:31.624 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:48:31.624 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:48:31.624 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:48:31.624 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:48:31.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:48:31.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:48:31.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:48:31.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:48:31.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:48:31.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:48:31.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:48:31.725 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:48:32.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:48:32.242 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:48:32.243 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:48:32.243 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:48:32.243 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T03:48:32.243 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T03:48:32.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:48:32.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:48:32.243 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:48:32.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836526 2024-09-16T03:48:32.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836526 2024-09-16T03:48:32.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526' 2024-09-16T03:48:32.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:48:32.366 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:48:32.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672998 2024-09-16T03:48:32.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672998 2024-09-16T03:48:32.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672998' 2024-09-16T03:48:32.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:48:32.520 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:48:32.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509472 2024-09-16T03:48:32.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509472 2024-09-16T03:48:32.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672998 2-64424509472' 2024-09-16T03:48:32.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:48:32.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:48:32.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345945 2024-09-16T03:48:32.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345945 2024-09-16T03:48:32.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672998 2-64424509472 3-85899345945' 2024-09-16T03:48:32.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:48:32.803 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:48:32.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182416 2024-09-16T03:48:32.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182416 2024-09-16T03:48:32.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672998 2-64424509472 3-85899345945 4-107374182416' 2024-09-16T03:48:32.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:48:32.923 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T03:48:33.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018895 2024-09-16T03:48:33.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018895 2024-09-16T03:48:33.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672998 2-64424509472 3-85899345945 4-107374182416 5-128849018895' 2024-09-16T03:48:33.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:48:33.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836526 2024-09-16T03:48:33.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:48:33.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:48:33.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836526 2024-09-16T03:48:33.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:48:33.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836526 2024-09-16T03:48:33.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836526' 2024-09-16T03:48:33.045 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836526 2024-09-16T03:48:33.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:48:33.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836526 -lt 21474836526 2024-09-16T03:48:33.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:48:33.452 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672998 2024-09-16T03:48:33.452 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:48:33.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:48:33.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672998 2024-09-16T03:48:33.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:48:33.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672998 2024-09-16T03:48:33.455 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672998 2024-09-16T03:48:33.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672998' 2024-09-16T03:48:33.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:48:33.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672998 -lt 42949672998 2024-09-16T03:48:33.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:48:33.918 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509472 2024-09-16T03:48:33.918 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:48:33.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:48:33.919 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509472 2024-09-16T03:48:33.919 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:48:33.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509472 2024-09-16T03:48:33.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509472' 2024-09-16T03:48:33.921 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509472 2024-09-16T03:48:33.921 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:48:34.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509472 -lt 64424509472 2024-09-16T03:48:34.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:48:34.446 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345945 2024-09-16T03:48:34.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:48:34.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:48:34.448 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345945 2024-09-16T03:48:34.448 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:48:34.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345945 2024-09-16T03:48:34.449 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345945 2024-09-16T03:48:34.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345945' 2024-09-16T03:48:34.450 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:48:34.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345945 -lt 85899345945 2024-09-16T03:48:34.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:48:34.993 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182416 2024-09-16T03:48:34.993 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:48:34.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:48:34.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182416 2024-09-16T03:48:34.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:48:34.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182416 2024-09-16T03:48:34.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182416' 2024-09-16T03:48:34.996 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182416 2024-09-16T03:48:34.996 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:48:35.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182417 -lt 107374182416 2024-09-16T03:48:35.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:48:35.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018895 2024-09-16T03:48:35.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:48:35.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T03:48:35.489 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018895 2024-09-16T03:48:35.489 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:48:35.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018895 2024-09-16T03:48:35.491 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018895 2024-09-16T03:48:35.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018895' 2024-09-16T03:48:35.491 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T03:48:35.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018896 -lt 128849018895 2024-09-16T03:48:35.984 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:48:35.984 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:48:35.984 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:48:36.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T03:48:36.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:48:36.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:48:36.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:48:36.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:48:36.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:48:36.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:48:36.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:48:37.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:48:37.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:48:37.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:48:37.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:48:37.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:48:37.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T03:48:37.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T03:48:37.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T03:48:37.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:48:37.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:48:37.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:48:37.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:48:37.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:48:37.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:48:37.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:48:37.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:48:37.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:48:37.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:48:38.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:48:38.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:48:38.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:48:38.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:48:38.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:48:38.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:48:38.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:48:38.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:48:38.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:48:38.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:48:38.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:48:38.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:48:38.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:48:39.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=53640 2024-09-16T03:48:39.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 53640 '!=' null 2024-09-16T03:48:39.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:48:39.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:48:39.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:48:39.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:48:39.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:48:39.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:48:39.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:48:39.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:48:39.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:48:39.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:48:39.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:48:39.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:48:39.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:48:39.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:48:39.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:48:40.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:48:40.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:48:40.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:48:40.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:48:40.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:48:40.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:48:40.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:48:40.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:48:40.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:48:41.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=94407 2024-09-16T03:48:41.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 94407 '!=' null 2024-09-16T03:48:41.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:48:41.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:48:41.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:48:41.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:48:41.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:48:41.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:48:41.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:48:41.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:48:41.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:48:41.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:48:41.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:48:41.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:48:41.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:48:41.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:48:41.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:48:42.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:48:42.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:48:42.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:48:42.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:48:42.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:48:42.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:48:42.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:48:42.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:48:42.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:48:42.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=94407 2024-09-16T03:48:42.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 94407 '!=' null 2024-09-16T03:48:42.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:48:42.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:48:42.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:48:42.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:48:42.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:48:42.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:48:42.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:48:42.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:48:42.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:48:42.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:48:42.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:48:43.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:48:43.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:48:43.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:48:43.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:48:44.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:48:44.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:48:44.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:48:44.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:48:44.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:48:44.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:48:44.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:48:44.020 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:48:44.020 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:48:44.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=78316 2024-09-16T03:48:44.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 78316 '!=' null 2024-09-16T03:48:44.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:48:44.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:48:44.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:48:44.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:48:44.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:48:44.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:48:44.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:48:44.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:48:44.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:48:44.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:48:44.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:48:45.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:48:45.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:48:45.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:48:45.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:48:46.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:48:46.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:48:46.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:48:46.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:48:46.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:48:46.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:48:46.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:48:46.026 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:48:46.026 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:48:46.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=100846 2024-09-16T03:48:46.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 100846 '!=' null 2024-09-16T03:48:46.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:48:46.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:48:46.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:48:46.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:48:46.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:48:46.725 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:48:46.725 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:48:46.725 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:48:46.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:48:46.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:48:46.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:48:47.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:48:47.121 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:48:47.121 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:48:47.122 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:48:47.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:48:47.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:48:47.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:48:47.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:48:47.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:48:47.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:48:47.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:48:47.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:48:47.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:48:48.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=127131 2024-09-16T03:48:48.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 127131 '!=' null 2024-09-16T03:48:48.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:48:48.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:48:48.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:48:48.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:48:48.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:48:48.350 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:48:48.350 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:48:48.350 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:48:48.350 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:48:48.350 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:48:48.350 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:48:48.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:48:48.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:48:48.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:48:48.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:48:49.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T03:48:49.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:48:49.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:48:49.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:78: _common_test: flush_pg_stats 2024-09-16T03:48:49.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:48:49.300 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:48:49.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:48:49.733 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:48:49.734 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:48:49.734 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:48:49.734 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T03:48:49.734 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T03:48:49.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:48:49.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:48:49.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:48:49.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836532 2024-09-16T03:48:49.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836532 2024-09-16T03:48:49.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532' 2024-09-16T03:48:49.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:48:49.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:48:49.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673004 2024-09-16T03:48:49.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673004 2024-09-16T03:48:49.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673004' 2024-09-16T03:48:49.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:48:49.972 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:48:50.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509478 2024-09-16T03:48:50.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509478 2024-09-16T03:48:50.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673004 2-64424509478' 2024-09-16T03:48:50.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:48:50.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T03:48:50.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345950 2024-09-16T03:48:50.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345950 2024-09-16T03:48:50.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673004 2-64424509478 3-85899345950' 2024-09-16T03:48:50.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:48:50.209 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T03:48:50.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182422 2024-09-16T03:48:50.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182422 2024-09-16T03:48:50.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673004 2-64424509478 3-85899345950 4-107374182422' 2024-09-16T03:48:50.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:48:50.328 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T03:48:50.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018901 2024-09-16T03:48:50.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018901 2024-09-16T03:48:50.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673004 2-64424509478 3-85899345950 4-107374182422 5-128849018901' 2024-09-16T03:48:50.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:48:50.446 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836532 2024-09-16T03:48:50.446 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:48:50.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:48:50.450 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836532 2024-09-16T03:48:50.450 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:48:50.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836532 2024-09-16T03:48:50.451 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836532 2024-09-16T03:48:50.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836532' 2024-09-16T03:48:50.451 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:48:50.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836532 -lt 21474836532 2024-09-16T03:48:50.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:48:50.884 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673004 2024-09-16T03:48:50.884 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:48:50.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:48:50.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673004 2024-09-16T03:48:50.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:48:50.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673004 2024-09-16T03:48:50.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673004' 2024-09-16T03:48:50.887 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673004 2024-09-16T03:48:50.887 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:48:51.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673004 -lt 42949673004 2024-09-16T03:48:51.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:48:51.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509478 2024-09-16T03:48:51.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:48:51.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:48:51.338 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509478 2024-09-16T03:48:51.338 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:48:51.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509478 2024-09-16T03:48:51.339 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509478 2024-09-16T03:48:51.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509478' 2024-09-16T03:48:51.339 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:48:51.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509478 -lt 64424509478 2024-09-16T03:48:51.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:48:51.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345950 2024-09-16T03:48:51.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:48:51.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T03:48:51.775 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345950 2024-09-16T03:48:51.775 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:48:51.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345950 2024-09-16T03:48:51.776 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345950 2024-09-16T03:48:51.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345950' 2024-09-16T03:48:51.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T03:48:52.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345950 -lt 85899345950 2024-09-16T03:48:52.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:48:52.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182422 2024-09-16T03:48:52.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:48:52.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T03:48:52.215 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182422 2024-09-16T03:48:52.215 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:48:52.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182422 2024-09-16T03:48:52.216 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182422 2024-09-16T03:48:52.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182422' 2024-09-16T03:48:52.216 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T03:48:52.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182422 -lt 107374182422 2024-09-16T03:48:52.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:48:52.681 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018901 2024-09-16T03:48:52.681 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:48:52.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T03:48:52.682 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018901 2024-09-16T03:48:52.682 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:48:52.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018901 2024-09-16T03:48:52.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018901' 2024-09-16T03:48:52.684 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018901 2024-09-16T03:48:52.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T03:48:53.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018901 -lt 128849018901 2024-09-16T03:48:53.124 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: ceph pg dump pgs --format=json 2024-09-16T03:48:53.124 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: jq '.pg_stats[0].up_primary' 2024-09-16T03:48:53.509 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:48:53.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:80: _common_test: newprimary=4 2024-09-16T03:48:53.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:81: _common_test: kill_daemons 2024-09-16T03:48:53.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:48:53.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:48:53.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:48:53.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:48:53.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:48:58.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:48:58.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:83: _common_test: ERRORS=0 2024-09-16T03:48:58.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: _objectstore_tool_nodown td/osd-backfill-recovery-log 4 --no-mon-config --pgid 1.0 --op log 2024-09-16T03:48:58.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:48:58.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2024-09-16T03:48:58.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=4 2024-09-16T03:48:58.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2024-09-16T03:48:58.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-backfill-recovery-log/4 2024-09-16T03:48:58.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-recovery-log/4 --no-mon-config --pgid 1.0 --op log 2024-09-16T03:48:58.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:84: _common_test: tee td/osd-backfill-recovery-log/result.log 2024-09-16T03:49:00.237 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2024-09-16T03:49:00.237 INFO:tasks.workunit.client.0.smithi026.stdout: "pg_log_t": { 2024-09-16T03:49:00.237 INFO:tasks.workunit.client.0.smithi026.stdout: "head": "38'161", 2024-09-16T03:49:00.237 INFO:tasks.workunit.client.0.smithi026.stdout: "tail": "34'10", 2024-09-16T03:49:00.237 INFO:tasks.workunit.client.0.smithi026.stdout: "log": [ 2024-09-16T03:49:00.237 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.237 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.237 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1e6eca61:::obj-11:head", 2024-09-16T03:49:00.237 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'11", 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4409.0:1", 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:01.320519+0000", 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.238 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:18dee445:::obj-12:head", 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'12", 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.239 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4412.0:1", 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:01.462341+0000", 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.240 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:283c5c90:::obj-13:head", 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'13", 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4415.0:1", 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:01.641103+0000", 2024-09-16T03:49:00.241 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.242 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.242 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.242 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.242 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.242 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.242 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.242 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.242 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.242 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.242 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.242 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:cc896bf0:::obj-14:head", 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'14", 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4418.0:1", 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:01.781997+0000", 2024-09-16T03:49:00.243 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.244 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:a581f807:::obj-15:head", 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'15", 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4421.0:1", 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:01.941850+0000", 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.245 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.246 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:c902ca7c:::obj-16:head", 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'16", 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4424.0:1", 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:02.084228+0000", 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.247 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.248 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.248 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.248 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.248 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.248 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.248 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.248 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.248 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.248 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.248 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.248 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.248 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:655283c8:::obj-17:head", 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'17", 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4427.0:1", 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:02.227060+0000", 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.249 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:d759d762:::obj-18:head", 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'18", 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.250 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4430.0:1", 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:02.360034+0000", 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.251 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1b934a2d:::obj-19:head", 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'19", 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4433.0:1", 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:02.510795+0000", 2024-09-16T03:49:00.252 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.253 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1d0ea2ca:::obj-20:head", 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'20", 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4436.0:1", 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:02.653057+0000", 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.254 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.255 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:ab396690:::obj-21:head", 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'21", 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4439.0:1", 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:02.811699+0000", 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.256 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:254983db:::obj-22:head", 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'22", 2024-09-16T03:49:00.257 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4442.0:1", 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:02.955358+0000", 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.258 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:e656299f:::obj-23:head", 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'23", 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4445.0:1", 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:03.122586+0000", 2024-09-16T03:49:00.259 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.260 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.260 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.260 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.260 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.260 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.260 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.260 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.260 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.260 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:5cdf412b:::obj-24:head", 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'24", 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4448.0:1", 2024-09-16T03:49:00.261 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.262 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:03.256315+0000", 2024-09-16T03:49:00.262 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.262 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.262 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.262 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.262 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.262 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.262 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.262 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.262 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.262 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.262 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:cacae143:::obj-25:head", 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'25", 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4451.0:1", 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:03.401607+0000", 2024-09-16T03:49:00.263 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.264 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:34b5bff6:::obj-26:head", 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'26", 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4454.0:1", 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:03.535020+0000", 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.265 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.266 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:a354f8f6:::obj-27:head", 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'27", 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4457.0:1", 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:03.732205+0000", 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.267 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.268 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.268 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.268 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.268 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.268 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.268 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.268 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.268 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.268 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.268 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.268 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.268 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:7421db49:::obj-28:head", 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'28", 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4460.0:1", 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:03.879192+0000", 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.269 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:54bc79ba:::obj-29:head", 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'29", 2024-09-16T03:49:00.270 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.271 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4463.0:1", 2024-09-16T03:49:00.271 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.271 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:04.021988+0000", 2024-09-16T03:49:00.271 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.271 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.271 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.271 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.271 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.271 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.271 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.271 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.271 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:01b15595:::obj-30:head", 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'30", 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.272 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4466.0:1", 2024-09-16T03:49:00.273 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.273 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:04.164542+0000", 2024-09-16T03:49:00.273 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.273 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.273 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.273 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.273 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.273 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.273 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.273 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.273 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.273 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:f9a0a8a2:::obj-31:head", 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'31", 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4469.0:1", 2024-09-16T03:49:00.274 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.275 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:04.307144+0000", 2024-09-16T03:49:00.275 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.275 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.275 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.275 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.275 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.275 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.275 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.275 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.275 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.275 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.275 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.276 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.276 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.276 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.276 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.276 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.276 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.276 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.276 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1bf2562f:::obj-32:head", 2024-09-16T03:49:00.276 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'32", 2024-09-16T03:49:00.276 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.276 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4472.0:1", 2024-09-16T03:49:00.276 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.277 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:04.449432+0000", 2024-09-16T03:49:00.277 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.277 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.277 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.277 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.277 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.277 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.277 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.277 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.277 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.277 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.277 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:b982ae22:::obj-33:head", 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'33", 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4475.0:1", 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.278 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:04.600980+0000", 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.279 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1ad9f98e:::obj-34:head", 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'34", 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4478.0:1", 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:04.742522+0000", 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.280 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.281 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:941f43ff:::obj-35:head", 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'35", 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4481.0:1", 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:04.876453+0000", 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.283 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.283 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.283 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.283 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.283 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.283 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.283 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.283 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.283 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.283 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:24ebabe9:::obj-36:head", 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'36", 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4484.0:1", 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:05.011338+0000", 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.284 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.285 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:5f3a5398:::obj-37:head", 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'37", 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4487.0:1", 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:05.170570+0000", 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.286 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:c96cb37e:::obj-38:head", 2024-09-16T03:49:00.287 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'38", 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4490.0:1", 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:05.320932+0000", 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.288 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:69e36996:::obj-39:head", 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'39", 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4493.0:1", 2024-09-16T03:49:00.289 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.290 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:05.463295+0000", 2024-09-16T03:49:00.290 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.290 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.290 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.290 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.290 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.290 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.290 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.290 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.292 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.292 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.292 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.292 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.292 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.292 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.292 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.292 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.292 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.292 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.292 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:9f75773e:::obj-40:head", 2024-09-16T03:49:00.292 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'40", 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4496.0:1", 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:05.605752+0000", 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.293 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:2c01cd48:::obj-41:head", 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'41", 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4499.0:1", 2024-09-16T03:49:00.294 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:05.777544+0000", 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.295 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:5e676e3d:::obj-42:head", 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'42", 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4502.0:1", 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:05.924125+0000", 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.296 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.297 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.297 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.297 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.297 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.297 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.297 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.297 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.297 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.297 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.297 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.297 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.297 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1215f697:::obj-43:head", 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'43", 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4505.0:1", 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:06.091208+0000", 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.298 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.299 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.300 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.300 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:3a0aa357:::obj-44:head", 2024-09-16T03:49:00.300 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'44", 2024-09-16T03:49:00.300 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.300 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4508.0:1", 2024-09-16T03:49:00.300 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.300 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:06.233540+0000", 2024-09-16T03:49:00.300 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.300 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.300 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.300 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.300 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.301 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:6366950a:::obj-45:head", 2024-09-16T03:49:00.302 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'45", 2024-09-16T03:49:00.302 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.302 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4511.0:1", 2024-09-16T03:49:00.302 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.302 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:06.383565+0000", 2024-09-16T03:49:00.302 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.302 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.302 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.302 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.302 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.302 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.302 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:621cb2b3:::obj-46:head", 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'46", 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.303 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4514.0:1", 2024-09-16T03:49:00.304 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.304 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:06.525721+0000", 2024-09-16T03:49:00.304 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.304 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.304 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.304 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.304 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.304 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.304 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.304 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.304 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.304 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:d83ab3cd:::obj-47:head", 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'47", 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4517.0:1", 2024-09-16T03:49:00.305 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:06.660164+0000", 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.306 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:3d8e6d4a:::obj-48:head", 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'48", 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4520.0:1", 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:06.811744+0000", 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.307 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.308 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:50b1e2f2:::obj-49:head", 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'49", 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4523.0:1", 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:06.953380+0000", 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.309 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:c75430e6:::obj-50:head", 2024-09-16T03:49:00.310 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'50", 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4526.0:1", 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:07.096209+0000", 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.311 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:eaf3ca0a:::obj-51:head", 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'51", 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.312 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4529.0:1", 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:07.238095+0000", 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.313 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:86a15bea:::obj-52:head", 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'52", 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4532.0:1", 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:07.380176+0000", 2024-09-16T03:49:00.314 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.315 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1df15dae:::obj-53:head", 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'53", 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4535.0:1", 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:07.531674+0000", 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.316 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.317 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.317 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.317 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.317 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.317 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.317 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.317 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.317 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.317 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.317 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.317 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.317 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:29304dc8:::obj-54:head", 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'54", 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4538.0:1", 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:07.721517+0000", 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.318 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.319 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:de02c26d:::obj-55:head", 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'55", 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4541.0:1", 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:07.884971+0000", 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:0d36fc08:::obj-56:head", 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'56", 2024-09-16T03:49:00.321 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.322 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4544.0:1", 2024-09-16T03:49:00.322 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.322 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:08.036247+0000", 2024-09-16T03:49:00.322 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.322 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.322 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.322 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.322 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.322 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.322 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.322 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.322 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:2b2cbcba:::obj-57:head", 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'57", 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4547.0:1", 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.323 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:08.233245+0000", 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.324 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:838be76e:::obj-58:head", 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'58", 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4550.0:1", 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:08.422449+0000", 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.325 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.326 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:2c66fd6f:::obj-59:head", 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'59", 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4553.0:1", 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:08.573500+0000", 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.327 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:2b18273b:::obj-60:head", 2024-09-16T03:49:00.328 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'60", 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4556.0:1", 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:08.733585+0000", 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.329 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:fcfa3cd1:::obj-61:head", 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'61", 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4559.0:1", 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.330 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:08.865296+0000", 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.331 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:16e51a68:::obj-62:head", 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'62", 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4562.0:1", 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:09.006983+0000", 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.332 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.333 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.334 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.334 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.334 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:c15678fc:::obj-63:head", 2024-09-16T03:49:00.334 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'63", 2024-09-16T03:49:00.334 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.334 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4565.0:1", 2024-09-16T03:49:00.334 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.334 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:09.149167+0000", 2024-09-16T03:49:00.334 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.334 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.335 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.336 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.336 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.336 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:e066252d:::obj-64:head", 2024-09-16T03:49:00.337 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'64", 2024-09-16T03:49:00.337 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.337 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4568.0:1", 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:09.291437+0000", 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.338 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:95a4ceaf:::obj-65:head", 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'65", 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4571.0:1", 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:09.434616+0000", 2024-09-16T03:49:00.339 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.340 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:6e97b31a:::obj-66:head", 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'66", 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4574.0:1", 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:09.576756+0000", 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.341 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.342 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:ceed8b4e:::obj-67:head", 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'67", 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4577.0:1", 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:09.765897+0000", 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.343 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:05e2e722:::obj-68:head", 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'68", 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.344 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4580.0:1", 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:09.904418+0000", 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.345 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:c40f7de9:::obj-69:head", 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'69", 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4583.0:1", 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:10.037869+0000", 2024-09-16T03:49:00.346 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.347 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.348 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.348 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.348 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.348 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.348 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:7bab3581:::obj-70:head", 2024-09-16T03:49:00.348 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'70", 2024-09-16T03:49:00.348 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.348 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4586.0:1", 2024-09-16T03:49:00.348 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.348 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:10.188574+0000", 2024-09-16T03:49:00.348 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.348 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.349 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:cb9edc4f:::obj-71:head", 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'71", 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4589.0:1", 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:10.338592+0000", 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.350 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.351 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:88ae729f:::obj-72:head", 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'72", 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4592.0:1", 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:10.481243+0000", 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.352 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:887b5de4:::obj-73:head", 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'73", 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.353 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4595.0:1", 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:10.623579+0000", 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.354 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:996efeaa:::obj-74:head", 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'74", 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4598.0:1", 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:10.775232+0000", 2024-09-16T03:49:00.355 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.356 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:942222a0:::obj-75:head", 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'75", 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4601.0:1", 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:10.909079+0000", 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.357 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.358 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:35f0499f:::obj-76:head", 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'76", 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4604.0:1", 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:11.050919+0000", 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.359 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:15cd38e3:::obj-77:head", 2024-09-16T03:49:00.360 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'77", 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4607.0:1", 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:11.185687+0000", 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.361 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:7adeb77b:::obj-78:head", 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'78", 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4610.0:1", 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:11.328454+0000", 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.363 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:c92176ea:::obj-79:head", 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'79", 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4613.0:1", 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:11.463039+0000", 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.364 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.365 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:14abac33:::obj-80:head", 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'80", 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4616.0:1", 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:11.597399+0000", 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.366 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:ea1005df:::obj-81:head", 2024-09-16T03:49:00.367 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'81", 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4619.0:1", 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:11.761136+0000", 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.368 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:df18954d:::obj-82:head", 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'82", 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4622.0:1", 2024-09-16T03:49:00.369 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:11.907410+0000", 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.370 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:cdd3834b:::obj-83:head", 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'83", 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4625.0:1", 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:12.050373+0000", 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.371 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.372 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:dfbf520a:::obj-84:head", 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'84", 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4628.0:1", 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:12.193625+0000", 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.373 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.374 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1dd3df2f:::obj-85:head", 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'85", 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4631.0:1", 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:12.345099+0000", 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.375 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:54554b77:::obj-86:head", 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'86", 2024-09-16T03:49:00.376 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.377 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4634.0:1", 2024-09-16T03:49:00.377 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.377 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:12.487134+0000", 2024-09-16T03:49:00.377 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.377 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.377 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.377 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.377 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.377 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.377 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.377 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.377 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.378 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.378 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.378 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.378 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.378 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.378 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.378 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.378 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.378 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.378 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:43a48f98:::obj-87:head", 2024-09-16T03:49:00.378 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'87", 2024-09-16T03:49:00.378 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.379 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4637.0:1", 2024-09-16T03:49:00.379 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.379 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:12.621442+0000", 2024-09-16T03:49:00.379 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.379 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.379 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.379 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.379 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.379 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.379 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.379 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.379 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.380 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.380 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.380 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.380 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.380 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.380 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.380 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.380 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.380 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.380 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:3f7b3ecc:::obj-88:head", 2024-09-16T03:49:00.380 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'88", 2024-09-16T03:49:00.380 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4640.0:1", 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:12.771808+0000", 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.381 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.382 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.382 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.382 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.382 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.382 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.382 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.382 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.382 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:d25ef7d2:::obj-89:head", 2024-09-16T03:49:00.382 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'89", 2024-09-16T03:49:00.382 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.382 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4643.0:1", 2024-09-16T03:49:00.382 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.383 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:12.913441+0000", 2024-09-16T03:49:00.383 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.383 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.383 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.383 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.383 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.383 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.383 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.383 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:ea27d688:::obj-90:head", 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'90", 2024-09-16T03:49:00.384 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4646.0:1", 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:13.047848+0000", 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.385 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.386 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.386 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.386 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.386 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.386 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.386 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.386 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.386 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.386 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:088f9d12:::obj-91:head", 2024-09-16T03:49:00.386 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'91", 2024-09-16T03:49:00.386 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.386 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4649.0:1", 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:13.181637+0000", 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.387 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:206f25a5:::obj-92:head", 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'92", 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4652.0:1", 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:13.384859+0000", 2024-09-16T03:49:00.388 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.389 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:501cca61:::obj-93:head", 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'93", 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4655.0:1", 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:13.544430+0000", 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.390 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.391 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1ed468c0:::obj-94:head", 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'94", 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4658.0:1", 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:13.748493+0000", 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.392 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.393 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:e8cba918:::obj-95:head", 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'95", 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4661.0:1", 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:13.896151+0000", 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.394 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:403c3dfc:::obj-96:head", 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'96", 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4664.0:1", 2024-09-16T03:49:00.395 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:14.030068+0000", 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.396 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:7c2d0cb1:::obj-97:head", 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'97", 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4667.0:1", 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:14.173310+0000", 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.397 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.398 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:6f3e26a7:::obj-98:head", 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'98", 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4670.0:1", 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:14.340995+0000", 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.399 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.400 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:a4b22c6a:::obj-99:head", 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'99", 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4673.0:1", 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:14.491209+0000", 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.401 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:25c09ea8:::obj-100:head", 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'100", 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.402 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4676.0:1", 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:14.633752+0000", 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.403 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:be8b0193:::obj-101:head", 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'101", 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4679.0:1", 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:14.784200+0000", 2024-09-16T03:49:00.404 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.405 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.406 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.406 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.406 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.406 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.406 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:6aa5e219:::obj-102:head", 2024-09-16T03:49:00.406 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'102", 2024-09-16T03:49:00.406 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.406 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4682.0:1", 2024-09-16T03:49:00.406 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.406 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:14.925818+0000", 2024-09-16T03:49:00.406 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.406 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.407 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.408 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.408 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.408 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:ff8cd32f:::obj-103:head", 2024-09-16T03:49:00.408 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'103", 2024-09-16T03:49:00.408 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.408 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4685.0:1", 2024-09-16T03:49:00.408 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.408 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:15.069575+0000", 2024-09-16T03:49:00.408 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.408 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.408 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.408 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.409 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:fcaf5c1c:::obj-104:head", 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'104", 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4688.0:1", 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:15.229079+0000", 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.410 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:2111aa60:::obj-105:head", 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'105", 2024-09-16T03:49:00.411 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4691.0:1", 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:15.379158+0000", 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.412 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:9fed4eb7:::obj-106:head", 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'106", 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4694.0:1", 2024-09-16T03:49:00.413 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:15.514033+0000", 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.414 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.415 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.415 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.415 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.415 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.415 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.415 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:0b0c0bce:::obj-107:head", 2024-09-16T03:49:00.415 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'107", 2024-09-16T03:49:00.415 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.415 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4697.0:1", 2024-09-16T03:49:00.415 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.415 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:15.673809+0000", 2024-09-16T03:49:00.415 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.416 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.416 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.416 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.416 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.416 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.416 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.416 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.416 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.416 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.416 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.416 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:b7ce613a:::obj-108:head", 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'108", 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4700.0:1", 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:15.832953+0000", 2024-09-16T03:49:00.417 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.418 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:4f32cd61:::obj-109:head", 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'109", 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4703.0:1", 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:15.975318+0000", 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.419 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.420 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:40f97f88:::obj-110:head", 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'110", 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4706.0:1", 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:16.125675+0000", 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.421 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.422 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:1d8e7a62:::obj-111:head", 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'111", 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4709.0:1", 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:16.268059+0000", 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.423 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:3a283967:::obj-112:head", 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'112", 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4712.0:1", 2024-09-16T03:49:00.424 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:16.418320+0000", 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.425 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:2acdc9e7:::obj-113:head", 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'113", 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4715.0:1", 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:16.568472+0000", 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.426 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.427 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:7f18a9ad:::obj-114:head", 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'114", 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4718.0:1", 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:16.729134+0000", 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.428 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.429 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:852b8a34:::obj-115:head", 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'115", 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4721.0:1", 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:16.868526+0000", 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.430 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:589de4f7:::obj-116:head", 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'116", 2024-09-16T03:49:00.431 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4724.0:1", 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:17.002273+0000", 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.432 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:14f2571c:::obj-117:head", 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'117", 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4727.0:1", 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.433 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:17.145752+0000", 2024-09-16T03:49:00.434 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.434 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.434 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.434 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.434 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.434 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.434 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.434 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.434 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.434 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.434 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.434 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:dd36f0e5:::obj-118:head", 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'118", 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4730.0:1", 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:17.288833+0000", 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.435 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.436 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:0d7fa432:::obj-119:head", 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'119", 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4733.0:1", 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:17.432373+0000", 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.437 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.438 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:295ec31a:::obj-120:head", 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'120", 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4736.0:1", 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:17.565673+0000", 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.439 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:c2863561:::obj-121:head", 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'121", 2024-09-16T03:49:00.440 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4739.0:1", 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:17.753885+0000", 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.441 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:0b943493:::obj-122:head", 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'122", 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4742.0:1", 2024-09-16T03:49:00.442 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:17.891308+0000", 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.443 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:4cfecbf8:::obj-123:head", 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'123", 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4745.0:1", 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:18.043278+0000", 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.444 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.445 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:fd18e511:::obj-124:head", 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'124", 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4748.0:1", 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:18.186090+0000", 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.446 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.447 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:4f299322:::obj-125:head", 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'125", 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4751.0:1", 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:18.337066+0000", 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.448 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:302ecc7e:::obj-126:head", 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'126", 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.449 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4754.0:1", 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:18.497118+0000", 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.450 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:42feb657:::obj-127:head", 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'127", 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4757.0:1", 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:18.638905+0000", 2024-09-16T03:49:00.451 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.452 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:5e6b9a81:::obj-128:head", 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'128", 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4760.0:1", 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:18.781537+0000", 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.453 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.454 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:0d242242:::obj-129:head", 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'129", 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4763.0:1", 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:18.916563+0000", 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.455 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:ed409294:::obj-130:head", 2024-09-16T03:49:00.456 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'130", 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4766.0:1", 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:19.067812+0000", 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.457 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:720761ff:::obj-131:head", 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'131", 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.458 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4769.0:1", 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:19.203355+0000", 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.459 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:7715ee72:::obj-132:head", 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'132", 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4772.0:1", 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:19.362643+0000", 2024-09-16T03:49:00.460 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.461 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:580938e3:::obj-133:head", 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'133", 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4775.0:1", 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:19.521519+0000", 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.462 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.463 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.464 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:05dc98b5:::obj-134:head", 2024-09-16T03:49:00.464 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'134", 2024-09-16T03:49:00.464 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.464 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4778.0:1", 2024-09-16T03:49:00.464 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.464 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:19.655877+0000", 2024-09-16T03:49:00.464 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.464 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.464 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.464 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.464 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.464 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.465 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:73221e51:::obj-135:head", 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'135", 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4781.0:1", 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:19.806253+0000", 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.466 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:3a97ede2:::obj-136:head", 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'136", 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.467 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4784.0:1", 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:19.947905+0000", 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.468 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:9e95a205:::obj-137:head", 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'137", 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4787.0:1", 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:20.089925+0000", 2024-09-16T03:49:00.469 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.470 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.470 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.470 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.470 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.470 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.470 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.470 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.470 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.470 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:27f846bd:::obj-138:head", 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'138", 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4790.0:1", 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.471 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:20.232492+0000", 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.472 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:bb2f7605:::obj-139:head", 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'139", 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4793.0:1", 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:20.375391+0000", 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.473 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.474 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:27668d5f:::obj-140:head", 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'140", 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4796.0:1", 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:20.517956+0000", 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.475 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.476 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.476 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.476 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.476 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.476 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.476 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.476 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.476 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.476 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.476 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.476 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.476 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:0d70cb86:::obj-141:head", 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'141", 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4799.0:1", 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:20.661036+0000", 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.477 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.478 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.479 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:347b39b5:::obj-more-1:head", 2024-09-16T03:49:00.479 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'142", 2024-09-16T03:49:00.479 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.479 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4806.0:1", 2024-09-16T03:49:00.479 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.479 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:21.806292+0000", 2024-09-16T03:49:00.479 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.479 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.479 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.479 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.479 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.479 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.480 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.480 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.480 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.480 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.480 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.480 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.480 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.480 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.480 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.480 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.480 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.480 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.481 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:0c63cc63:::obj-more-2:head", 2024-09-16T03:49:00.481 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'143", 2024-09-16T03:49:00.481 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.481 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4809.0:1", 2024-09-16T03:49:00.481 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.481 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:25.879209+0000", 2024-09-16T03:49:00.481 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.481 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.481 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.481 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.481 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.481 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.482 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:3ce69b57:::obj-more-3:head", 2024-09-16T03:49:00.483 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'144", 2024-09-16T03:49:00.483 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.483 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4812.0:1", 2024-09-16T03:49:00.483 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.483 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:26.130895+0000", 2024-09-16T03:49:00.483 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.483 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.483 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.483 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.483 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.483 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.483 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.484 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.484 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.484 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.484 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.484 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.484 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.484 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.484 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.484 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.484 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:50476200:::obj-more-4:head", 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'145", 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4815.0:1", 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:26.357239+0000", 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.485 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:7a39cfd8:::obj-more-5:head", 2024-09-16T03:49:00.486 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'146", 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4818.0:1", 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:26.591690+0000", 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.487 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.488 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.488 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.488 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.488 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.488 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.488 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.488 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.488 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.488 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.488 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:a7159f95:::obj-more-6:head", 2024-09-16T03:49:00.488 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'147", 2024-09-16T03:49:00.488 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4821.0:1", 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:26.844985+0000", 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.489 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:37f29f5f:::obj-more-7:head", 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'148", 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4824.0:1", 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:27.079186+0000", 2024-09-16T03:49:00.490 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.491 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.492 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.492 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.492 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.492 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:4e4836c1:::obj-more-8:head", 2024-09-16T03:49:00.492 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'149", 2024-09-16T03:49:00.492 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.492 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4827.0:1", 2024-09-16T03:49:00.492 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.492 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:27.339447+0000", 2024-09-16T03:49:00.492 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.492 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.492 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.493 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:d56cad57:::obj-more-9:head", 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'150", 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4830.0:1", 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:27.599309+0000", 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.494 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.495 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:96ff4b77:::obj-more-10:head", 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'151", 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4833.0:1", 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:27.893168+0000", 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.496 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.497 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.497 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.497 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.497 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.497 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.497 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.497 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.497 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.497 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.497 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:b8937ca5:::obj-more-11:head", 2024-09-16T03:49:00.497 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'152", 2024-09-16T03:49:00.497 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.498 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4836.0:1", 2024-09-16T03:49:00.498 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.498 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:28.111404+0000", 2024-09-16T03:49:00.498 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.498 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.498 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.498 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.498 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.498 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.498 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.498 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:c949902e:::obj-more-12:head", 2024-09-16T03:49:00.499 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'153", 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4839.0:1", 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:28.380384+0000", 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.500 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:4909985f:::obj-more-13:head", 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'154", 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.501 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4842.0:1", 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:28.648920+0000", 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.502 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:acf906ce:::obj-more-14:head", 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'155", 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4845.0:1", 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:28.908370+0000", 2024-09-16T03:49:00.503 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.504 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.505 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.505 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.505 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.505 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:44d31ae5:::obj-more-15:head", 2024-09-16T03:49:00.505 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'156", 2024-09-16T03:49:00.505 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.505 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4848.0:1", 2024-09-16T03:49:00.505 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.505 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:29.161310+0000", 2024-09-16T03:49:00.505 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.505 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.505 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.506 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:54dfd3e0:::obj-more-16:head", 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'157", 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4851.0:1", 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:29.403888+0000", 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.507 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.508 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.508 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.508 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.508 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.508 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.508 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.508 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.508 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.508 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.508 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.508 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:6a7dcd50:::obj-more-17:head", 2024-09-16T03:49:00.508 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'158", 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4854.0:1", 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:29.674297+0000", 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.509 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:fb20876f:::obj-more-18:head", 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'159", 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4857.0:1", 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:29.906545+0000", 2024-09-16T03:49:00.510 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.511 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.512 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.512 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.512 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.512 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:ed63ae36:::obj-more-19:head", 2024-09-16T03:49:00.512 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'160", 2024-09-16T03:49:00.512 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.513 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4860.0:1", 2024-09-16T03:49:00.513 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.513 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:30.161101+0000", 2024-09-16T03:49:00.513 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.513 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.513 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.513 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.513 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.513 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.513 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.513 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.513 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: "op": "modify", 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: "object": "1:6a8a392a:::obj-more-20:head", 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "38'161", 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: "prior_version": "0'0", 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4863.0:1", 2024-09-16T03:49:00.514 INFO:tasks.workunit.client.0.smithi026.stdout: "extra_reqids": [], 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: "mtime": "2024-09-16T03:48:30.410700+0000", 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": 0, 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: "mod_desc": { 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: "object_mod_desc": { 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: "can_local_rollback": false, 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: "rollback_info_completed": false, 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: "ops": [] 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_regions": { 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: "object_clean_regions": { 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_offsets": "[12875~18446744073709538740]", 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: "clean_omap": true, 2024-09-16T03:49:00.515 INFO:tasks.workunit.client.0.smithi026.stdout: "new_object": false 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: ], 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: "dups": [ 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4379.0:1", 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'1", 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "1", 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4382.0:1", 2024-09-16T03:49:00.516 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'2", 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "2", 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4385.0:1", 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'3", 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "3", 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4388.0:1", 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'4", 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "4", 2024-09-16T03:49:00.517 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4391.0:1", 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'5", 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "5", 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4394.0:1", 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'6", 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "6", 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.518 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4397.0:1", 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'7", 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "7", 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4400.0:1", 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'8", 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "8", 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4403.0:1", 2024-09-16T03:49:00.519 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'9", 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "9", 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: { 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: "reqid": "client.4406.0:1", 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: "version": "34'10", 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: "user_version": "10", 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: "return_code": "0" 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: ] 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: "pg_missing_t": { 2024-09-16T03:49:00.520 INFO:tasks.workunit.client.0.smithi026.stdout: "missing": [], 2024-09-16T03:49:00.521 INFO:tasks.workunit.client.0.smithi026.stdout: "may_include_deletes": true 2024-09-16T03:49:00.521 INFO:tasks.workunit.client.0.smithi026.stdout: } 2024-09-16T03:49:00.521 INFO:tasks.workunit.client.0.smithi026.stdout:} 2024-09-16T03:49:00.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: jq '.pg_log_t.log | length' td/osd-backfill-recovery-log/result.log 2024-09-16T03:49:00.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:85: _common_test: LOGLEN=151 2024-09-16T03:49:00.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:86: _common_test: '[' 151 '!=' 151 ']' 2024-09-16T03:49:00.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: jq '.pg_log_t.dups | length' td/osd-backfill-recovery-log/result.log 2024-09-16T03:49:00.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:90: _common_test: DUPSLEN=10 2024-09-16T03:49:00.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:91: _common_test: '[' 10 '!=' 10 ']' 2024-09-16T03:49:00.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:95: _common_test: grep 'copy_up_to\|copy_after' td/osd-backfill-recovery-log/osd.0.log td/osd-backfill-recovery-log/osd.1.log td/osd-backfill-recovery-log/osd.2.log td/osd-backfill-recovery-log/osd.3.log td/osd-backfill-recovery-log/osd.4.log td/osd-backfill-recovery-log/osd.5.log 2024-09-16T03:49:00.523 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after v 0'0 dups.size()=0 other.dups.size()=0 2024-09-16T03:49:00.523 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'141 2024-09-16T03:49:00.523 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'140 2024-09-16T03:49:00.523 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'139 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'138 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'137 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'136 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'135 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'134 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'133 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'132 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'131 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'130 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'129 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'128 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'127 2024-09-16T03:49:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'126 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'125 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'124 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'123 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'122 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'121 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'120 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'119 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'118 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'117 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'116 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'115 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'114 2024-09-16T03:49:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'113 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'112 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'111 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'110 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'109 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'108 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'107 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'106 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'105 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'104 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'103 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'102 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'101 2024-09-16T03:49:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'100 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'99 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'98 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'97 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'96 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'95 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'94 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'93 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'92 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'91 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'90 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'89 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'88 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'87 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'86 2024-09-16T03:49:00.527 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'85 2024-09-16T03:49:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'84 2024-09-16T03:49:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'83 2024-09-16T03:49:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'82 2024-09-16T03:49:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'81 2024-09-16T03:49:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'80 2024-09-16T03:49:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'79 2024-09-16T03:49:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'78 2024-09-16T03:49:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'77 2024-09-16T03:49:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'76 2024-09-16T03:49:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'75 2024-09-16T03:49:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'74 2024-09-16T03:49:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'73 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'72 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'71 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'70 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'69 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'68 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'67 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'66 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'65 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'64 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'63 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'62 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'61 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'60 2024-09-16T03:49:00.529 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'59 2024-09-16T03:49:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'58 2024-09-16T03:49:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'57 2024-09-16T03:49:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'56 2024-09-16T03:49:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'55 2024-09-16T03:49:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'54 2024-09-16T03:49:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'53 2024-09-16T03:49:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'52 2024-09-16T03:49:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'51 2024-09-16T03:49:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'50 2024-09-16T03:49:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'49 2024-09-16T03:49:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'48 2024-09-16T03:49:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'47 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'46 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'45 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'44 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'43 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'42 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'41 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'40 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'39 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'38 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'37 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'36 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'35 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'34 2024-09-16T03:49:00.531 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'33 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'32 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'31 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'30 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'29 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'28 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'27 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'26 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'25 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'24 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'23 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'22 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'21 2024-09-16T03:49:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'20 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'19 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'18 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'17 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'16 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'15 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'14 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'13 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'12 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'11 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'10 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'9 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'8 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'7 2024-09-16T03:49:00.533 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'6 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'5 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'4 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'3 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'2 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'1 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after END v 0'0 dups.size()=0 other.dups.size()=0 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after v 0'0 dups.size()=0 other.dups.size()=0 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'141 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'140 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'139 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'138 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'137 2024-09-16T03:49:00.534 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'136 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'135 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'134 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'133 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'132 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'131 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'130 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'129 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'128 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'127 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'126 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'125 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'124 2024-09-16T03:49:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'123 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'122 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'121 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'120 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'119 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'118 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'117 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'116 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'115 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'114 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'113 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'112 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'111 2024-09-16T03:49:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'110 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'109 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'108 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'107 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'106 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'105 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'104 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'103 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'102 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'101 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'100 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'99 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'98 2024-09-16T03:49:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'97 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'96 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'95 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'94 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'93 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'92 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'91 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'90 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'89 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'88 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'87 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'86 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'85 2024-09-16T03:49:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'84 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'83 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'82 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'81 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'80 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'79 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'78 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'77 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'76 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'75 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'74 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'73 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'72 2024-09-16T03:49:00.539 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'71 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'70 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'69 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'68 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'67 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'66 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'65 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'64 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'63 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'62 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'61 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'60 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'59 2024-09-16T03:49:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'58 2024-09-16T03:49:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'57 2024-09-16T03:49:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'56 2024-09-16T03:49:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'55 2024-09-16T03:49:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'54 2024-09-16T03:49:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'53 2024-09-16T03:49:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'52 2024-09-16T03:49:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'51 2024-09-16T03:49:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'50 2024-09-16T03:49:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'49 2024-09-16T03:49:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'48 2024-09-16T03:49:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'47 2024-09-16T03:49:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'46 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'45 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'44 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'43 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'42 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'41 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'40 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'39 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'38 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'37 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'36 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'35 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'34 2024-09-16T03:49:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'33 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'32 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'31 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'30 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'29 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'28 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'27 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'26 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'25 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'24 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'23 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'22 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'21 2024-09-16T03:49:00.543 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'20 2024-09-16T03:49:00.544 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'19 2024-09-16T03:49:00.544 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'18 2024-09-16T03:49:00.544 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'17 2024-09-16T03:49:00.544 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'16 2024-09-16T03:49:00.544 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'15 2024-09-16T03:49:00.544 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'14 2024-09-16T03:49:00.544 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'13 2024-09-16T03:49:00.544 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'12 2024-09-16T03:49:00.544 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'11 2024-09-16T03:49:00.544 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'10 2024-09-16T03:49:00.544 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'9 2024-09-16T03:49:00.544 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'8 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'7 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'6 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'5 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'4 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'3 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'2 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after copy log version 34'1 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.709+0000 7f2c5f628640 20 copy_after END v 0'0 dups.size()=0 other.dups.size()=0 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after v 0'0 dups.size()=0 other.dups.size()=0 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'141 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'140 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'139 2024-09-16T03:49:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'138 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'137 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'136 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'135 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'134 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'133 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'132 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'131 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'130 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'129 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'128 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'127 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'126 2024-09-16T03:49:00.546 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'125 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'124 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'123 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'122 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'121 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'120 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'119 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'118 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'117 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'116 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'115 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'114 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'113 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'112 2024-09-16T03:49:00.547 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'111 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'110 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'109 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'108 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'107 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'106 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'105 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'104 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'103 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'102 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'101 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'100 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'99 2024-09-16T03:49:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'98 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'97 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'96 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'95 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'94 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'93 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'92 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'91 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'90 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'89 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'88 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'87 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'86 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'85 2024-09-16T03:49:00.549 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'84 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'83 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'82 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'81 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'80 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'79 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'78 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'77 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'76 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'75 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'74 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'73 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'72 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'71 2024-09-16T03:49:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'70 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'69 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'68 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'67 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'66 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'65 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'64 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'63 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'62 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'61 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'60 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'59 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'58 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'57 2024-09-16T03:49:00.551 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'56 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'55 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'54 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'53 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'52 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'51 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'50 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'49 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'48 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'47 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'46 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'45 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'44 2024-09-16T03:49:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'43 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'42 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'41 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'40 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'39 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'38 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'37 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'36 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'35 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'34 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'33 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'32 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'31 2024-09-16T03:49:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'30 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'29 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'28 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'27 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'26 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'25 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'24 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'23 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'22 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'21 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'20 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'19 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'18 2024-09-16T03:49:00.554 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'17 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'16 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'15 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'14 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'13 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'12 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'11 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'10 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'9 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'8 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'7 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'6 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'5 2024-09-16T03:49:00.555 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'4 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'3 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'2 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after copy log version 34'1 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:24.710+0000 7f2c5f628640 20 copy_after END v 0'0 dups.size()=0 other.dups.size()=0 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_after v 38'161 dups.size()=0 other.dups.size()=10 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup version 34'1 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup version 34'2 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup version 34'3 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup version 34'4 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup version 34'5 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup version 34'6 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup version 34'7 2024-09-16T03:49:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup version 34'8 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup version 34'9 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup version 34'10 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'11 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'12 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'13 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'14 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'15 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'16 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'17 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'18 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'19 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'20 2024-09-16T03:49:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'21 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'22 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'23 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'24 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'25 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'26 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'27 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'28 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'29 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'30 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'31 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'32 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'33 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'34 2024-09-16T03:49:00.558 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'35 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'36 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'37 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'38 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'39 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'40 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'41 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'42 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'43 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'44 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'45 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'46 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'47 2024-09-16T03:49:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'48 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'49 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'50 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'51 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'52 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'53 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'54 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'55 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'56 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'57 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'58 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'59 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'60 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'61 2024-09-16T03:49:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'62 2024-09-16T03:49:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'63 2024-09-16T03:49:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'64 2024-09-16T03:49:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'65 2024-09-16T03:49:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'66 2024-09-16T03:49:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'67 2024-09-16T03:49:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'68 2024-09-16T03:49:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'69 2024-09-16T03:49:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'70 2024-09-16T03:49:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'71 2024-09-16T03:49:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'72 2024-09-16T03:49:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'73 2024-09-16T03:49:00.561 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'74 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'75 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'76 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'77 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'78 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'79 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'80 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'81 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'82 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'83 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'84 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'85 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'86 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'87 2024-09-16T03:49:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'88 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'89 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'90 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'91 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'92 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'93 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'94 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'95 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'96 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'97 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'98 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'99 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'100 2024-09-16T03:49:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'101 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'102 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'103 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'104 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'105 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'106 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'107 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'108 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'109 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'110 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'111 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'112 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'113 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'114 2024-09-16T03:49:00.564 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'115 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'116 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'117 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'118 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'119 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'120 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'121 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'122 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'123 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'124 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'125 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'126 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'127 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'128 2024-09-16T03:49:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'129 2024-09-16T03:49:00.566 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'130 2024-09-16T03:49:00.566 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'131 2024-09-16T03:49:00.566 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'132 2024-09-16T03:49:00.566 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'133 2024-09-16T03:49:00.566 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'134 2024-09-16T03:49:00.566 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'135 2024-09-16T03:49:00.566 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'136 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'137 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'138 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'139 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'140 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 34'141 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'142 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'143 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'144 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'145 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'146 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'147 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'148 2024-09-16T03:49:00.567 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'149 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'150 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'151 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'152 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'153 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'154 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'155 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'156 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'157 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'158 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'159 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'160 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_up_to/copy_after copy dup from log version 38'161 2024-09-16T03:49:00.568 INFO:tasks.workunit.client.0.smithi026.stdout:td/osd-backfill-recovery-log/osd.0.log:2024-09-16T03:48:45.916+0000 7f2c5f628640 20 copy_after END v 38'161 dups.size()=161 other.dups.size()=10 2024-09-16T03:49:00.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:96: _common_test: rm -f td/osd-backfill-recovery-log/result.log 2024-09-16T03:49:00.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:97: _common_test: '[' 0 '!=' 0 ']' 2024-09-16T03:49:00.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh:35: run: teardown td/osd-backfill-recovery-log 2024-09-16T03:49:00.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:49:00.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:49:00.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-09-16T03:49:00.571 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:49:00.571 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:49:00.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:49:00.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:49:00.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:49:00.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:49:00.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:49:00.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:49:00.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:49:00.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:49:00.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:49:00.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:49:00.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:49:00.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:49:00.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:49:00.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:49:00.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:49:00.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:49:00.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-recovery-log 2024-09-16T03:49:00.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:49:00.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:49:00.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:49:00.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.53196 2024-09-16T03:49:00.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:49:00.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:49:00.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T03:49:00.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/osd-backfill-recovery-log 0 2024-09-16T03:49:00.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-recovery-log 2024-09-16T03:49:00.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T03:49:00.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-recovery-log KILL 2024-09-16T03:49:00.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:49:00.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:49:00.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:49:00.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:49:00.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:49:00.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:49:00.598 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:49:00.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:49:00.599 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:49:00.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:49:00.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:49:00.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:49:00.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:49:00.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:49:00.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:49:00.602 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:49:00.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:49:00.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T03:49:00.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-recovery-log 2024-09-16T03:49:00.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:49:00.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:49:00.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.53196 2024-09-16T03:49:00.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.53196 2024-09-16T03:49:00.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:49:00.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:49:00.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T03:49:00.608 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T03:49:00.608 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T03:49:00.676 INFO:tasks.workunit:Running workunit osd-backfill/osd-backfill-space.sh... 2024-09-16T03:49:00.676 DEBUG:teuthology.orchestra.run.smithi026:workunit test osd-backfill/osd-backfill-space.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh 2024-09-16T03:49:00.740 INFO:tasks.workunit.client.0.smithi026.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T03:49:00.747 INFO:tasks.workunit.client.0.smithi026.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T03:49:00.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-16T03:49:00.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-16T03:49:00.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T03:49:00.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T03:49:00.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T03:49:00.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T03:49:00.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T03:49:00.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T03:49:00.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/osd-backfill-space 2024-09-16T03:49:00.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:21: run: local dir=td/osd-backfill-space 2024-09-16T03:49:00.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:22: run: shift 2024-09-16T03:49:00.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:24: run: export CEPH_MON=127.0.0.1:7180 2024-09-16T03:49:00.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:24: run: CEPH_MON=127.0.0.1:7180 2024-09-16T03:49:00.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:25: run: export CEPH_ARGS 2024-09-16T03:49:00.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:26: run: uuidgen 2024-09-16T03:49:00.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:26: run: CEPH_ARGS+='--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none ' 2024-09-16T03:49:00.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7180 ' 2024-09-16T03:49:00.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:28: run: CEPH_ARGS+='--osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T03:49:00.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:29: run: CEPH_ARGS+='--fake_statfs_for_testing=3686400 ' 2024-09-16T03:49:00.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:30: run: CEPH_ARGS+='--osd_max_backfills=10 ' 2024-09-16T03:49:00.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:31: run: CEPH_ARGS+='--osd_mclock_override_recovery_settings=true ' 2024-09-16T03:49:00.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:32: run: export objects=600 2024-09-16T03:49:00.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:32: run: objects=600 2024-09-16T03:49:00.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:33: run: export poolprefix=test 2024-09-16T03:49:00.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:33: run: poolprefix=test 2024-09-16T03:49:00.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:35: run: set 2024-09-16T03:49:00.750 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:35: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T03:49:00.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:35: run: local 'funcs=TEST_backfill_grow 2024-09-16T03:49:00.751 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_multi_partial 2024-09-16T03:49:00.752 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_test_multi 2024-09-16T03:49:00.752 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_test_sametarget 2024-09-16T03:49:00.752 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_test_simple 2024-09-16T03:49:00.752 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_ec_backfill_grow 2024-09-16T03:49:00.752 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_ec_backfill_multi 2024-09-16T03:49:00.752 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_ec_backfill_simple' 2024-09-16T03:49:00.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-09-16T03:49:00.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-09-16T03:49:00.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-space 2024-09-16T03:49:00.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-space 2024-09-16T03:49:00.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T03:49:00.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:49:00.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T03:49:00.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:49:00.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:49:00.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:49:00.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:49:00.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:49:00.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:49:00.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:49:00.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:49:00.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:49:00.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:49:00.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:49:00.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:49:00.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:49:00.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:49:00.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:49:00.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:49:00.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:49:00.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:49:00.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T03:49:00.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:49:00.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:49:00.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:49:00.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T03:49:00.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:49:00.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:49:00.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-space 2024-09-16T03:49:00.760 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:49:00.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:49:00.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:49:00.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.114688 2024-09-16T03:49:00.763 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:49:00.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T03:49:00.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T03:49:00.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:49:00.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-09-16T03:49:00.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_backfill_grow td/osd-backfill-space 2024-09-16T03:49:00.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:558: TEST_backfill_grow: local dir=td/osd-backfill-space 2024-09-16T03:49:00.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:559: TEST_backfill_grow: local poolname=test 2024-09-16T03:49:00.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:560: TEST_backfill_grow: local OSDS=3 2024-09-16T03:49:00.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:562: TEST_backfill_grow: run_mon td/osd-backfill-space a 2024-09-16T03:49:00.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-space 2024-09-16T03:49:00.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:49:00.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:49:00.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:49:00.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-space/a 2024-09-16T03:49:00.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-09-16T03:49:01.236 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:49:01.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:49:01.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:49:01.237 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:49:01.237 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:49:01.237 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:49:01.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:49:01.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:49:01.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:49:01.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:49:01.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:49:01.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:49:01.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:49:01.435 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:49:01.435 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:49:01.435 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:49:01.435 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:49:01.436 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:49:01.436 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:49:01.436 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:49:01.436 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T03:49:01.436 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:49:01.436 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get fsid 2024-09-16T03:49:01.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:49:01.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:49:01.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:49:01.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:49:01.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:49:01.524 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:49:01.524 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:49:01.524 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:49:01.524 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:49:01.525 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:49:01.525 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:49:01.525 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T03:49:01.525 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:49:01.525 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get mon_host 2024-09-16T03:49:01.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:563: TEST_backfill_grow: run_mgr td/osd-backfill-space x 2024-09-16T03:49:01.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-space 2024-09-16T03:49:01.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:49:01.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:49:01.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:49:01.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-space/x 2024-09-16T03:49:01.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:49:02.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:49:02.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:49:02.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:49:02.482 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:49:02.482 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:49:02.482 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:49:02.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:49:02.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:49:02.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:49:02.516 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:565: TEST_backfill_grow: expr 3 - 1 2024-09-16T03:49:02.517 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:565: TEST_backfill_grow: seq 0 2 2024-09-16T03:49:02.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:565: TEST_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:49:02.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:567: TEST_backfill_grow: run_osd td/osd-backfill-space 0 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/0 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:49:02.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T03:49:02.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T03:49:02.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:49:02.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:49:02.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:49:02.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:49:02.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:49:02.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:49:02.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/0 2024-09-16T03:49:02.523 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:49:02.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1cb4bd34-daa4-4e73-a10a-4704cfc4ad59 2024-09-16T03:49:02.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1cb4bd34-daa4-4e73-a10a-4704cfc4ad59' 2024-09-16T03:49:02.524 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 1cb4bd34-daa4-4e73-a10a-4704cfc4ad59 2024-09-16T03:49:02.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:49:02.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCuqudmg2JkIBAArDBdJyamq1YxM5Rzmw1GDQ== 2024-09-16T03:49:02.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCuqudmg2JkIBAArDBdJyamq1YxM5Rzmw1GDQ=="}' 2024-09-16T03:49:02.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1cb4bd34-daa4-4e73-a10a-4704cfc4ad59 -i td/osd-backfill-space/0/new.json 2024-09-16T03:49:02.816 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:49:02.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/0/new.json 2024-09-16T03:49:02.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCuqudmg2JkIBAArDBdJyamq1YxM5Rzmw1GDQ== --osd-uuid 1cb4bd34-daa4-4e73-a10a-4704cfc4ad59 2024-09-16T03:49:02.863 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:02.861+0000 7fd73ce0c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:02.884 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:02.881+0000 7fd73ce0c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:02.885 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:02.882+0000 7fd73ce0c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:02.885 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:02.883+0000 7fd73ce0c640 -1 bdev(0x559240c69c00 td/osd-backfill-space/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:49:02.886 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:02.883+0000 7fd73ce0c640 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-09-16T03:49:08.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-09-16T03:49:08.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:49:08.309 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T03:49:08.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:49:08.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:49:08.878 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T03:49:08.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:49:08.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:49:08.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:49:08.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:49:08.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:49:08.913 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:08.910+0000 7f504b5c5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:08.915 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:08.912+0000 7f504b5c5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:08.916 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:08.913+0000 7f504b5c5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:09.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:49:09.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:49:09.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:49:09.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:49:09.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:49:09.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:09.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:49:09.405 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:49:09.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:09.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:09.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:10.015 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:10.012+0000 7f504b5c5640 -1 Falling back to public interface 2024-09-16T03:49:10.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:10.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:10.761 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:49:10.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:49:10.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:10.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:11.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:12.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:12.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:12.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:49:12.213 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:49:12.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:12.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:12.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:12.767 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:12.764+0000 7f504b5c5640 -1 osd.0 0 log_to_monitors true 2024-09-16T03:49:13.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:13.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:13.633 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:49:13.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:49:13.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:13.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:14.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:15.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:15.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:15.058 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:49:15.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:49:15.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:15.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:15.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:16.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:16.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:16.572 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:49:16.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:49:16.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:16.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:17.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:18.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:18.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:18.015 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:49:18.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:49:18.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:18.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:18.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:19.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:19.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:19.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:49:19.548 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:49:19.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:19.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:19.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:20.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:20.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:20.976 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:49:20.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:49:20.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:20.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:21.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:22.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:22.401 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:49:22.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:22.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:49:22.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:22.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:22.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:23.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:23.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:23.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:49:23.905 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:49:23.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:23.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:24.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:25.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:25.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:25.410 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:49:25.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:49:25.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:25.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:26.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:27.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:27.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:27.019 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:49:27.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:49:27.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:27.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:27.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:28.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:28.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:28.968 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:49:28.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:49:28.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:28.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:29.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:30.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:30.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:30.749 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:49:30.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:49:30.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:30.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:31.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:32.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:32.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:32.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:49:32.679 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:49:32.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:32.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:33.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:34.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:34.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:34.659 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:49:34.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:49:34.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:34.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:49:35.165 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2566850815,v1:127.0.0.1:6803/2566850815] [v2:127.0.0.1:6804/2566850815,v1:127.0.0.1:6805/2566850815] exists,up 1cb4bd34-daa4-4e73-a10a-4704cfc4ad59 2024-09-16T03:49:35.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:49:35.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:49:35.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:49:35.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:565: TEST_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:49:35.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:567: TEST_backfill_grow: run_osd td/osd-backfill-space 1 2024-09-16T03:49:35.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T03:49:35.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:49:35.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:49:35.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:49:35.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/1 2024-09-16T03:49:35.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:49:35.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:49:35.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:49:35.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:49:35.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:49:35.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:49:35.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:49:35.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:49:35.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T03:49:35.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T03:49:35.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:49:35.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:49:35.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:49:35.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:49:35.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:49:35.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:49:35.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/1 2024-09-16T03:49:35.173 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:49:35.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f8211f31-570b-4854-8cbf-3bf48a45bc78 2024-09-16T03:49:35.174 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 f8211f31-570b-4854-8cbf-3bf48a45bc78 2024-09-16T03:49:35.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 f8211f31-570b-4854-8cbf-3bf48a45bc78' 2024-09-16T03:49:35.174 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:49:35.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDPqudm50hjCxAAuEfovxk8JaHik40Gua/ckw== 2024-09-16T03:49:35.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDPqudm50hjCxAAuEfovxk8JaHik40Gua/ckw=="}' 2024-09-16T03:49:35.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f8211f31-570b-4854-8cbf-3bf48a45bc78 -i td/osd-backfill-space/1/new.json 2024-09-16T03:49:35.719 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:49:35.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/1/new.json 2024-09-16T03:49:35.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDPqudm50hjCxAAuEfovxk8JaHik40Gua/ckw== --osd-uuid f8211f31-570b-4854-8cbf-3bf48a45bc78 2024-09-16T03:49:35.768 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:35.766+0000 7fe122060640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:35.769 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:35.768+0000 7fe122060640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:35.770 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:35.769+0000 7fe122060640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:35.771 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:35.769+0000 7fe122060640 -1 bdev(0x55b830233c00 td/osd-backfill-space/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:49:35.771 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:35.769+0000 7fe122060640 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-09-16T03:49:41.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-09-16T03:49:41.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:49:41.968 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T03:49:41.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:49:41.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:49:42.550 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T03:49:42.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:49:42.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:49:42.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:49:42.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:49:42.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:49:42.585 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:42.583+0000 7f0086eb2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:42.589 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:42.587+0000 7f0086eb2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:42.590 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:42.588+0000 7f0086eb2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:49:42.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:49:42.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:49:42.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:49:42.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:49:42.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:49:42.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:42.982 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:49:42.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:49:42.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:42.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:49:43.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:43.678 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:43.677+0000 7f0086eb2640 -1 Falling back to public interface 2024-09-16T03:49:44.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:44.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:44.473 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:49:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:49:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:49:44.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:45.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:45.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:45.941 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:49:45.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:49:45.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:45.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:49:46.292 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:49:46.290+0000 7f0086eb2640 -1 osd.1 0 log_to_monitors true 2024-09-16T03:49:46.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:47.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:47.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:47.365 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:49:47.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:49:47.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:47.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:49:47.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:48.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:48.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:48.869 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:49:48.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:49:48.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:48.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:49:49.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:50.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:50.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:50.380 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:49:50.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:49:50.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:50.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:49:50.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:51.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:51.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:51.806 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:49:51.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:49:51.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:51.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:49:52.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:53.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:53.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:53.338 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:49:53.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:49:53.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:53.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:49:53.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:54.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:54.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:54.869 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:49:54.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:49:54.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:54.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:49:55.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:56.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:56.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:56.305 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:49:56.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:49:56.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:56.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:49:56.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:57.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:57.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:57.752 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:49:57.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:49:57.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:57.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:49:58.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:49:59.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:49:59.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:49:59.179 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:49:59.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:49:59.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:49:59.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:50:00.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:01.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:01.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:01.014 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:50:01.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:50:01.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:01.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:50:01.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:02.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:02.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:02.985 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:50:02.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:50:02.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:02.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:50:03.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:04.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:04.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:04.746 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:50:04.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:50:04.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:04.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:50:05.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:06.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:06.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:06.596 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:50:06.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:50:06.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:06.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:50:07.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:08.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:08.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:08.341 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:50:08.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:50:08.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:08.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:50:09.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:10.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:10.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:10.057 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:50:10.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:50:10.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:10.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:50:10.482 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/196985707,v1:127.0.0.1:6811/196985707] [v2:127.0.0.1:6812/196985707,v1:127.0.0.1:6813/196985707] exists,up f8211f31-570b-4854-8cbf-3bf48a45bc78 2024-09-16T03:50:10.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:50:10.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:50:10.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:50:10.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:565: TEST_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:50:10.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:567: TEST_backfill_grow: run_osd td/osd-backfill-space 2 2024-09-16T03:50:10.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T03:50:10.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:50:10.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:50:10.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:50:10.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/2 2024-09-16T03:50:10.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:50:10.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:50:10.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:50:10.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:50:10.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-09-16T03:50:10.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-09-16T03:50:10.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:50:10.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:50:10.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T03:50:10.487 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T03:50:10.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:50:10.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:50:10.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:50:10.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:50:10.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:50:10.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:50:10.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/2 2024-09-16T03:50:10.489 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:50:10.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9524d794-69e4-4e4c-84ba-7ac11bf33175 2024-09-16T03:50:10.489 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 9524d794-69e4-4e4c-84ba-7ac11bf33175 2024-09-16T03:50:10.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 9524d794-69e4-4e4c-84ba-7ac11bf33175' 2024-09-16T03:50:10.490 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:50:10.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDyqudm5FdDHhAAhmDL1SDF3xHoQdsQ/TxT3g== 2024-09-16T03:50:10.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDyqudm5FdDHhAAhmDL1SDF3xHoQdsQ/TxT3g=="}' 2024-09-16T03:50:10.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9524d794-69e4-4e4c-84ba-7ac11bf33175 -i td/osd-backfill-space/2/new.json 2024-09-16T03:50:10.986 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:50:10.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/2/new.json 2024-09-16T03:50:10.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDyqudm5FdDHhAAhmDL1SDF3xHoQdsQ/TxT3g== --osd-uuid 9524d794-69e4-4e4c-84ba-7ac11bf33175 2024-09-16T03:50:11.034 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:50:11.031+0000 7f246bffd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:50:11.074 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:50:11.071+0000 7f246bffd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:50:11.075 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:50:11.072+0000 7f246bffd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:50:11.075 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:50:11.073+0000 7f246bffd640 -1 bdev(0x5616fc133c00 td/osd-backfill-space/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:50:11.075 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:50:11.073+0000 7f246bffd640 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-09-16T03:50:16.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-09-16T03:50:16.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:50:16.943 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T03:50:16.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:50:16.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:50:17.515 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T03:50:17.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:50:17.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:50:17.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:50:17.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:50:17.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:50:17.550 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:50:17.547+0000 7f1a95c16640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:50:17.553 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:50:17.551+0000 7f1a95c16640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:50:17.554 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:50:17.552+0000 7f1a95c16640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:50:17.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:50:17.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:50:17.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:50:17.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:50:17.951 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:50:17.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:50:17.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:17.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:50:17.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:17.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:18.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:19.150 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:50:19.147+0000 7f1a95c16640 -1 Falling back to public interface 2024-09-16T03:50:19.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:19.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:19.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:50:19.437 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:50:19.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:19.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:19.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:20.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:20.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:20.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:50:20.921 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:50:20.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:20.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:21.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:22.110 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:50:22.107+0000 7f1a95c16640 -1 osd.2 0 log_to_monitors true 2024-09-16T03:50:22.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:22.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:22.388 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:50:22.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:50:22.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:22.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:23.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:24.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:24.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:50:24.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:50:24.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:24.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:24.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:25.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:25.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:25.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:50:25.587 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:50:25.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:25.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:26.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:27.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:27.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:27.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:50:27.181 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:50:27.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:27.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:27.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:28.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:28.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:28.611 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:50:28.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:50:28.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:28.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:29.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:30.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:30.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:30.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:50:30.205 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:50:30.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:30.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:30.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:31.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:31.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:31.633 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:50:31.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:50:31.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:31.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:32.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:33.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:33.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:33.304 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:50:33.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:50:33.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:33.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:33.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:34.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:34.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:34.837 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:50:34.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:50:34.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:34.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:35.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:36.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:36.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:36.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:50:36.460 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:50:36.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:36.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:36.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:37.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:37.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:37.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:50:37.988 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:50:37.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:37.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:38.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:39.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:39.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:39.736 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:50:39.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:50:39.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:39.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:40.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:41.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:41.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:41.531 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:50:41.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:50:41.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:41.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:42.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:43.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:43.417 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:50:43.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:43.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:50:43.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:43.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:44.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:45.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:45.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:45.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:50:45.360 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:50:45.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:45.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:45.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:50:46.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:50:46.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:50:46.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T03:50:46.790 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T03:50:46.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:50:46.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:50:47.243 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4048255004,v1:127.0.0.1:6819/4048255004] [v2:127.0.0.1:6820/4048255004,v1:127.0.0.1:6821/4048255004] exists,up 9524d794-69e4-4e4c-84ba-7ac11bf33175 2024-09-16T03:50:47.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:50:47.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:50:47.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:50:47.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:570: TEST_backfill_grow: ceph osd set-backfillfull-ratio .85 2024-09-16T03:50:48.092 INFO:tasks.workunit.client.0.smithi026.stderr:osd set-backfillfull-ratio 0.85 2024-09-16T03:50:48.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:572: TEST_backfill_grow: create_pool test 1 1 2024-09-16T03:50:48.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2024-09-16T03:50:48.715 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T03:50:48.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:50:49.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:573: TEST_backfill_grow: ceph osd pool set test size 3 2024-09-16T03:50:50.467 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 3 2024-09-16T03:50:50.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:574: TEST_backfill_grow: sleep 5 2024-09-16T03:50:55.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:576: TEST_backfill_grow: wait_for_clean 2024-09-16T03:50:55.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:50:55.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:50:55.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:50:55.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:50:55.483 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:50:55.483 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:50:55.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:50:55.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:50:55.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:50:55.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:50:55.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:50:55.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:50:55.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:50:55.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:50:55.583 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:50:56.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:50:56.037 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:50:56.037 INFO:tasks.workunit.client.0.smithi026.stderr:2' 2024-09-16T03:50:56.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:50:56.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:50:56.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:50:56.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836504 2024-09-16T03:50:56.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836504 2024-09-16T03:50:56.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836504' 2024-09-16T03:50:56.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:50:56.178 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:50:56.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672974 2024-09-16T03:50:56.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672974 2024-09-16T03:50:56.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836504 1-42949672974' 2024-09-16T03:50:56.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:50:56.302 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:50:56.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509450 2024-09-16T03:50:56.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509450 2024-09-16T03:50:56.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836504 1-42949672974 2-64424509450' 2024-09-16T03:50:56.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:50:56.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836504 2024-09-16T03:50:56.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:50:56.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:50:56.427 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836504 2024-09-16T03:50:56.427 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:50:56.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836504 2024-09-16T03:50:56.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836504' 2024-09-16T03:50:56.428 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836504 2024-09-16T03:50:56.428 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:50:56.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836504 -lt 21474836504 2024-09-16T03:50:56.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:50:56.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672974 2024-09-16T03:50:56.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:50:56.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:50:56.882 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672974 2024-09-16T03:50:56.883 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:50:56.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672974 2024-09-16T03:50:56.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672974' 2024-09-16T03:50:56.884 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672974 2024-09-16T03:50:56.884 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:50:57.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672974 -lt 42949672974 2024-09-16T03:50:57.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:50:57.332 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509450 2024-09-16T03:50:57.333 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:50:57.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:50:57.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509450 2024-09-16T03:50:57.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:50:57.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509450 2024-09-16T03:50:57.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509450' 2024-09-16T03:50:57.335 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509450 2024-09-16T03:50:57.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:50:57.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509450 -lt 64424509450 2024-09-16T03:50:57.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:50:57.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:50:57.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:50:58.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T03:50:58.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:50:58.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:50:58.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:50:58.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:50:58.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:50:58.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:50:58.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:50:58.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:50:58.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:50:58.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:50:58.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:50:59.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T03:50:59.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:50:59.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:50:59.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:578: TEST_backfill_grow: dd if=/dev/urandom of=td/osd-backfill-space/4kdata bs=1k count=4 2024-09-16T03:50:59.315 INFO:tasks.workunit.client.0.smithi026.stderr:4+0 records in 2024-09-16T03:50:59.316 INFO:tasks.workunit.client.0.smithi026.stderr:4+0 records out 2024-09-16T03:50:59.316 INFO:tasks.workunit.client.0.smithi026.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 6.2516e-05 s, 65.5 MB/s 2024-09-16T03:50:59.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: seq 1 600 2024-09-16T03:50:59.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:50:59.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj1 td/osd-backfill-space/4kdata 2024-09-16T03:50:59.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:50:59.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj2 td/osd-backfill-space/4kdata 2024-09-16T03:50:59.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:50:59.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj3 td/osd-backfill-space/4kdata 2024-09-16T03:50:59.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:50:59.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj4 td/osd-backfill-space/4kdata 2024-09-16T03:50:59.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:50:59.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj5 td/osd-backfill-space/4kdata 2024-09-16T03:51:00.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:00.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj6 td/osd-backfill-space/4kdata 2024-09-16T03:51:00.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:00.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj7 td/osd-backfill-space/4kdata 2024-09-16T03:51:00.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:00.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj8 td/osd-backfill-space/4kdata 2024-09-16T03:51:00.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:00.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj9 td/osd-backfill-space/4kdata 2024-09-16T03:51:00.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:00.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj10 td/osd-backfill-space/4kdata 2024-09-16T03:51:00.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:00.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj11 td/osd-backfill-space/4kdata 2024-09-16T03:51:00.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:00.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj12 td/osd-backfill-space/4kdata 2024-09-16T03:51:01.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:01.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj13 td/osd-backfill-space/4kdata 2024-09-16T03:51:01.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:01.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj14 td/osd-backfill-space/4kdata 2024-09-16T03:51:01.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:01.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj15 td/osd-backfill-space/4kdata 2024-09-16T03:51:01.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:01.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj16 td/osd-backfill-space/4kdata 2024-09-16T03:51:01.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:01.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj17 td/osd-backfill-space/4kdata 2024-09-16T03:51:01.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:01.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj18 td/osd-backfill-space/4kdata 2024-09-16T03:51:02.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:02.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj19 td/osd-backfill-space/4kdata 2024-09-16T03:51:02.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:02.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj20 td/osd-backfill-space/4kdata 2024-09-16T03:51:02.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:02.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj21 td/osd-backfill-space/4kdata 2024-09-16T03:51:02.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:02.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj22 td/osd-backfill-space/4kdata 2024-09-16T03:51:02.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:02.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj23 td/osd-backfill-space/4kdata 2024-09-16T03:51:02.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:02.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj24 td/osd-backfill-space/4kdata 2024-09-16T03:51:02.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:02.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj25 td/osd-backfill-space/4kdata 2024-09-16T03:51:03.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:03.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj26 td/osd-backfill-space/4kdata 2024-09-16T03:51:03.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:03.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj27 td/osd-backfill-space/4kdata 2024-09-16T03:51:03.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:03.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj28 td/osd-backfill-space/4kdata 2024-09-16T03:51:03.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:03.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj29 td/osd-backfill-space/4kdata 2024-09-16T03:51:03.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:03.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj30 td/osd-backfill-space/4kdata 2024-09-16T03:51:03.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:03.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj31 td/osd-backfill-space/4kdata 2024-09-16T03:51:03.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:03.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj32 td/osd-backfill-space/4kdata 2024-09-16T03:51:04.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:04.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj33 td/osd-backfill-space/4kdata 2024-09-16T03:51:04.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:04.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj34 td/osd-backfill-space/4kdata 2024-09-16T03:51:04.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:04.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj35 td/osd-backfill-space/4kdata 2024-09-16T03:51:04.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:04.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj36 td/osd-backfill-space/4kdata 2024-09-16T03:51:04.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:04.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj37 td/osd-backfill-space/4kdata 2024-09-16T03:51:04.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:04.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj38 td/osd-backfill-space/4kdata 2024-09-16T03:51:04.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:04.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj39 td/osd-backfill-space/4kdata 2024-09-16T03:51:05.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:05.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj40 td/osd-backfill-space/4kdata 2024-09-16T03:51:05.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:05.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj41 td/osd-backfill-space/4kdata 2024-09-16T03:51:05.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:05.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj42 td/osd-backfill-space/4kdata 2024-09-16T03:51:05.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:05.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj43 td/osd-backfill-space/4kdata 2024-09-16T03:51:05.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:05.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj44 td/osd-backfill-space/4kdata 2024-09-16T03:51:05.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:05.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj45 td/osd-backfill-space/4kdata 2024-09-16T03:51:06.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:06.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj46 td/osd-backfill-space/4kdata 2024-09-16T03:51:06.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:06.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj47 td/osd-backfill-space/4kdata 2024-09-16T03:51:06.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:06.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj48 td/osd-backfill-space/4kdata 2024-09-16T03:51:06.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:06.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj49 td/osd-backfill-space/4kdata 2024-09-16T03:51:06.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:06.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj50 td/osd-backfill-space/4kdata 2024-09-16T03:51:06.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:06.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj51 td/osd-backfill-space/4kdata 2024-09-16T03:51:06.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:06.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj52 td/osd-backfill-space/4kdata 2024-09-16T03:51:07.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:07.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj53 td/osd-backfill-space/4kdata 2024-09-16T03:51:07.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:07.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj54 td/osd-backfill-space/4kdata 2024-09-16T03:51:07.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:07.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj55 td/osd-backfill-space/4kdata 2024-09-16T03:51:07.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:07.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj56 td/osd-backfill-space/4kdata 2024-09-16T03:51:07.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:07.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj57 td/osd-backfill-space/4kdata 2024-09-16T03:51:07.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:07.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj58 td/osd-backfill-space/4kdata 2024-09-16T03:51:07.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:07.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj59 td/osd-backfill-space/4kdata 2024-09-16T03:51:08.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:08.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj60 td/osd-backfill-space/4kdata 2024-09-16T03:51:08.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:08.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj61 td/osd-backfill-space/4kdata 2024-09-16T03:51:08.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:08.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj62 td/osd-backfill-space/4kdata 2024-09-16T03:51:08.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:08.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj63 td/osd-backfill-space/4kdata 2024-09-16T03:51:08.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:08.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj64 td/osd-backfill-space/4kdata 2024-09-16T03:51:08.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:08.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj65 td/osd-backfill-space/4kdata 2024-09-16T03:51:08.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:08.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj66 td/osd-backfill-space/4kdata 2024-09-16T03:51:09.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:09.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj67 td/osd-backfill-space/4kdata 2024-09-16T03:51:09.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:09.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj68 td/osd-backfill-space/4kdata 2024-09-16T03:51:09.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:09.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj69 td/osd-backfill-space/4kdata 2024-09-16T03:51:09.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:09.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj70 td/osd-backfill-space/4kdata 2024-09-16T03:51:09.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:09.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj71 td/osd-backfill-space/4kdata 2024-09-16T03:51:09.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:09.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj72 td/osd-backfill-space/4kdata 2024-09-16T03:51:10.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:10.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj73 td/osd-backfill-space/4kdata 2024-09-16T03:51:10.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:10.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj74 td/osd-backfill-space/4kdata 2024-09-16T03:51:10.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:10.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj75 td/osd-backfill-space/4kdata 2024-09-16T03:51:10.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:10.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj76 td/osd-backfill-space/4kdata 2024-09-16T03:51:10.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:10.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj77 td/osd-backfill-space/4kdata 2024-09-16T03:51:10.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:10.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj78 td/osd-backfill-space/4kdata 2024-09-16T03:51:10.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:10.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj79 td/osd-backfill-space/4kdata 2024-09-16T03:51:11.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:11.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj80 td/osd-backfill-space/4kdata 2024-09-16T03:51:11.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:11.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj81 td/osd-backfill-space/4kdata 2024-09-16T03:51:11.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:11.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj82 td/osd-backfill-space/4kdata 2024-09-16T03:51:11.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:11.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj83 td/osd-backfill-space/4kdata 2024-09-16T03:51:11.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:11.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj84 td/osd-backfill-space/4kdata 2024-09-16T03:51:11.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:11.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj85 td/osd-backfill-space/4kdata 2024-09-16T03:51:11.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:11.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj86 td/osd-backfill-space/4kdata 2024-09-16T03:51:12.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:12.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj87 td/osd-backfill-space/4kdata 2024-09-16T03:51:12.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:12.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj88 td/osd-backfill-space/4kdata 2024-09-16T03:51:12.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:12.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj89 td/osd-backfill-space/4kdata 2024-09-16T03:51:12.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:12.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj90 td/osd-backfill-space/4kdata 2024-09-16T03:51:12.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:12.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj91 td/osd-backfill-space/4kdata 2024-09-16T03:51:12.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:12.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj92 td/osd-backfill-space/4kdata 2024-09-16T03:51:12.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:12.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj93 td/osd-backfill-space/4kdata 2024-09-16T03:51:13.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:13.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj94 td/osd-backfill-space/4kdata 2024-09-16T03:51:13.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:13.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj95 td/osd-backfill-space/4kdata 2024-09-16T03:51:13.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:13.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj96 td/osd-backfill-space/4kdata 2024-09-16T03:51:13.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:13.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj97 td/osd-backfill-space/4kdata 2024-09-16T03:51:13.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:13.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj98 td/osd-backfill-space/4kdata 2024-09-16T03:51:13.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:13.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj99 td/osd-backfill-space/4kdata 2024-09-16T03:51:14.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:14.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj100 td/osd-backfill-space/4kdata 2024-09-16T03:51:14.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:14.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj101 td/osd-backfill-space/4kdata 2024-09-16T03:51:14.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:14.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj102 td/osd-backfill-space/4kdata 2024-09-16T03:51:14.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:14.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj103 td/osd-backfill-space/4kdata 2024-09-16T03:51:14.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:14.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj104 td/osd-backfill-space/4kdata 2024-09-16T03:51:14.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:14.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj105 td/osd-backfill-space/4kdata 2024-09-16T03:51:14.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:14.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj106 td/osd-backfill-space/4kdata 2024-09-16T03:51:15.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:15.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj107 td/osd-backfill-space/4kdata 2024-09-16T03:51:15.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:15.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj108 td/osd-backfill-space/4kdata 2024-09-16T03:51:15.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:15.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj109 td/osd-backfill-space/4kdata 2024-09-16T03:51:15.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:15.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj110 td/osd-backfill-space/4kdata 2024-09-16T03:51:15.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:15.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj111 td/osd-backfill-space/4kdata 2024-09-16T03:51:15.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:15.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj112 td/osd-backfill-space/4kdata 2024-09-16T03:51:15.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:15.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj113 td/osd-backfill-space/4kdata 2024-09-16T03:51:16.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:16.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj114 td/osd-backfill-space/4kdata 2024-09-16T03:51:16.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:16.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj115 td/osd-backfill-space/4kdata 2024-09-16T03:51:16.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:16.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj116 td/osd-backfill-space/4kdata 2024-09-16T03:51:16.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:16.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj117 td/osd-backfill-space/4kdata 2024-09-16T03:51:16.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:16.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj118 td/osd-backfill-space/4kdata 2024-09-16T03:51:16.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:16.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj119 td/osd-backfill-space/4kdata 2024-09-16T03:51:16.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:16.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj120 td/osd-backfill-space/4kdata 2024-09-16T03:51:17.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:17.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj121 td/osd-backfill-space/4kdata 2024-09-16T03:51:17.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:17.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj122 td/osd-backfill-space/4kdata 2024-09-16T03:51:17.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:17.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj123 td/osd-backfill-space/4kdata 2024-09-16T03:51:17.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:17.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj124 td/osd-backfill-space/4kdata 2024-09-16T03:51:17.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:17.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj125 td/osd-backfill-space/4kdata 2024-09-16T03:51:17.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:17.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj126 td/osd-backfill-space/4kdata 2024-09-16T03:51:17.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:17.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj127 td/osd-backfill-space/4kdata 2024-09-16T03:51:18.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:18.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj128 td/osd-backfill-space/4kdata 2024-09-16T03:51:18.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:18.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj129 td/osd-backfill-space/4kdata 2024-09-16T03:51:18.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:18.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj130 td/osd-backfill-space/4kdata 2024-09-16T03:51:18.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:18.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj131 td/osd-backfill-space/4kdata 2024-09-16T03:51:18.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:18.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj132 td/osd-backfill-space/4kdata 2024-09-16T03:51:18.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:18.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj133 td/osd-backfill-space/4kdata 2024-09-16T03:51:19.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:19.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj134 td/osd-backfill-space/4kdata 2024-09-16T03:51:19.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:19.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj135 td/osd-backfill-space/4kdata 2024-09-16T03:51:19.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:19.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj136 td/osd-backfill-space/4kdata 2024-09-16T03:51:19.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:19.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj137 td/osd-backfill-space/4kdata 2024-09-16T03:51:19.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:19.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj138 td/osd-backfill-space/4kdata 2024-09-16T03:51:19.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:19.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj139 td/osd-backfill-space/4kdata 2024-09-16T03:51:19.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:19.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj140 td/osd-backfill-space/4kdata 2024-09-16T03:51:20.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:20.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj141 td/osd-backfill-space/4kdata 2024-09-16T03:51:20.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:20.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj142 td/osd-backfill-space/4kdata 2024-09-16T03:51:20.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:20.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj143 td/osd-backfill-space/4kdata 2024-09-16T03:51:20.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:20.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj144 td/osd-backfill-space/4kdata 2024-09-16T03:51:20.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:20.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj145 td/osd-backfill-space/4kdata 2024-09-16T03:51:20.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:20.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj146 td/osd-backfill-space/4kdata 2024-09-16T03:51:20.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:20.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj147 td/osd-backfill-space/4kdata 2024-09-16T03:51:21.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:21.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj148 td/osd-backfill-space/4kdata 2024-09-16T03:51:21.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:21.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj149 td/osd-backfill-space/4kdata 2024-09-16T03:51:21.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:21.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj150 td/osd-backfill-space/4kdata 2024-09-16T03:51:21.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:21.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj151 td/osd-backfill-space/4kdata 2024-09-16T03:51:21.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:21.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj152 td/osd-backfill-space/4kdata 2024-09-16T03:51:21.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:21.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj153 td/osd-backfill-space/4kdata 2024-09-16T03:51:21.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:21.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj154 td/osd-backfill-space/4kdata 2024-09-16T03:51:22.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:22.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj155 td/osd-backfill-space/4kdata 2024-09-16T03:51:22.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:22.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj156 td/osd-backfill-space/4kdata 2024-09-16T03:51:22.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:22.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj157 td/osd-backfill-space/4kdata 2024-09-16T03:51:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj158 td/osd-backfill-space/4kdata 2024-09-16T03:51:22.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:22.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj159 td/osd-backfill-space/4kdata 2024-09-16T03:51:22.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:22.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj160 td/osd-backfill-space/4kdata 2024-09-16T03:51:22.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:22.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj161 td/osd-backfill-space/4kdata 2024-09-16T03:51:23.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:23.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj162 td/osd-backfill-space/4kdata 2024-09-16T03:51:23.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:23.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj163 td/osd-backfill-space/4kdata 2024-09-16T03:51:23.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:23.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj164 td/osd-backfill-space/4kdata 2024-09-16T03:51:23.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:23.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj165 td/osd-backfill-space/4kdata 2024-09-16T03:51:23.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:23.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj166 td/osd-backfill-space/4kdata 2024-09-16T03:51:24.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:24.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj167 td/osd-backfill-space/4kdata 2024-09-16T03:51:24.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:24.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj168 td/osd-backfill-space/4kdata 2024-09-16T03:51:24.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:24.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj169 td/osd-backfill-space/4kdata 2024-09-16T03:51:24.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:24.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj170 td/osd-backfill-space/4kdata 2024-09-16T03:51:24.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:24.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj171 td/osd-backfill-space/4kdata 2024-09-16T03:51:24.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:24.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj172 td/osd-backfill-space/4kdata 2024-09-16T03:51:24.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:24.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj173 td/osd-backfill-space/4kdata 2024-09-16T03:51:25.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:25.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj174 td/osd-backfill-space/4kdata 2024-09-16T03:51:25.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:25.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj175 td/osd-backfill-space/4kdata 2024-09-16T03:51:25.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:25.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj176 td/osd-backfill-space/4kdata 2024-09-16T03:51:25.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:25.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj177 td/osd-backfill-space/4kdata 2024-09-16T03:51:25.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:25.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj178 td/osd-backfill-space/4kdata 2024-09-16T03:51:25.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:25.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj179 td/osd-backfill-space/4kdata 2024-09-16T03:51:25.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:25.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj180 td/osd-backfill-space/4kdata 2024-09-16T03:51:26.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:26.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj181 td/osd-backfill-space/4kdata 2024-09-16T03:51:26.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:26.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj182 td/osd-backfill-space/4kdata 2024-09-16T03:51:26.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:26.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj183 td/osd-backfill-space/4kdata 2024-09-16T03:51:26.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:26.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj184 td/osd-backfill-space/4kdata 2024-09-16T03:51:26.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:26.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj185 td/osd-backfill-space/4kdata 2024-09-16T03:51:26.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:26.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj186 td/osd-backfill-space/4kdata 2024-09-16T03:51:26.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:26.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj187 td/osd-backfill-space/4kdata 2024-09-16T03:51:27.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:27.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj188 td/osd-backfill-space/4kdata 2024-09-16T03:51:27.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:27.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj189 td/osd-backfill-space/4kdata 2024-09-16T03:51:27.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:27.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj190 td/osd-backfill-space/4kdata 2024-09-16T03:51:27.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:27.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj191 td/osd-backfill-space/4kdata 2024-09-16T03:51:27.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:27.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj192 td/osd-backfill-space/4kdata 2024-09-16T03:51:27.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:27.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj193 td/osd-backfill-space/4kdata 2024-09-16T03:51:28.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:28.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj194 td/osd-backfill-space/4kdata 2024-09-16T03:51:28.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:28.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj195 td/osd-backfill-space/4kdata 2024-09-16T03:51:28.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:28.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj196 td/osd-backfill-space/4kdata 2024-09-16T03:51:28.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:28.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj197 td/osd-backfill-space/4kdata 2024-09-16T03:51:28.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:28.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj198 td/osd-backfill-space/4kdata 2024-09-16T03:51:28.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:28.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj199 td/osd-backfill-space/4kdata 2024-09-16T03:51:28.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:28.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj200 td/osd-backfill-space/4kdata 2024-09-16T03:51:29.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:29.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj201 td/osd-backfill-space/4kdata 2024-09-16T03:51:29.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:29.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj202 td/osd-backfill-space/4kdata 2024-09-16T03:51:29.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:29.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj203 td/osd-backfill-space/4kdata 2024-09-16T03:51:29.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:29.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj204 td/osd-backfill-space/4kdata 2024-09-16T03:51:29.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:29.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj205 td/osd-backfill-space/4kdata 2024-09-16T03:51:29.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:29.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj206 td/osd-backfill-space/4kdata 2024-09-16T03:51:29.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:29.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj207 td/osd-backfill-space/4kdata 2024-09-16T03:51:30.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:30.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj208 td/osd-backfill-space/4kdata 2024-09-16T03:51:30.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:30.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj209 td/osd-backfill-space/4kdata 2024-09-16T03:51:30.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:30.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj210 td/osd-backfill-space/4kdata 2024-09-16T03:51:30.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:30.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj211 td/osd-backfill-space/4kdata 2024-09-16T03:51:30.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:30.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj212 td/osd-backfill-space/4kdata 2024-09-16T03:51:30.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:30.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj213 td/osd-backfill-space/4kdata 2024-09-16T03:51:30.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:30.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj214 td/osd-backfill-space/4kdata 2024-09-16T03:51:31.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:31.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj215 td/osd-backfill-space/4kdata 2024-09-16T03:51:31.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:31.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj216 td/osd-backfill-space/4kdata 2024-09-16T03:51:31.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:31.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj217 td/osd-backfill-space/4kdata 2024-09-16T03:51:31.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:31.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj218 td/osd-backfill-space/4kdata 2024-09-16T03:51:31.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:31.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj219 td/osd-backfill-space/4kdata 2024-09-16T03:51:31.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:31.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj220 td/osd-backfill-space/4kdata 2024-09-16T03:51:31.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:31.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj221 td/osd-backfill-space/4kdata 2024-09-16T03:51:32.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:32.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj222 td/osd-backfill-space/4kdata 2024-09-16T03:51:32.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:32.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj223 td/osd-backfill-space/4kdata 2024-09-16T03:51:32.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:32.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj224 td/osd-backfill-space/4kdata 2024-09-16T03:51:32.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:32.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj225 td/osd-backfill-space/4kdata 2024-09-16T03:51:32.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:32.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj226 td/osd-backfill-space/4kdata 2024-09-16T03:51:32.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:32.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj227 td/osd-backfill-space/4kdata 2024-09-16T03:51:33.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:33.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj228 td/osd-backfill-space/4kdata 2024-09-16T03:51:33.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:33.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj229 td/osd-backfill-space/4kdata 2024-09-16T03:51:33.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:33.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj230 td/osd-backfill-space/4kdata 2024-09-16T03:51:33.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:33.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj231 td/osd-backfill-space/4kdata 2024-09-16T03:51:33.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:33.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj232 td/osd-backfill-space/4kdata 2024-09-16T03:51:33.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:33.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj233 td/osd-backfill-space/4kdata 2024-09-16T03:51:33.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:33.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj234 td/osd-backfill-space/4kdata 2024-09-16T03:51:34.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:34.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj235 td/osd-backfill-space/4kdata 2024-09-16T03:51:34.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:34.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj236 td/osd-backfill-space/4kdata 2024-09-16T03:51:34.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:34.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj237 td/osd-backfill-space/4kdata 2024-09-16T03:51:34.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:34.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj238 td/osd-backfill-space/4kdata 2024-09-16T03:51:34.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:34.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj239 td/osd-backfill-space/4kdata 2024-09-16T03:51:34.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:34.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj240 td/osd-backfill-space/4kdata 2024-09-16T03:51:34.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:34.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj241 td/osd-backfill-space/4kdata 2024-09-16T03:51:35.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:35.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj242 td/osd-backfill-space/4kdata 2024-09-16T03:51:35.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:35.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj243 td/osd-backfill-space/4kdata 2024-09-16T03:51:35.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:35.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj244 td/osd-backfill-space/4kdata 2024-09-16T03:51:35.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:35.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj245 td/osd-backfill-space/4kdata 2024-09-16T03:51:35.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:35.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj246 td/osd-backfill-space/4kdata 2024-09-16T03:51:35.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:35.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj247 td/osd-backfill-space/4kdata 2024-09-16T03:51:35.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:35.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj248 td/osd-backfill-space/4kdata 2024-09-16T03:51:36.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:36.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj249 td/osd-backfill-space/4kdata 2024-09-16T03:51:36.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:36.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj250 td/osd-backfill-space/4kdata 2024-09-16T03:51:36.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:36.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj251 td/osd-backfill-space/4kdata 2024-09-16T03:51:36.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:36.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj252 td/osd-backfill-space/4kdata 2024-09-16T03:51:36.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:36.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj253 td/osd-backfill-space/4kdata 2024-09-16T03:51:36.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:36.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj254 td/osd-backfill-space/4kdata 2024-09-16T03:51:36.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:36.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj255 td/osd-backfill-space/4kdata 2024-09-16T03:51:37.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:37.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj256 td/osd-backfill-space/4kdata 2024-09-16T03:51:37.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:37.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj257 td/osd-backfill-space/4kdata 2024-09-16T03:51:37.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:37.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj258 td/osd-backfill-space/4kdata 2024-09-16T03:51:37.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:37.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj259 td/osd-backfill-space/4kdata 2024-09-16T03:51:37.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:37.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj260 td/osd-backfill-space/4kdata 2024-09-16T03:51:37.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:37.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj261 td/osd-backfill-space/4kdata 2024-09-16T03:51:37.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:37.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj262 td/osd-backfill-space/4kdata 2024-09-16T03:51:38.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:38.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj263 td/osd-backfill-space/4kdata 2024-09-16T03:51:38.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:38.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj264 td/osd-backfill-space/4kdata 2024-09-16T03:51:38.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:38.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj265 td/osd-backfill-space/4kdata 2024-09-16T03:51:38.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:38.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj266 td/osd-backfill-space/4kdata 2024-09-16T03:51:38.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:38.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj267 td/osd-backfill-space/4kdata 2024-09-16T03:51:38.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:38.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj268 td/osd-backfill-space/4kdata 2024-09-16T03:51:39.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:39.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj269 td/osd-backfill-space/4kdata 2024-09-16T03:51:39.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:39.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj270 td/osd-backfill-space/4kdata 2024-09-16T03:51:39.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:39.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj271 td/osd-backfill-space/4kdata 2024-09-16T03:51:39.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:39.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj272 td/osd-backfill-space/4kdata 2024-09-16T03:51:39.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:39.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj273 td/osd-backfill-space/4kdata 2024-09-16T03:51:39.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:39.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj274 td/osd-backfill-space/4kdata 2024-09-16T03:51:39.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:39.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj275 td/osd-backfill-space/4kdata 2024-09-16T03:51:40.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:40.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj276 td/osd-backfill-space/4kdata 2024-09-16T03:51:40.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:40.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj277 td/osd-backfill-space/4kdata 2024-09-16T03:51:40.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:40.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj278 td/osd-backfill-space/4kdata 2024-09-16T03:51:40.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:40.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj279 td/osd-backfill-space/4kdata 2024-09-16T03:51:40.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:40.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj280 td/osd-backfill-space/4kdata 2024-09-16T03:51:40.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:40.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj281 td/osd-backfill-space/4kdata 2024-09-16T03:51:40.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:40.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj282 td/osd-backfill-space/4kdata 2024-09-16T03:51:41.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:41.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj283 td/osd-backfill-space/4kdata 2024-09-16T03:51:41.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:41.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj284 td/osd-backfill-space/4kdata 2024-09-16T03:51:41.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:41.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj285 td/osd-backfill-space/4kdata 2024-09-16T03:51:41.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:41.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj286 td/osd-backfill-space/4kdata 2024-09-16T03:51:41.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:41.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj287 td/osd-backfill-space/4kdata 2024-09-16T03:51:41.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:41.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj288 td/osd-backfill-space/4kdata 2024-09-16T03:51:41.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:41.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj289 td/osd-backfill-space/4kdata 2024-09-16T03:51:42.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:42.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj290 td/osd-backfill-space/4kdata 2024-09-16T03:51:42.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:42.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj291 td/osd-backfill-space/4kdata 2024-09-16T03:51:42.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:42.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj292 td/osd-backfill-space/4kdata 2024-09-16T03:51:42.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:42.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj293 td/osd-backfill-space/4kdata 2024-09-16T03:51:42.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:42.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj294 td/osd-backfill-space/4kdata 2024-09-16T03:51:42.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:42.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj295 td/osd-backfill-space/4kdata 2024-09-16T03:51:42.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:42.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj296 td/osd-backfill-space/4kdata 2024-09-16T03:51:43.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:43.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj297 td/osd-backfill-space/4kdata 2024-09-16T03:51:43.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:43.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj298 td/osd-backfill-space/4kdata 2024-09-16T03:51:43.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:43.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj299 td/osd-backfill-space/4kdata 2024-09-16T03:51:43.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:43.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj300 td/osd-backfill-space/4kdata 2024-09-16T03:51:43.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:43.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj301 td/osd-backfill-space/4kdata 2024-09-16T03:51:43.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:43.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj302 td/osd-backfill-space/4kdata 2024-09-16T03:51:44.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:44.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj303 td/osd-backfill-space/4kdata 2024-09-16T03:51:44.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:44.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj304 td/osd-backfill-space/4kdata 2024-09-16T03:51:44.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:44.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj305 td/osd-backfill-space/4kdata 2024-09-16T03:51:44.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:44.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj306 td/osd-backfill-space/4kdata 2024-09-16T03:51:44.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:44.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj307 td/osd-backfill-space/4kdata 2024-09-16T03:51:44.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:44.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj308 td/osd-backfill-space/4kdata 2024-09-16T03:51:44.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:44.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj309 td/osd-backfill-space/4kdata 2024-09-16T03:51:45.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:45.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj310 td/osd-backfill-space/4kdata 2024-09-16T03:51:45.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:45.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj311 td/osd-backfill-space/4kdata 2024-09-16T03:51:45.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:45.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj312 td/osd-backfill-space/4kdata 2024-09-16T03:51:45.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:45.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj313 td/osd-backfill-space/4kdata 2024-09-16T03:51:45.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:45.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj314 td/osd-backfill-space/4kdata 2024-09-16T03:51:45.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:45.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj315 td/osd-backfill-space/4kdata 2024-09-16T03:51:45.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:45.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj316 td/osd-backfill-space/4kdata 2024-09-16T03:51:46.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:46.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj317 td/osd-backfill-space/4kdata 2024-09-16T03:51:46.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:46.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj318 td/osd-backfill-space/4kdata 2024-09-16T03:51:46.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:46.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj319 td/osd-backfill-space/4kdata 2024-09-16T03:51:46.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:46.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj320 td/osd-backfill-space/4kdata 2024-09-16T03:51:46.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:46.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj321 td/osd-backfill-space/4kdata 2024-09-16T03:51:46.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:46.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj322 td/osd-backfill-space/4kdata 2024-09-16T03:51:46.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:46.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj323 td/osd-backfill-space/4kdata 2024-09-16T03:51:47.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:47.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj324 td/osd-backfill-space/4kdata 2024-09-16T03:51:47.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:47.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj325 td/osd-backfill-space/4kdata 2024-09-16T03:51:47.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:47.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj326 td/osd-backfill-space/4kdata 2024-09-16T03:51:47.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:47.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj327 td/osd-backfill-space/4kdata 2024-09-16T03:51:47.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:47.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj328 td/osd-backfill-space/4kdata 2024-09-16T03:51:47.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:47.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj329 td/osd-backfill-space/4kdata 2024-09-16T03:51:48.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:48.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj330 td/osd-backfill-space/4kdata 2024-09-16T03:51:48.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:48.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj331 td/osd-backfill-space/4kdata 2024-09-16T03:51:48.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:48.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj332 td/osd-backfill-space/4kdata 2024-09-16T03:51:48.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:48.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj333 td/osd-backfill-space/4kdata 2024-09-16T03:51:48.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:48.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj334 td/osd-backfill-space/4kdata 2024-09-16T03:51:48.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:48.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj335 td/osd-backfill-space/4kdata 2024-09-16T03:51:48.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:48.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj336 td/osd-backfill-space/4kdata 2024-09-16T03:51:49.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:49.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj337 td/osd-backfill-space/4kdata 2024-09-16T03:51:49.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:49.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj338 td/osd-backfill-space/4kdata 2024-09-16T03:51:49.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:49.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj339 td/osd-backfill-space/4kdata 2024-09-16T03:51:49.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:49.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj340 td/osd-backfill-space/4kdata 2024-09-16T03:51:49.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:49.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj341 td/osd-backfill-space/4kdata 2024-09-16T03:51:49.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:49.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj342 td/osd-backfill-space/4kdata 2024-09-16T03:51:49.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:49.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj343 td/osd-backfill-space/4kdata 2024-09-16T03:51:50.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:50.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj344 td/osd-backfill-space/4kdata 2024-09-16T03:51:50.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:50.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj345 td/osd-backfill-space/4kdata 2024-09-16T03:51:50.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:50.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj346 td/osd-backfill-space/4kdata 2024-09-16T03:51:50.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:50.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj347 td/osd-backfill-space/4kdata 2024-09-16T03:51:50.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:50.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj348 td/osd-backfill-space/4kdata 2024-09-16T03:51:50.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:50.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj349 td/osd-backfill-space/4kdata 2024-09-16T03:51:50.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:50.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj350 td/osd-backfill-space/4kdata 2024-09-16T03:51:51.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:51.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj351 td/osd-backfill-space/4kdata 2024-09-16T03:51:51.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:51.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj352 td/osd-backfill-space/4kdata 2024-09-16T03:51:51.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:51.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj353 td/osd-backfill-space/4kdata 2024-09-16T03:51:51.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:51.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj354 td/osd-backfill-space/4kdata 2024-09-16T03:51:51.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:51.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj355 td/osd-backfill-space/4kdata 2024-09-16T03:51:51.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:51.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj356 td/osd-backfill-space/4kdata 2024-09-16T03:51:51.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:51.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj357 td/osd-backfill-space/4kdata 2024-09-16T03:51:52.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:52.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj358 td/osd-backfill-space/4kdata 2024-09-16T03:51:52.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:52.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj359 td/osd-backfill-space/4kdata 2024-09-16T03:51:52.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:52.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj360 td/osd-backfill-space/4kdata 2024-09-16T03:51:52.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:52.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj361 td/osd-backfill-space/4kdata 2024-09-16T03:51:52.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:52.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj362 td/osd-backfill-space/4kdata 2024-09-16T03:51:52.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:52.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj363 td/osd-backfill-space/4kdata 2024-09-16T03:51:52.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:52.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj364 td/osd-backfill-space/4kdata 2024-09-16T03:51:53.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:53.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj365 td/osd-backfill-space/4kdata 2024-09-16T03:51:53.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:53.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj366 td/osd-backfill-space/4kdata 2024-09-16T03:51:53.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:53.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj367 td/osd-backfill-space/4kdata 2024-09-16T03:51:53.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:53.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj368 td/osd-backfill-space/4kdata 2024-09-16T03:51:53.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:53.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj369 td/osd-backfill-space/4kdata 2024-09-16T03:51:53.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:53.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj370 td/osd-backfill-space/4kdata 2024-09-16T03:51:54.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:54.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj371 td/osd-backfill-space/4kdata 2024-09-16T03:51:54.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:54.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj372 td/osd-backfill-space/4kdata 2024-09-16T03:51:54.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:54.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj373 td/osd-backfill-space/4kdata 2024-09-16T03:51:54.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:54.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj374 td/osd-backfill-space/4kdata 2024-09-16T03:51:54.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:54.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj375 td/osd-backfill-space/4kdata 2024-09-16T03:51:55.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:55.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj376 td/osd-backfill-space/4kdata 2024-09-16T03:51:55.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:55.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj377 td/osd-backfill-space/4kdata 2024-09-16T03:51:55.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:55.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj378 td/osd-backfill-space/4kdata 2024-09-16T03:51:55.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:55.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj379 td/osd-backfill-space/4kdata 2024-09-16T03:51:55.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:55.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj380 td/osd-backfill-space/4kdata 2024-09-16T03:51:55.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:55.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj381 td/osd-backfill-space/4kdata 2024-09-16T03:51:55.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:55.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj382 td/osd-backfill-space/4kdata 2024-09-16T03:51:56.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:56.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj383 td/osd-backfill-space/4kdata 2024-09-16T03:51:56.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:56.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj384 td/osd-backfill-space/4kdata 2024-09-16T03:51:56.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:56.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj385 td/osd-backfill-space/4kdata 2024-09-16T03:51:56.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:56.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj386 td/osd-backfill-space/4kdata 2024-09-16T03:51:56.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:56.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj387 td/osd-backfill-space/4kdata 2024-09-16T03:51:56.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:56.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj388 td/osd-backfill-space/4kdata 2024-09-16T03:51:56.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:56.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj389 td/osd-backfill-space/4kdata 2024-09-16T03:51:57.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:57.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj390 td/osd-backfill-space/4kdata 2024-09-16T03:51:57.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:57.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj391 td/osd-backfill-space/4kdata 2024-09-16T03:51:57.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:57.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj392 td/osd-backfill-space/4kdata 2024-09-16T03:51:57.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:57.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj393 td/osd-backfill-space/4kdata 2024-09-16T03:51:57.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:57.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj394 td/osd-backfill-space/4kdata 2024-09-16T03:51:57.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:57.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj395 td/osd-backfill-space/4kdata 2024-09-16T03:51:57.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:57.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj396 td/osd-backfill-space/4kdata 2024-09-16T03:51:58.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:58.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj397 td/osd-backfill-space/4kdata 2024-09-16T03:51:58.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:58.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj398 td/osd-backfill-space/4kdata 2024-09-16T03:51:58.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:58.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj399 td/osd-backfill-space/4kdata 2024-09-16T03:51:58.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:58.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj400 td/osd-backfill-space/4kdata 2024-09-16T03:51:58.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:58.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj401 td/osd-backfill-space/4kdata 2024-09-16T03:51:58.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:58.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj402 td/osd-backfill-space/4kdata 2024-09-16T03:51:58.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:58.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj403 td/osd-backfill-space/4kdata 2024-09-16T03:51:59.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:59.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj404 td/osd-backfill-space/4kdata 2024-09-16T03:51:59.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:59.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj405 td/osd-backfill-space/4kdata 2024-09-16T03:51:59.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:59.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj406 td/osd-backfill-space/4kdata 2024-09-16T03:51:59.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:59.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj407 td/osd-backfill-space/4kdata 2024-09-16T03:51:59.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:59.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj408 td/osd-backfill-space/4kdata 2024-09-16T03:51:59.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:51:59.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj409 td/osd-backfill-space/4kdata 2024-09-16T03:52:00.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:00.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj410 td/osd-backfill-space/4kdata 2024-09-16T03:52:00.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:00.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj411 td/osd-backfill-space/4kdata 2024-09-16T03:52:00.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:00.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj412 td/osd-backfill-space/4kdata 2024-09-16T03:52:00.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:00.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj413 td/osd-backfill-space/4kdata 2024-09-16T03:52:00.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:00.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj414 td/osd-backfill-space/4kdata 2024-09-16T03:52:00.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:00.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj415 td/osd-backfill-space/4kdata 2024-09-16T03:52:00.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:00.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj416 td/osd-backfill-space/4kdata 2024-09-16T03:52:01.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:01.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj417 td/osd-backfill-space/4kdata 2024-09-16T03:52:01.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:01.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj418 td/osd-backfill-space/4kdata 2024-09-16T03:52:01.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:01.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj419 td/osd-backfill-space/4kdata 2024-09-16T03:52:01.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:01.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj420 td/osd-backfill-space/4kdata 2024-09-16T03:52:01.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:01.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj421 td/osd-backfill-space/4kdata 2024-09-16T03:52:01.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:01.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj422 td/osd-backfill-space/4kdata 2024-09-16T03:52:02.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:02.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj423 td/osd-backfill-space/4kdata 2024-09-16T03:52:02.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:02.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj424 td/osd-backfill-space/4kdata 2024-09-16T03:52:02.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:02.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj425 td/osd-backfill-space/4kdata 2024-09-16T03:52:02.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:02.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj426 td/osd-backfill-space/4kdata 2024-09-16T03:52:02.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:02.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj427 td/osd-backfill-space/4kdata 2024-09-16T03:52:02.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:02.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj428 td/osd-backfill-space/4kdata 2024-09-16T03:52:02.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:02.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj429 td/osd-backfill-space/4kdata 2024-09-16T03:52:03.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:03.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj430 td/osd-backfill-space/4kdata 2024-09-16T03:52:03.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj431 td/osd-backfill-space/4kdata 2024-09-16T03:52:03.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:03.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj432 td/osd-backfill-space/4kdata 2024-09-16T03:52:03.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:03.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj433 td/osd-backfill-space/4kdata 2024-09-16T03:52:03.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:03.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj434 td/osd-backfill-space/4kdata 2024-09-16T03:52:03.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:03.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj435 td/osd-backfill-space/4kdata 2024-09-16T03:52:03.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:03.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj436 td/osd-backfill-space/4kdata 2024-09-16T03:52:04.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:04.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj437 td/osd-backfill-space/4kdata 2024-09-16T03:52:04.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:04.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj438 td/osd-backfill-space/4kdata 2024-09-16T03:52:04.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:04.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj439 td/osd-backfill-space/4kdata 2024-09-16T03:52:04.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:04.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj440 td/osd-backfill-space/4kdata 2024-09-16T03:52:04.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:04.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj441 td/osd-backfill-space/4kdata 2024-09-16T03:52:04.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:04.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj442 td/osd-backfill-space/4kdata 2024-09-16T03:52:05.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:05.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj443 td/osd-backfill-space/4kdata 2024-09-16T03:52:05.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:05.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj444 td/osd-backfill-space/4kdata 2024-09-16T03:52:05.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:05.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj445 td/osd-backfill-space/4kdata 2024-09-16T03:52:05.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:05.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj446 td/osd-backfill-space/4kdata 2024-09-16T03:52:05.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:05.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj447 td/osd-backfill-space/4kdata 2024-09-16T03:52:05.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:05.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj448 td/osd-backfill-space/4kdata 2024-09-16T03:52:05.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:05.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj449 td/osd-backfill-space/4kdata 2024-09-16T03:52:06.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:06.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj450 td/osd-backfill-space/4kdata 2024-09-16T03:52:06.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:06.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj451 td/osd-backfill-space/4kdata 2024-09-16T03:52:06.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:06.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj452 td/osd-backfill-space/4kdata 2024-09-16T03:52:06.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:06.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj453 td/osd-backfill-space/4kdata 2024-09-16T03:52:06.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:06.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj454 td/osd-backfill-space/4kdata 2024-09-16T03:52:06.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:06.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj455 td/osd-backfill-space/4kdata 2024-09-16T03:52:06.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:06.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj456 td/osd-backfill-space/4kdata 2024-09-16T03:52:07.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:07.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj457 td/osd-backfill-space/4kdata 2024-09-16T03:52:07.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:07.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj458 td/osd-backfill-space/4kdata 2024-09-16T03:52:07.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:07.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj459 td/osd-backfill-space/4kdata 2024-09-16T03:52:07.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:07.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj460 td/osd-backfill-space/4kdata 2024-09-16T03:52:07.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:07.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj461 td/osd-backfill-space/4kdata 2024-09-16T03:52:07.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:07.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj462 td/osd-backfill-space/4kdata 2024-09-16T03:52:07.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:07.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj463 td/osd-backfill-space/4kdata 2024-09-16T03:52:08.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:08.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj464 td/osd-backfill-space/4kdata 2024-09-16T03:52:08.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:08.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj465 td/osd-backfill-space/4kdata 2024-09-16T03:52:08.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:08.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj466 td/osd-backfill-space/4kdata 2024-09-16T03:52:08.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:08.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj467 td/osd-backfill-space/4kdata 2024-09-16T03:52:08.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:08.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj468 td/osd-backfill-space/4kdata 2024-09-16T03:52:08.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:08.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj469 td/osd-backfill-space/4kdata 2024-09-16T03:52:08.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:08.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj470 td/osd-backfill-space/4kdata 2024-09-16T03:52:09.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:09.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj471 td/osd-backfill-space/4kdata 2024-09-16T03:52:09.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:09.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj472 td/osd-backfill-space/4kdata 2024-09-16T03:52:09.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:09.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj473 td/osd-backfill-space/4kdata 2024-09-16T03:52:09.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:09.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj474 td/osd-backfill-space/4kdata 2024-09-16T03:52:09.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:09.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj475 td/osd-backfill-space/4kdata 2024-09-16T03:52:09.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:09.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj476 td/osd-backfill-space/4kdata 2024-09-16T03:52:10.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:10.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj477 td/osd-backfill-space/4kdata 2024-09-16T03:52:10.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:10.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj478 td/osd-backfill-space/4kdata 2024-09-16T03:52:10.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:10.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj479 td/osd-backfill-space/4kdata 2024-09-16T03:52:10.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:10.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj480 td/osd-backfill-space/4kdata 2024-09-16T03:52:10.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:10.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj481 td/osd-backfill-space/4kdata 2024-09-16T03:52:10.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:10.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj482 td/osd-backfill-space/4kdata 2024-09-16T03:52:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj483 td/osd-backfill-space/4kdata 2024-09-16T03:52:11.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:11.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj484 td/osd-backfill-space/4kdata 2024-09-16T03:52:11.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:11.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj485 td/osd-backfill-space/4kdata 2024-09-16T03:52:11.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:11.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj486 td/osd-backfill-space/4kdata 2024-09-16T03:52:11.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:11.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj487 td/osd-backfill-space/4kdata 2024-09-16T03:52:11.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:11.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj488 td/osd-backfill-space/4kdata 2024-09-16T03:52:11.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:11.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj489 td/osd-backfill-space/4kdata 2024-09-16T03:52:12.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:12.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj490 td/osd-backfill-space/4kdata 2024-09-16T03:52:12.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:12.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj491 td/osd-backfill-space/4kdata 2024-09-16T03:52:12.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:12.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj492 td/osd-backfill-space/4kdata 2024-09-16T03:52:12.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:12.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj493 td/osd-backfill-space/4kdata 2024-09-16T03:52:12.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:12.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj494 td/osd-backfill-space/4kdata 2024-09-16T03:52:12.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:12.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj495 td/osd-backfill-space/4kdata 2024-09-16T03:52:12.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:12.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj496 td/osd-backfill-space/4kdata 2024-09-16T03:52:13.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:13.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj497 td/osd-backfill-space/4kdata 2024-09-16T03:52:13.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:13.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj498 td/osd-backfill-space/4kdata 2024-09-16T03:52:13.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:13.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj499 td/osd-backfill-space/4kdata 2024-09-16T03:52:13.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:13.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj500 td/osd-backfill-space/4kdata 2024-09-16T03:52:13.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:13.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj501 td/osd-backfill-space/4kdata 2024-09-16T03:52:13.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:13.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj502 td/osd-backfill-space/4kdata 2024-09-16T03:52:13.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:13.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj503 td/osd-backfill-space/4kdata 2024-09-16T03:52:14.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:14.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj504 td/osd-backfill-space/4kdata 2024-09-16T03:52:14.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:14.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj505 td/osd-backfill-space/4kdata 2024-09-16T03:52:14.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:14.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj506 td/osd-backfill-space/4kdata 2024-09-16T03:52:14.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:14.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj507 td/osd-backfill-space/4kdata 2024-09-16T03:52:14.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:14.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj508 td/osd-backfill-space/4kdata 2024-09-16T03:52:14.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:14.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj509 td/osd-backfill-space/4kdata 2024-09-16T03:52:15.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:15.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj510 td/osd-backfill-space/4kdata 2024-09-16T03:52:15.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:15.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj511 td/osd-backfill-space/4kdata 2024-09-16T03:52:15.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:15.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj512 td/osd-backfill-space/4kdata 2024-09-16T03:52:15.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:15.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj513 td/osd-backfill-space/4kdata 2024-09-16T03:52:15.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:15.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj514 td/osd-backfill-space/4kdata 2024-09-16T03:52:15.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:15.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj515 td/osd-backfill-space/4kdata 2024-09-16T03:52:15.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:15.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj516 td/osd-backfill-space/4kdata 2024-09-16T03:52:16.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:16.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj517 td/osd-backfill-space/4kdata 2024-09-16T03:52:16.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:16.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj518 td/osd-backfill-space/4kdata 2024-09-16T03:52:16.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:16.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj519 td/osd-backfill-space/4kdata 2024-09-16T03:52:16.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:16.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj520 td/osd-backfill-space/4kdata 2024-09-16T03:52:16.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:16.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj521 td/osd-backfill-space/4kdata 2024-09-16T03:52:16.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:16.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj522 td/osd-backfill-space/4kdata 2024-09-16T03:52:16.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:16.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj523 td/osd-backfill-space/4kdata 2024-09-16T03:52:17.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:17.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj524 td/osd-backfill-space/4kdata 2024-09-16T03:52:17.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:17.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj525 td/osd-backfill-space/4kdata 2024-09-16T03:52:17.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:17.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj526 td/osd-backfill-space/4kdata 2024-09-16T03:52:17.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:17.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj527 td/osd-backfill-space/4kdata 2024-09-16T03:52:17.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:17.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj528 td/osd-backfill-space/4kdata 2024-09-16T03:52:17.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:17.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj529 td/osd-backfill-space/4kdata 2024-09-16T03:52:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:17.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj530 td/osd-backfill-space/4kdata 2024-09-16T03:52:18.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:18.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj531 td/osd-backfill-space/4kdata 2024-09-16T03:52:18.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:18.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj532 td/osd-backfill-space/4kdata 2024-09-16T03:52:18.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:18.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj533 td/osd-backfill-space/4kdata 2024-09-16T03:52:18.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:18.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj534 td/osd-backfill-space/4kdata 2024-09-16T03:52:18.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:18.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj535 td/osd-backfill-space/4kdata 2024-09-16T03:52:18.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:18.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj536 td/osd-backfill-space/4kdata 2024-09-16T03:52:18.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:18.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj537 td/osd-backfill-space/4kdata 2024-09-16T03:52:19.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:19.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj538 td/osd-backfill-space/4kdata 2024-09-16T03:52:19.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:19.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj539 td/osd-backfill-space/4kdata 2024-09-16T03:52:19.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:19.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj540 td/osd-backfill-space/4kdata 2024-09-16T03:52:19.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:19.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj541 td/osd-backfill-space/4kdata 2024-09-16T03:52:19.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:19.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj542 td/osd-backfill-space/4kdata 2024-09-16T03:52:19.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:19.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj543 td/osd-backfill-space/4kdata 2024-09-16T03:52:19.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:19.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj544 td/osd-backfill-space/4kdata 2024-09-16T03:52:20.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:20.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj545 td/osd-backfill-space/4kdata 2024-09-16T03:52:20.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:20.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj546 td/osd-backfill-space/4kdata 2024-09-16T03:52:20.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:20.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj547 td/osd-backfill-space/4kdata 2024-09-16T03:52:20.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:20.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj548 td/osd-backfill-space/4kdata 2024-09-16T03:52:20.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:20.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj549 td/osd-backfill-space/4kdata 2024-09-16T03:52:20.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:20.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj550 td/osd-backfill-space/4kdata 2024-09-16T03:52:20.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:20.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj551 td/osd-backfill-space/4kdata 2024-09-16T03:52:21.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:21.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj552 td/osd-backfill-space/4kdata 2024-09-16T03:52:21.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:21.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj553 td/osd-backfill-space/4kdata 2024-09-16T03:52:21.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:21.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj554 td/osd-backfill-space/4kdata 2024-09-16T03:52:21.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:21.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj555 td/osd-backfill-space/4kdata 2024-09-16T03:52:21.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:21.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj556 td/osd-backfill-space/4kdata 2024-09-16T03:52:21.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:21.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj557 td/osd-backfill-space/4kdata 2024-09-16T03:52:21.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:21.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj558 td/osd-backfill-space/4kdata 2024-09-16T03:52:22.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:22.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj559 td/osd-backfill-space/4kdata 2024-09-16T03:52:22.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:22.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj560 td/osd-backfill-space/4kdata 2024-09-16T03:52:22.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:22.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj561 td/osd-backfill-space/4kdata 2024-09-16T03:52:22.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:22.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj562 td/osd-backfill-space/4kdata 2024-09-16T03:52:22.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:22.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj563 td/osd-backfill-space/4kdata 2024-09-16T03:52:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj564 td/osd-backfill-space/4kdata 2024-09-16T03:52:23.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:23.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj565 td/osd-backfill-space/4kdata 2024-09-16T03:52:23.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:23.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj566 td/osd-backfill-space/4kdata 2024-09-16T03:52:23.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:23.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj567 td/osd-backfill-space/4kdata 2024-09-16T03:52:23.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:23.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj568 td/osd-backfill-space/4kdata 2024-09-16T03:52:23.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:23.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj569 td/osd-backfill-space/4kdata 2024-09-16T03:52:23.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:23.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj570 td/osd-backfill-space/4kdata 2024-09-16T03:52:24.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:24.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj571 td/osd-backfill-space/4kdata 2024-09-16T03:52:24.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:24.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj572 td/osd-backfill-space/4kdata 2024-09-16T03:52:24.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:24.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj573 td/osd-backfill-space/4kdata 2024-09-16T03:52:24.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:24.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj574 td/osd-backfill-space/4kdata 2024-09-16T03:52:24.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:24.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj575 td/osd-backfill-space/4kdata 2024-09-16T03:52:24.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:24.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj576 td/osd-backfill-space/4kdata 2024-09-16T03:52:24.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:24.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj577 td/osd-backfill-space/4kdata 2024-09-16T03:52:24.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:24.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj578 td/osd-backfill-space/4kdata 2024-09-16T03:52:25.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:25.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj579 td/osd-backfill-space/4kdata 2024-09-16T03:52:25.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:25.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj580 td/osd-backfill-space/4kdata 2024-09-16T03:52:25.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:25.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj581 td/osd-backfill-space/4kdata 2024-09-16T03:52:25.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:25.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj582 td/osd-backfill-space/4kdata 2024-09-16T03:52:25.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:25.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj583 td/osd-backfill-space/4kdata 2024-09-16T03:52:25.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:25.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj584 td/osd-backfill-space/4kdata 2024-09-16T03:52:26.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:26.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj585 td/osd-backfill-space/4kdata 2024-09-16T03:52:26.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:26.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj586 td/osd-backfill-space/4kdata 2024-09-16T03:52:26.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:26.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj587 td/osd-backfill-space/4kdata 2024-09-16T03:52:26.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:26.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj588 td/osd-backfill-space/4kdata 2024-09-16T03:52:26.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:26.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj589 td/osd-backfill-space/4kdata 2024-09-16T03:52:26.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:26.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj590 td/osd-backfill-space/4kdata 2024-09-16T03:52:26.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:26.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj591 td/osd-backfill-space/4kdata 2024-09-16T03:52:26.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:26.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj592 td/osd-backfill-space/4kdata 2024-09-16T03:52:26.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:26.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj593 td/osd-backfill-space/4kdata 2024-09-16T03:52:27.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:27.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj594 td/osd-backfill-space/4kdata 2024-09-16T03:52:27.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:27.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj595 td/osd-backfill-space/4kdata 2024-09-16T03:52:27.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:27.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj596 td/osd-backfill-space/4kdata 2024-09-16T03:52:27.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:27.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj597 td/osd-backfill-space/4kdata 2024-09-16T03:52:27.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:27.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj598 td/osd-backfill-space/4kdata 2024-09-16T03:52:27.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:27.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj599 td/osd-backfill-space/4kdata 2024-09-16T03:52:27.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:579: TEST_backfill_grow: for i in $(seq 1 $objects) 2024-09-16T03:52:27.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:581: TEST_backfill_grow: rados -p test put obj600 td/osd-backfill-space/4kdata 2024-09-16T03:52:27.831 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:584: TEST_backfill_grow: get_pg test obj1 2024-09-16T03:52:27.831 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T03:52:27.831 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T03:52:27.831 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T03:52:27.831 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T03:52:28.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:584: TEST_backfill_grow: local PG=1.0 2024-09-16T03:52:28.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:586: TEST_backfill_grow: get_primary test obj1 2024-09-16T03:52:28.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T03:52:28.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T03:52:28.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T03:52:28.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T03:52:28.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:586: TEST_backfill_grow: local primary=1 2024-09-16T03:52:28.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:587: TEST_backfill_grow: get_not_primary test obj1 2024-09-16T03:52:28.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2024-09-16T03:52:28.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2024-09-16T03:52:28.744 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2024-09-16T03:52:28.744 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T03:52:28.745 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T03:52:28.745 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T03:52:28.745 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T03:52:29.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2024-09-16T03:52:29.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2024-09-16T03:52:29.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-09-16T03:52:29.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:587: TEST_backfill_grow: local otherosd=0 2024-09-16T03:52:29.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:589: TEST_backfill_grow: ceph osd set noout 2024-09-16T03:52:30.284 INFO:tasks.workunit.client.0.smithi026.stderr:noout is set 2024-09-16T03:52:30.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:590: TEST_backfill_grow: kill_daemons td/osd-backfill-space TERM 0 2024-09-16T03:52:30.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:52:30.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:52:30.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:52:30.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:52:30.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:52:30.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:52:30.604 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:592: TEST_backfill_grow: expr 600 / 4 2024-09-16T03:52:30.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:592: TEST_backfill_grow: rmobjects=150 2024-09-16T03:52:30.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: seq 1 150 2024-09-16T03:52:30.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:30.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj1 2024-09-16T03:52:31.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:31.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj2 2024-09-16T03:52:31.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:31.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj3 2024-09-16T03:52:31.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:31.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj4 2024-09-16T03:52:31.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:31.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj5 2024-09-16T03:52:31.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:31.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj6 2024-09-16T03:52:31.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:31.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj7 2024-09-16T03:52:31.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:31.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj8 2024-09-16T03:52:31.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:31.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj9 2024-09-16T03:52:32.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:32.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj10 2024-09-16T03:52:32.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:32.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj11 2024-09-16T03:52:32.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:32.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj12 2024-09-16T03:52:32.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:32.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj13 2024-09-16T03:52:32.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:32.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj14 2024-09-16T03:52:32.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:32.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj15 2024-09-16T03:52:32.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:32.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj16 2024-09-16T03:52:32.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:32.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj17 2024-09-16T03:52:32.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:32.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj18 2024-09-16T03:52:32.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:32.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj19 2024-09-16T03:52:33.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:33.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj20 2024-09-16T03:52:33.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:33.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj21 2024-09-16T03:52:33.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:33.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj22 2024-09-16T03:52:33.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:33.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj23 2024-09-16T03:52:33.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:33.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj24 2024-09-16T03:52:33.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:33.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj25 2024-09-16T03:52:33.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:33.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj26 2024-09-16T03:52:33.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:33.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj27 2024-09-16T03:52:33.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:33.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj28 2024-09-16T03:52:33.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:33.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj29 2024-09-16T03:52:34.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:34.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj30 2024-09-16T03:52:34.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:34.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj31 2024-09-16T03:52:34.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:34.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj32 2024-09-16T03:52:34.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:34.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj33 2024-09-16T03:52:34.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:34.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj34 2024-09-16T03:52:34.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:34.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj35 2024-09-16T03:52:34.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:34.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj36 2024-09-16T03:52:34.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:34.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj37 2024-09-16T03:52:34.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:34.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj38 2024-09-16T03:52:34.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:34.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj39 2024-09-16T03:52:35.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:35.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj40 2024-09-16T03:52:35.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:35.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj41 2024-09-16T03:52:35.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:35.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj42 2024-09-16T03:52:35.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:35.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj43 2024-09-16T03:52:35.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:35.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj44 2024-09-16T03:52:35.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:35.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj45 2024-09-16T03:52:35.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:35.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj46 2024-09-16T03:52:35.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:35.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj47 2024-09-16T03:52:35.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:35.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj48 2024-09-16T03:52:35.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:35.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj49 2024-09-16T03:52:36.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:36.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj50 2024-09-16T03:52:36.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:36.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj51 2024-09-16T03:52:36.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:36.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj52 2024-09-16T03:52:36.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:36.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj53 2024-09-16T03:52:36.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:36.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj54 2024-09-16T03:52:36.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:36.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj55 2024-09-16T03:52:36.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:36.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj56 2024-09-16T03:52:36.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:36.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj57 2024-09-16T03:52:36.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:36.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj58 2024-09-16T03:52:36.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:36.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj59 2024-09-16T03:52:37.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:37.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj60 2024-09-16T03:52:37.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:37.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj61 2024-09-16T03:52:37.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:37.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj62 2024-09-16T03:52:37.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:37.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj63 2024-09-16T03:52:37.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:37.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj64 2024-09-16T03:52:37.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:37.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj65 2024-09-16T03:52:37.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:37.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj66 2024-09-16T03:52:37.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:37.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj67 2024-09-16T03:52:37.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:37.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj68 2024-09-16T03:52:37.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:37.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj69 2024-09-16T03:52:37.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:37.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj70 2024-09-16T03:52:38.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:38.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj71 2024-09-16T03:52:38.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:38.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj72 2024-09-16T03:52:38.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:38.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj73 2024-09-16T03:52:38.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:38.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj74 2024-09-16T03:52:38.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:38.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj75 2024-09-16T03:52:38.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:38.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj76 2024-09-16T03:52:38.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:38.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj77 2024-09-16T03:52:38.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:38.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj78 2024-09-16T03:52:38.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:38.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj79 2024-09-16T03:52:38.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:38.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj80 2024-09-16T03:52:39.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:39.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj81 2024-09-16T03:52:39.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:39.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj82 2024-09-16T03:52:39.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:39.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj83 2024-09-16T03:52:39.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:39.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj84 2024-09-16T03:52:39.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:39.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj85 2024-09-16T03:52:39.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:39.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj86 2024-09-16T03:52:39.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:39.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj87 2024-09-16T03:52:39.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:39.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj88 2024-09-16T03:52:39.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:39.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj89 2024-09-16T03:52:39.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:39.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj90 2024-09-16T03:52:39.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:39.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj91 2024-09-16T03:52:40.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:40.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj92 2024-09-16T03:52:40.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:40.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj93 2024-09-16T03:52:40.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:40.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj94 2024-09-16T03:52:40.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:40.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj95 2024-09-16T03:52:40.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:40.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj96 2024-09-16T03:52:40.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:40.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj97 2024-09-16T03:52:40.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:40.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj98 2024-09-16T03:52:40.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:40.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj99 2024-09-16T03:52:40.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:40.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj100 2024-09-16T03:52:40.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:40.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj101 2024-09-16T03:52:41.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:41.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj102 2024-09-16T03:52:41.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:41.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj103 2024-09-16T03:52:41.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:41.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj104 2024-09-16T03:52:41.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:41.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj105 2024-09-16T03:52:41.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:41.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj106 2024-09-16T03:52:41.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:41.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj107 2024-09-16T03:52:41.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:41.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj108 2024-09-16T03:52:41.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:41.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj109 2024-09-16T03:52:41.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:41.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj110 2024-09-16T03:52:41.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:41.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj111 2024-09-16T03:52:42.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:42.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj112 2024-09-16T03:52:42.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:42.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj113 2024-09-16T03:52:42.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:42.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj114 2024-09-16T03:52:42.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:42.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj115 2024-09-16T03:52:42.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:42.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj116 2024-09-16T03:52:42.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:42.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj117 2024-09-16T03:52:42.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:42.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj118 2024-09-16T03:52:42.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:42.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj119 2024-09-16T03:52:42.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:42.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj120 2024-09-16T03:52:42.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:42.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj121 2024-09-16T03:52:43.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:43.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj122 2024-09-16T03:52:43.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:43.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj123 2024-09-16T03:52:43.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:43.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj124 2024-09-16T03:52:43.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:43.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj125 2024-09-16T03:52:43.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:43.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj126 2024-09-16T03:52:43.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:43.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj127 2024-09-16T03:52:43.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:43.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj128 2024-09-16T03:52:43.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:43.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj129 2024-09-16T03:52:43.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:43.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj130 2024-09-16T03:52:43.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:43.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj131 2024-09-16T03:52:43.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:43.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj132 2024-09-16T03:52:44.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:44.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj133 2024-09-16T03:52:44.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:44.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj134 2024-09-16T03:52:44.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:44.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj135 2024-09-16T03:52:44.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:44.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj136 2024-09-16T03:52:44.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:44.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj137 2024-09-16T03:52:44.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:44.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj138 2024-09-16T03:52:44.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:44.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj139 2024-09-16T03:52:44.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:44.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj140 2024-09-16T03:52:44.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:44.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj141 2024-09-16T03:52:44.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:44.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj142 2024-09-16T03:52:45.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:45.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj143 2024-09-16T03:52:45.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:45.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj144 2024-09-16T03:52:45.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:45.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj145 2024-09-16T03:52:45.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:45.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj146 2024-09-16T03:52:45.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:45.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj147 2024-09-16T03:52:45.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:45.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj148 2024-09-16T03:52:45.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:45.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj149 2024-09-16T03:52:45.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:593: TEST_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T03:52:45.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:595: TEST_backfill_grow: rados -p test rm obj150 2024-09-16T03:52:45.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:598: TEST_backfill_grow: dd if=/dev/urandom of=td/osd-backfill-space/6kdata bs=6k count=1 2024-09-16T03:52:45.821 INFO:tasks.workunit.client.0.smithi026.stderr:1+0 records in 2024-09-16T03:52:45.822 INFO:tasks.workunit.client.0.smithi026.stderr:1+0 records out 2024-09-16T03:52:45.822 INFO:tasks.workunit.client.0.smithi026.stderr:6144 bytes (6.1 kB, 6.0 KiB) copied, 6.2648e-05 s, 98.1 MB/s 2024-09-16T03:52:45.822 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: expr 150 + 1 2024-09-16T03:52:45.823 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: seq 151 600 2024-09-16T03:52:45.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:45.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj151 td/osd-backfill-space/6kdata 2024-09-16T03:52:45.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:45.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj152 td/osd-backfill-space/6kdata 2024-09-16T03:52:46.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:46.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj153 td/osd-backfill-space/6kdata 2024-09-16T03:52:46.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:46.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj154 td/osd-backfill-space/6kdata 2024-09-16T03:52:46.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:46.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj155 td/osd-backfill-space/6kdata 2024-09-16T03:52:46.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:46.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj156 td/osd-backfill-space/6kdata 2024-09-16T03:52:46.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:46.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj157 td/osd-backfill-space/6kdata 2024-09-16T03:52:46.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:46.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj158 td/osd-backfill-space/6kdata 2024-09-16T03:52:46.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:46.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj159 td/osd-backfill-space/6kdata 2024-09-16T03:52:46.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:46.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj160 td/osd-backfill-space/6kdata 2024-09-16T03:52:46.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:46.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj161 td/osd-backfill-space/6kdata 2024-09-16T03:52:46.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:46.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj162 td/osd-backfill-space/6kdata 2024-09-16T03:52:47.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:47.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj163 td/osd-backfill-space/6kdata 2024-09-16T03:52:47.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:47.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj164 td/osd-backfill-space/6kdata 2024-09-16T03:52:47.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:47.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj165 td/osd-backfill-space/6kdata 2024-09-16T03:52:47.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:47.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj166 td/osd-backfill-space/6kdata 2024-09-16T03:52:47.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:47.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj167 td/osd-backfill-space/6kdata 2024-09-16T03:52:47.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:47.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj168 td/osd-backfill-space/6kdata 2024-09-16T03:52:47.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:47.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj169 td/osd-backfill-space/6kdata 2024-09-16T03:52:47.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:47.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj170 td/osd-backfill-space/6kdata 2024-09-16T03:52:47.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:47.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj171 td/osd-backfill-space/6kdata 2024-09-16T03:52:47.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:47.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj172 td/osd-backfill-space/6kdata 2024-09-16T03:52:48.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:48.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj173 td/osd-backfill-space/6kdata 2024-09-16T03:52:48.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:48.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj174 td/osd-backfill-space/6kdata 2024-09-16T03:52:48.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:48.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj175 td/osd-backfill-space/6kdata 2024-09-16T03:52:48.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:48.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj176 td/osd-backfill-space/6kdata 2024-09-16T03:52:48.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:48.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj177 td/osd-backfill-space/6kdata 2024-09-16T03:52:48.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:48.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj178 td/osd-backfill-space/6kdata 2024-09-16T03:52:48.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:48.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj179 td/osd-backfill-space/6kdata 2024-09-16T03:52:48.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:48.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj180 td/osd-backfill-space/6kdata 2024-09-16T03:52:48.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:48.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj181 td/osd-backfill-space/6kdata 2024-09-16T03:52:48.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:48.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj182 td/osd-backfill-space/6kdata 2024-09-16T03:52:48.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:48.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj183 td/osd-backfill-space/6kdata 2024-09-16T03:52:49.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:49.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj184 td/osd-backfill-space/6kdata 2024-09-16T03:52:49.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:49.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj185 td/osd-backfill-space/6kdata 2024-09-16T03:52:49.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:49.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj186 td/osd-backfill-space/6kdata 2024-09-16T03:52:49.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:49.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj187 td/osd-backfill-space/6kdata 2024-09-16T03:52:49.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:49.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj188 td/osd-backfill-space/6kdata 2024-09-16T03:52:49.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:49.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj189 td/osd-backfill-space/6kdata 2024-09-16T03:52:49.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:49.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj190 td/osd-backfill-space/6kdata 2024-09-16T03:52:49.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:49.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj191 td/osd-backfill-space/6kdata 2024-09-16T03:52:49.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:49.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj192 td/osd-backfill-space/6kdata 2024-09-16T03:52:49.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:49.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj193 td/osd-backfill-space/6kdata 2024-09-16T03:52:49.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:49.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj194 td/osd-backfill-space/6kdata 2024-09-16T03:52:49.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:49.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj195 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj196 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj197 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj198 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj199 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj200 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj201 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj202 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj203 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj204 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj205 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj206 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj207 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj208 td/osd-backfill-space/6kdata 2024-09-16T03:52:50.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:50.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj209 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj210 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj211 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj212 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj213 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj214 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj215 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj216 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj217 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj218 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj219 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj220 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj221 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj222 td/osd-backfill-space/6kdata 2024-09-16T03:52:51.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:51.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj223 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj224 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj225 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj226 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj227 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj228 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj229 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj230 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj231 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj232 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj233 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj234 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj235 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj236 td/osd-backfill-space/6kdata 2024-09-16T03:52:52.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:52.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj237 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj238 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj239 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj240 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj241 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj242 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj243 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj244 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj245 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj246 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj247 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj248 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj249 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj250 td/osd-backfill-space/6kdata 2024-09-16T03:52:53.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:53.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj251 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj252 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj253 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj254 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj255 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj256 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj257 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj258 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj259 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj260 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj261 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj262 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj263 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj264 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj265 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj266 td/osd-backfill-space/6kdata 2024-09-16T03:52:54.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:54.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj267 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj268 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj269 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj270 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj271 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj272 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj273 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj274 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj275 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj276 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj277 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj278 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj279 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj280 td/osd-backfill-space/6kdata 2024-09-16T03:52:55.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:55.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj281 td/osd-backfill-space/6kdata 2024-09-16T03:52:56.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:56.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj282 td/osd-backfill-space/6kdata 2024-09-16T03:52:56.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:56.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj283 td/osd-backfill-space/6kdata 2024-09-16T03:52:56.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:56.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj284 td/osd-backfill-space/6kdata 2024-09-16T03:52:56.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:56.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj285 td/osd-backfill-space/6kdata 2024-09-16T03:52:56.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:56.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj286 td/osd-backfill-space/6kdata 2024-09-16T03:52:56.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:56.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj287 td/osd-backfill-space/6kdata 2024-09-16T03:52:56.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:56.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj288 td/osd-backfill-space/6kdata 2024-09-16T03:52:56.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:56.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj289 td/osd-backfill-space/6kdata 2024-09-16T03:52:56.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:56.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj290 td/osd-backfill-space/6kdata 2024-09-16T03:52:56.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:56.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj291 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj292 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj293 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj294 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj295 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj296 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj297 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj298 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj299 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj300 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj301 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj302 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj303 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj304 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj305 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj306 td/osd-backfill-space/6kdata 2024-09-16T03:52:57.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:57.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj307 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj308 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj309 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj310 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj311 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj312 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj313 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj314 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj315 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj316 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj317 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj318 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj319 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj320 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj321 td/osd-backfill-space/6kdata 2024-09-16T03:52:58.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:58.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj322 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj323 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj324 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj325 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj326 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj327 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj328 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj329 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj330 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj331 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj332 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj333 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj334 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj335 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj336 td/osd-backfill-space/6kdata 2024-09-16T03:52:59.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:52:59.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj337 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj338 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj339 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj340 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj341 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj342 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj343 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj344 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj345 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj346 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj347 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj348 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj349 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj350 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj351 td/osd-backfill-space/6kdata 2024-09-16T03:53:00.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:00.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj352 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj353 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj354 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj355 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj356 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj357 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj358 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj359 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj360 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj361 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj362 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj363 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj364 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj365 td/osd-backfill-space/6kdata 2024-09-16T03:53:01.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:01.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj366 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj367 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj368 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj369 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj370 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj371 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj372 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj373 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj374 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj375 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj376 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj377 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj378 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj379 td/osd-backfill-space/6kdata 2024-09-16T03:53:02.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:02.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj380 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj381 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj382 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj383 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj384 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj385 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj386 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj387 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj388 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj389 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj390 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj391 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj392 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj393 td/osd-backfill-space/6kdata 2024-09-16T03:53:03.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:03.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj394 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj395 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj396 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj397 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj398 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj399 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj400 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj401 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj402 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj403 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj404 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj405 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj406 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj407 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj408 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj409 td/osd-backfill-space/6kdata 2024-09-16T03:53:04.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:04.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj410 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj411 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj412 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj413 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj414 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj415 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj416 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj417 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj418 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj419 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj420 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj421 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj422 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj423 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj424 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj425 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj426 td/osd-backfill-space/6kdata 2024-09-16T03:53:05.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:05.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj427 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj428 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj429 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj430 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj431 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj432 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj433 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj434 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj435 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj436 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj437 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj438 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj439 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj440 td/osd-backfill-space/6kdata 2024-09-16T03:53:06.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:06.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj441 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj442 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj443 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj444 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj445 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj446 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj447 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj448 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj449 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj450 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj451 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj452 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj453 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj454 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj455 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj456 td/osd-backfill-space/6kdata 2024-09-16T03:53:07.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:07.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj457 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj458 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj459 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj460 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj461 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj462 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj463 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj464 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj465 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj466 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj467 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj468 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj469 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj470 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj471 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj472 td/osd-backfill-space/6kdata 2024-09-16T03:53:08.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:08.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj473 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj474 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj475 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj476 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj477 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj478 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj479 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj480 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj481 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj482 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj483 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj484 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj485 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj486 td/osd-backfill-space/6kdata 2024-09-16T03:53:09.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:09.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj487 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj488 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj489 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj490 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj491 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj492 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj493 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj494 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj495 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj496 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj497 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj498 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj499 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj500 td/osd-backfill-space/6kdata 2024-09-16T03:53:10.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:10.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj501 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj502 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj503 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj504 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj505 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj506 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj507 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj508 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj509 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj510 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj511 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj512 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj513 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj514 td/osd-backfill-space/6kdata 2024-09-16T03:53:11.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:11.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj515 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj516 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj517 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj518 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj519 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj520 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj521 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj522 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj523 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj524 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj525 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj526 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj527 td/osd-backfill-space/6kdata 2024-09-16T03:53:12.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:12.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj528 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj529 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj530 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj531 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj532 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj533 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj534 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj535 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj536 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj537 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj538 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj539 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj540 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj541 td/osd-backfill-space/6kdata 2024-09-16T03:53:13.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:13.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj542 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj543 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj544 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj545 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj546 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj547 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj548 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj549 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj550 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj551 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj552 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj553 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj554 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj555 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj556 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj557 td/osd-backfill-space/6kdata 2024-09-16T03:53:14.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:14.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj558 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj559 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj560 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj561 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj562 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj563 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj564 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj565 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj566 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj567 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj568 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj569 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj570 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj571 td/osd-backfill-space/6kdata 2024-09-16T03:53:15.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:15.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj572 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj573 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj574 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj575 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj576 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj577 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj578 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj579 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj580 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj581 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj582 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj583 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj584 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj585 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj586 td/osd-backfill-space/6kdata 2024-09-16T03:53:16.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:16.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj587 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj588 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj589 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj590 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj591 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj592 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj593 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj594 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj595 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj596 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj597 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj598 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj599 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:599: TEST_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $objects) 2024-09-16T03:53:17.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:601: TEST_backfill_grow: rados -p test put obj600 td/osd-backfill-space/6kdata 2024-09-16T03:53:17.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:604: TEST_backfill_grow: activate_osd td/osd-backfill-space 0 2024-09-16T03:53:17.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-backfill-space 2024-09-16T03:53:17.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T03:53:17.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2024-09-16T03:53:17.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T03:53:17.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-backfill-space/0 2024-09-16T03:53:17.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:53:17.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:53:17.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:53:17.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:53:17.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:53:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:53:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T03:53:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T03:53:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:53:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:53:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:53:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:53:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T03:53:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T03:53:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-backfill-space/0 2024-09-16T03:53:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2024-09-16T03:53:17.968 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T03:53:17.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:53:17.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-backfill-space/0/whoami 2024-09-16T03:53:17.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2024-09-16T03:53:17.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T03:53:17.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T03:53:17.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T03:53:17.999 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:53:17.997+0000 7feb8cc13640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:53:18.001 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:53:17.999+0000 7feb8cc13640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:53:18.002 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:53:18.000+0000 7feb8cc13640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:53:18.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2024-09-16T03:53:18.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:53:18.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:53:18.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:53:18.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:53:18.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:18.411 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:53:18.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:53:18.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:18.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:53:18.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:19.087 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:53:19.084+0000 7feb8cc13640 -1 Falling back to public interface 2024-09-16T03:53:19.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:19.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:19.826 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:53:19.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:53:19.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:19.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:53:20.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:21.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:21.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:21.280 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:53:21.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:53:21.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:21.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:53:21.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:53:22.206 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:53:22.204+0000 7feb8cc13640 -1 osd.0 23 log_to_monitors true 2024-09-16T03:53:22.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:53:22.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:53:22.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:53:22.801 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:53:22.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:53:22.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:53:23.247 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 29 up_thru 0 down_at 26 last_clean_interval [5,23) [v2:127.0.0.1:6802/651713859,v1:127.0.0.1:6803/651713859] [v2:127.0.0.1:6804/651713859,v1:127.0.0.1:6805/651713859] exists,up 1cb4bd34-daa4-4e73-a10a-4704cfc4ad59 2024-09-16T03:53:23.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:53:23.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:53:23.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:53:23.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:606: TEST_backfill_grow: ceph tell osd.1 debug kick_recovery_wq 0 2024-09-16T03:53:23.396 INFO:tasks.workunit.client.0.smithi026.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-09-16T03:53:23.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:608: TEST_backfill_grow: sleep 2 2024-09-16T03:53:25.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:610: TEST_backfill_grow: wait_for_clean 2024-09-16T03:53:25.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:53:25.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:53:25.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:53:25.406 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:53:25.407 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:53:25.407 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:53:25.407 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:53:25.407 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:53:25.407 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:53:25.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:53:25.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:53:25.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:53:25.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:53:25.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:53:25.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:53:25.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:53:25.922 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:53:25.922 INFO:tasks.workunit.client.0.smithi026.stderr:2' 2024-09-16T03:53:25.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:53:25.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:53:25.922 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:53:26.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=124554051587 2024-09-16T03:53:26.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 124554051587 2024-09-16T03:53:26.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-124554051587' 2024-09-16T03:53:26.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:53:26.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:53:26.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673006 2024-09-16T03:53:26.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673006 2024-09-16T03:53:26.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-124554051587 1-42949673006' 2024-09-16T03:53:26.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:53:26.263 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:53:26.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509482 2024-09-16T03:53:26.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509482 2024-09-16T03:53:26.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-124554051587 1-42949673006 2-64424509482' 2024-09-16T03:53:26.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:53:26.386 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-124554051587 2024-09-16T03:53:26.386 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:53:26.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:53:26.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-124554051587 2024-09-16T03:53:26.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:53:26.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=124554051587 2024-09-16T03:53:26.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 124554051587' 2024-09-16T03:53:26.388 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 124554051587 2024-09-16T03:53:26.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:53:26.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 1 -lt 124554051587 2024-09-16T03:53:26.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:53:27.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:53:27.800 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:53:28.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 124554051587 -lt 124554051587 2024-09-16T03:53:28.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:53:28.327 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673006 2024-09-16T03:53:28.327 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:53:28.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:53:28.328 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673006 2024-09-16T03:53:28.329 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:53:28.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673006 2024-09-16T03:53:28.330 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673006 2024-09-16T03:53:28.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673006' 2024-09-16T03:53:28.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:53:28.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673006 -lt 42949673006 2024-09-16T03:53:28.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:53:28.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509482 2024-09-16T03:53:28.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:53:28.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:53:28.890 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509482 2024-09-16T03:53:28.891 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:53:28.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509482 2024-09-16T03:53:28.892 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509482 2024-09-16T03:53:28.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509482' 2024-09-16T03:53:28.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:53:29.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509483 -lt 64424509482 2024-09-16T03:53:29.304 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:53:29.304 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:29.304 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:29.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T03:53:29.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:29.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:29.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:29.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:29.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:29.868 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:29.868 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:30.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:53:30.271 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:30.272 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:30.272 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:30.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:53:30.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T03:53:30.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T03:53:30.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T03:53:30.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:53:30.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:53:30.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:53:31.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:31.000 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:31.000 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:31.000 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:31.000 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:31.000 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:31.000 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:31.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:53:31.400 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:31.401 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:31.401 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:31.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:53:31.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:53:31.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:53:31.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:53:31.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:53:31.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:53:31.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:53:31.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:53:31.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:53:32.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=62975 2024-09-16T03:53:32.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 62975 '!=' null 2024-09-16T03:53:32.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:53:32.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:53:32.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:53:32.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:53:32.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:32.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:32.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:32.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:32.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:32.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:32.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:33.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:53:33.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:33.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:33.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:33.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:53:33.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:53:33.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:53:33.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:53:33.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:53:33.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:53:33.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:53:33.659 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:53:33.659 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:53:34.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=51160 2024-09-16T03:53:34.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 51160 '!=' null 2024-09-16T03:53:34.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:53:34.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:53:34.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:53:34.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:53:34.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:34.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:34.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:34.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:34.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:34.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:34.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:34.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:53:34.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:34.725 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:34.725 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:35.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:53:35.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:53:35.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:53:35.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:53:35.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:53:35.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:53:35.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:53:35.305 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:53:35.305 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:53:35.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=43887 2024-09-16T03:53:35.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 43887 '!=' null 2024-09-16T03:53:35.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:53:35.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:53:35.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:53:36.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:53:36.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:36.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:36.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:36.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:36.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:36.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:36.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:36.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:53:36.473 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:36.473 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:36.473 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:37.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:53:37.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:53:37.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:53:37.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:53:37.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:53:37.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:53:37.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:53:37.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:53:37.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:53:37.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=101377 2024-09-16T03:53:37.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 101377 '!=' null 2024-09-16T03:53:37.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:53:37.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:53:37.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:53:37.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:53:37.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:37.705 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:37.705 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:37.705 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:37.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:37.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:37.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:38.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:53:38.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:38.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:38.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:38.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:53:38.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:53:38.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:53:38.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:53:38.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:53:38.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:53:38.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:53:38.672 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:53:38.672 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:53:39.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=81410 2024-09-16T03:53:39.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 81410 '!=' null 2024-09-16T03:53:39.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:53:39.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:53:39.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:53:39.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:53:39.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:39.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:39.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:39.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:39.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:39.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:39.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:39.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:53:39.768 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:39.769 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:39.769 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:40.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:53:40.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:53:40.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:53:40.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:53:40.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:53:40.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:53:40.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:53:40.326 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:53:40.326 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:53:40.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=152579 2024-09-16T03:53:40.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 152579 '!=' null 2024-09-16T03:53:40.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:53:40.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:53:40.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:53:41.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:53:41.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:41.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:41.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:41.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:41.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:41.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:41.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:41.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:53:41.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:41.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:41.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:42.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:53:42.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:53:42.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:53:42.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:53:42.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:53:42.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:53:42.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:53:42.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:53:42.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:53:42.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=152579 2024-09-16T03:53:42.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 152579 '!=' null 2024-09-16T03:53:42.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:53:42.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:53:42.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:53:42.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:53:42.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:42.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:42.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:42.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:42.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:42.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:42.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:43.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:53:43.130 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:43.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:43.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:43.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:53:43.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:53:43.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:53:43.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:53:43.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:53:43.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:53:43.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:53:43.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:53:43.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:53:44.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=130563 2024-09-16T03:53:44.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 130563 '!=' null 2024-09-16T03:53:44.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:53:44.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:53:44.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:53:44.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:53:44.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:44.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:44.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:44.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:44.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:44.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:44.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:44.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:53:44.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:44.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:44.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:45.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:53:45.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:53:45.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:53:45.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:53:45.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:53:45.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:53:45.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:53:45.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:53:45.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:53:46.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=156675 2024-09-16T03:53:46.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 156675 '!=' null 2024-09-16T03:53:46.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:53:46.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:53:46.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:53:46.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:53:46.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:46.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:46.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:46.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:46.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:46.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:46.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:46.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T03:53:46.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:46.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:46.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:47.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T03:53:47.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T03:53:47.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T03:53:47.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T03:53:47.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T03:53:47.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T03:53:47.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T03:53:47.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T03:53:47.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T03:53:47.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=193541 2024-09-16T03:53:47.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 193541 '!=' null 2024-09-16T03:53:47.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T03:53:47.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T03:53:47.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T03:53:47.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T03:53:47.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:53:47.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:53:47.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:53:47.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:53:47.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:53:47.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:53:47.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:53:48.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T03:53:48.223 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:53:48.223 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:53:48.223 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:53:48.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T03:53:48.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:53:48.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:53:48.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:612: TEST_backfill_grow: delete_pool test 2024-09-16T03:53:48.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T03:53:48.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T03:53:49.423 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T03:53:49.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:613: TEST_backfill_grow: kill_daemons td/osd-backfill-space 2024-09-16T03:53:49.436 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:53:49.436 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:53:49.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:53:49.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:53:49.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:53:54.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:53:54.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:614: TEST_backfill_grow: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log 2024-09-16T03:53:54.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-09-16T03:53:54.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T03:53:54.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:53:54.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T03:53:54.793 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:53:54.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:53:54.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:53:54.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:53:54.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:53:54.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:53:54.799 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:53:54.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:53:54.801 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:53:54.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:53:54.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:53:54.802 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:53:54.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:53:54.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:53:54.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:53:54.804 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:53:54.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:53:54.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:53:54.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T03:53:54.865 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:53:54.865 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:53:54.865 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:53:54.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T03:53:54.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:53:54.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:53:54.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-09-16T03:53:54.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-09-16T03:53:54.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-space 2024-09-16T03:53:54.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-space 2024-09-16T03:53:54.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T03:53:54.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T03:53:54.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T03:53:54.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:53:54.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:53:54.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:53:54.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:53:54.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:53:54.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:53:54.869 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T03:53:54.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T03:53:54.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T03:53:54.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T03:53:54.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T03:53:54.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T03:53:54.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:53:54.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T03:53:54.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T03:53:54.873 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T03:53:54.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T03:53:54.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T03:53:54.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T03:53:54.876 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T03:53:54.876 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:53:54.876 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:53:54.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T03:53:54.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T03:53:54.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T03:53:54.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-space 2024-09-16T03:53:54.878 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T03:53:54.878 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:53:54.878 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:53:54.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.114688 2024-09-16T03:53:54.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T03:53:54.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T03:53:54.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T03:53:54.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-09-16T03:53:54.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_backfill_multi_partial td/osd-backfill-space 2024-09-16T03:53:54.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:430: TEST_backfill_multi_partial: local dir=td/osd-backfill-space 2024-09-16T03:53:54.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:431: TEST_backfill_multi_partial: local EC= 2024-09-16T03:53:54.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:432: TEST_backfill_multi_partial: local pools=2 2024-09-16T03:53:54.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:433: TEST_backfill_multi_partial: local OSDS=3 2024-09-16T03:53:54.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:435: TEST_backfill_multi_partial: run_mon td/osd-backfill-space a 2024-09-16T03:53:54.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-space 2024-09-16T03:53:54.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T03:53:54.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T03:53:54.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T03:53:54.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-space/a 2024-09-16T03:53:54.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-09-16T03:53:55.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T03:53:55.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:53:55.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:53:55.344 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:53:55.344 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:53:55.344 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:53:55.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:53:55.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T03:53:55.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T03:53:55.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T03:53:55.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:53:55.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:53:55.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T03:53:55.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T03:53:55.556 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:53:55.557 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:53:55.557 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:53:55.557 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:53:55.557 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:53:55.557 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:53:55.557 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T03:53:55.557 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:53:55.557 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get fsid 2024-09-16T03:53:55.647 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T03:53:55.647 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T03:53:55.647 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T03:53:55.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T03:53:55.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T03:53:55.648 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T03:53:55.648 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T03:53:55.648 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T03:53:55.649 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T03:53:55.649 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:53:55.649 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:53:55.649 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T03:53:55.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T03:53:55.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get mon_host 2024-09-16T03:53:55.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:436: TEST_backfill_multi_partial: run_mgr td/osd-backfill-space x 2024-09-16T03:53:55.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-space 2024-09-16T03:53:55.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T03:53:55.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T03:53:55.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T03:53:55.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-space/x 2024-09-16T03:53:55.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T03:53:56.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T03:53:56.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:53:56.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:53:56.595 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:53:56.595 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:53:56.596 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:53:56.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:53:56.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:53:56.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T03:53:56.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:437: TEST_backfill_multi_partial: export CEPH_ARGS 2024-09-16T03:53:56.631 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:439: TEST_backfill_multi_partial: expr 3 - 1 2024-09-16T03:53:56.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:439: TEST_backfill_multi_partial: seq 0 2 2024-09-16T03:53:56.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:439: TEST_backfill_multi_partial: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:53:56.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:441: TEST_backfill_multi_partial: run_osd td/osd-backfill-space 0 2024-09-16T03:53:56.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T03:53:56.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:53:56.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T03:53:56.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:53:56.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/0 2024-09-16T03:53:56.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:53:56.638 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:53:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:53:56.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/0 2024-09-16T03:53:56.640 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:53:56.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2e5b8503-60e1-49f7-8fed-e917a042cbc2 2024-09-16T03:53:56.640 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 2e5b8503-60e1-49f7-8fed-e917a042cbc2 2024-09-16T03:53:56.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2e5b8503-60e1-49f7-8fed-e917a042cbc2' 2024-09-16T03:53:56.641 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:53:56.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDUq+dmfzZHJxAA9gfySNa8QIOjNToyjgccxg== 2024-09-16T03:53:56.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDUq+dmfzZHJxAA9gfySNa8QIOjNToyjgccxg=="}' 2024-09-16T03:53:56.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2e5b8503-60e1-49f7-8fed-e917a042cbc2 -i td/osd-backfill-space/0/new.json 2024-09-16T03:53:56.936 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:53:56.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/0/new.json 2024-09-16T03:53:56.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDUq+dmfzZHJxAA9gfySNa8QIOjNToyjgccxg== --osd-uuid 2e5b8503-60e1-49f7-8fed-e917a042cbc2 2024-09-16T03:53:56.983 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:53:56.981+0000 7fdf45c15640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:53:56.996 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:53:56.995+0000 7fdf45c15640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:53:56.997 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:53:56.996+0000 7fdf45c15640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:53:56.998 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:53:56.996+0000 7fdf45c15640 -1 bdev(0x55e33f78dc00 td/osd-backfill-space/0/block) open stat got: (1) Operation not permitted 2024-09-16T03:53:56.998 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:53:56.996+0000 7fdf45c15640 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-09-16T03:54:02.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-09-16T03:54:02.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:54:02.702 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T03:54:02.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T03:54:02.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:54:03.272 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T03:54:03.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T03:54:03.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:54:03.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:54:03.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:54:03.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:54:03.307 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:03.305+0000 7f41f4a24640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:03.312 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:03.310+0000 7f41f4a24640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:03.313 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:03.311+0000 7f41f4a24640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:03.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T03:54:03.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:54:03.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T03:54:03.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:54:03.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:54:03.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:03.735 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:54:03.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:54:03.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:03.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:04.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:04.413 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:04.412+0000 7f41f4a24640 -1 Falling back to public interface 2024-09-16T03:54:05.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:05.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:05.178 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:54:05.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:54:05.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:05.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:05.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:06.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:06.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:06.630 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:54:06.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:54:06.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:06.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:07.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:07.113 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:07.112+0000 7f41f4a24640 -1 osd.0 0 log_to_monitors true 2024-09-16T03:54:08.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:08.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:08.051 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:54:08.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:54:08.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:08.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:08.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:09.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:09.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:09.477 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:54:09.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:54:09.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:09.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:10.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:11.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:11.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:11.007 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:54:11.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:54:11.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:11.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:11.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:12.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:12.427 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:54:12.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:12.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:54:12.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:12.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:12.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:13.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:13.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:13.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:54:13.902 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:54:13.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:13.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:14.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:15.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:15.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:15.329 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:54:15.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:54:15.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:15.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:15.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:16.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:16.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:16.901 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:54:16.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:54:16.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:16.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:17.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:18.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:18.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:18.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:54:18.334 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:54:18.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:18.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:18.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:19.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:19.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:19.949 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:54:19.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:54:19.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:19.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:20.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:21.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:21.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:21.904 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:54:21.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:54:21.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:21.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:22.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:23.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:23.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:23.709 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:54:23.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:54:23.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:23.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:24.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:25.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:25.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:25.393 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:54:25.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:54:25.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:25.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:26.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:27.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:27.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:27.210 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:54:27.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:54:27.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:27.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:28.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:29.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:29.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:29.216 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:54:29.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:54:29.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:29.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T03:54:29.752 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3071359192,v1:127.0.0.1:6803/3071359192] [v2:127.0.0.1:6804/3071359192,v1:127.0.0.1:6805/3071359192] exists,up 2e5b8503-60e1-49f7-8fed-e917a042cbc2 2024-09-16T03:54:29.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:54:29.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:54:29.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:54:29.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:439: TEST_backfill_multi_partial: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:54:29.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:441: TEST_backfill_multi_partial: run_osd td/osd-backfill-space 1 2024-09-16T03:54:29.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T03:54:29.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:54:29.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T03:54:29.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:54:29.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/1 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:54:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:54:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:54:29.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:54:29.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/1 2024-09-16T03:54:29.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:54:29.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c7947f11-e894-41de-b15f-a5c3658a4a1f 2024-09-16T03:54:29.759 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 c7947f11-e894-41de-b15f-a5c3658a4a1f 2024-09-16T03:54:29.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 c7947f11-e894-41de-b15f-a5c3658a4a1f' 2024-09-16T03:54:29.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:54:29.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD1q+dm14BfLhAACe5TvyLNzVtH5SF4T4J96g== 2024-09-16T03:54:29.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD1q+dm14BfLhAACe5TvyLNzVtH5SF4T4J96g=="}' 2024-09-16T03:54:29.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c7947f11-e894-41de-b15f-a5c3658a4a1f -i td/osd-backfill-space/1/new.json 2024-09-16T03:54:30.283 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:54:30.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/1/new.json 2024-09-16T03:54:30.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD1q+dm14BfLhAACe5TvyLNzVtH5SF4T4J96g== --osd-uuid c7947f11-e894-41de-b15f-a5c3658a4a1f 2024-09-16T03:54:30.333 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:30.329+0000 7f9dc8c22640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:30.359 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:30.357+0000 7f9dc8c22640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:30.360 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:30.358+0000 7f9dc8c22640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:30.360 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:30.359+0000 7f9dc8c22640 -1 bdev(0x55e4a5cadc00 td/osd-backfill-space/1/block) open stat got: (1) Operation not permitted 2024-09-16T03:54:30.360 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:30.359+0000 7f9dc8c22640 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-09-16T03:54:36.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-09-16T03:54:36.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:54:36.275 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T03:54:36.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T03:54:36.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:54:36.869 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T03:54:36.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T03:54:36.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:54:36.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:54:36.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:54:36.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:54:36.903 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:36.902+0000 7fc856aef640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:36.916 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:36.914+0000 7fc856aef640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:36.917 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:36.915+0000 7fc856aef640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:54:37.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T03:54:37.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:54:37.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:54:37.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:54:37.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:54:37.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:37.322 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:54:37.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:54:37.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:37.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:37.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:38.003 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:38.002+0000 7fc856aef640 -1 Falling back to public interface 2024-09-16T03:54:38.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:38.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:38.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:54:38.765 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:54:38.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:38.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:39.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:40.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:40.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:40.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:54:40.217 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:54:40.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:40.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:40.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:40.719 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:54:40.717+0000 7fc856aef640 -1 osd.1 0 log_to_monitors true 2024-09-16T03:54:41.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:41.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:41.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:54:41.645 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:54:41.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:41.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:42.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:43.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:43.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:43.126 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:54:43.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:54:43.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:43.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:43.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:44.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:44.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:44.646 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:54:44.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:54:44.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:44.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:45.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:46.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:46.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:46.092 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:54:46.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:54:46.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:46.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:46.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:47.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:47.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:47.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:54:47.630 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:54:47.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:47.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:48.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:49.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:49.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:49.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:54:49.124 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:54:49.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:49.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:49.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:50.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:50.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:50.619 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:54:50.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:54:50.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:50.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:51.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:52.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:52.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:52.063 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:54:52.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:54:52.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:52.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:52.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:53.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:53.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:53.613 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:54:53.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:54:53.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:53.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:54.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:55.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:55.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:55.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:54:55.302 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:54:55.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:55.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:56.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:57.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:57.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:57.237 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:54:57.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:54:57.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:57.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:54:58.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:54:59.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:54:59.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:54:59.060 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:54:59.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:54:59.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:54:59.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:00.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:01.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:01.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:01.351 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:55:01.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:55:01.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:01.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:02.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:03.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:03.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:03.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:55:03.313 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:55:03.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:03.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:55:03.787 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2064802052,v1:127.0.0.1:6811/2064802052] [v2:127.0.0.1:6812/2064802052,v1:127.0.0.1:6813/2064802052] exists,up c7947f11-e894-41de-b15f-a5c3658a4a1f 2024-09-16T03:55:03.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:55:03.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:55:03.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:55:03.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:439: TEST_backfill_multi_partial: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T03:55:03.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:441: TEST_backfill_multi_partial: run_osd td/osd-backfill-space 2 2024-09-16T03:55:03.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T03:55:03.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T03:55:03.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T03:55:03.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T03:55:03.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/2 2024-09-16T03:55:03.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:55:03.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:55:03.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:55:03.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:55:03.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-09-16T03:55:03.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-09-16T03:55:03.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T03:55:03.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T03:55:03.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T03:55:03.793 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T03:55:03.793 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:55:03.793 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:55:03.793 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:55:03.793 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:55:03.793 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:55:03.793 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:55:03.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:55:03.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:55:03.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T03:55:03.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T03:55:03.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T03:55:03.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T03:55:03.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:55:03.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:55:03.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:55:03.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:55:03.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T03:55:03.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T03:55:03.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/2 2024-09-16T03:55:03.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T03:55:03.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8e9f8cf3-0b08-482a-b7a7-7f57e65f91e0 2024-09-16T03:55:03.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 8e9f8cf3-0b08-482a-b7a7-7f57e65f91e0' 2024-09-16T03:55:03.795 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 8e9f8cf3-0b08-482a-b7a7-7f57e65f91e0 2024-09-16T03:55:03.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T03:55:03.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAXrOdmWfFoMBAAp8D0ozkPD6suOAvZEEEx6A== 2024-09-16T03:55:03.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAXrOdmWfFoMBAAp8D0ozkPD6suOAvZEEEx6A=="}' 2024-09-16T03:55:03.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8e9f8cf3-0b08-482a-b7a7-7f57e65f91e0 -i td/osd-backfill-space/2/new.json 2024-09-16T03:55:04.313 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:55:04.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/2/new.json 2024-09-16T03:55:04.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAXrOdmWfFoMBAAp8D0ozkPD6suOAvZEEEx6A== --osd-uuid 8e9f8cf3-0b08-482a-b7a7-7f57e65f91e0 2024-09-16T03:55:04.362 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:55:04.360+0000 7fd92dc15640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:04.364 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:55:04.362+0000 7fd92dc15640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:04.365 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:55:04.363+0000 7fd92dc15640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:04.365 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:55:04.364+0000 7fd92dc15640 -1 bdev(0x5583a5ea3c00 td/osd-backfill-space/2/block) open stat got: (1) Operation not permitted 2024-09-16T03:55:04.365 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:55:04.364+0000 7fd92dc15640 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-09-16T03:55:10.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-09-16T03:55:10.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T03:55:10.297 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T03:55:10.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T03:55:10.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T03:55:10.871 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T03:55:10.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T03:55:10.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:55:10.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T03:55:10.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T03:55:10.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T03:55:10.906 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:55:10.904+0000 7f3858143640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:10.908 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:55:10.906+0000 7f3858143640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:10.909 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:55:10.907+0000 7f3858143640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:55:11.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T03:55:11.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:55:11.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:55:11.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:55:11.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:55:11.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:11.332 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:55:11.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:55:11.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:11.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:11.748 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:55:11.747+0000 7f3858143640 -1 Falling back to public interface 2024-09-16T03:55:11.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:12.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:12.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:12.765 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:55:12.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:55:12.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:12.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:13.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:14.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:14.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:14.224 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:55:14.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:55:14.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:14.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:14.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:14.701 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:55:14.699+0000 7f3858143640 -1 osd.2 0 log_to_monitors true 2024-09-16T03:55:15.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:15.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:15.650 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:55:15.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:55:15.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:15.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:16.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:17.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:17.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:17.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T03:55:17.115 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T03:55:17.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:17.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:17.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:18.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:18.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:18.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T03:55:18.561 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T03:55:18.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:18.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:19.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:20.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:20.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:20.040 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T03:55:20.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T03:55:20.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:20.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:20.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:21.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:21.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:21.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T03:55:21.582 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T03:55:21.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:21.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:22.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:23.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:23.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:23.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T03:55:23.105 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T03:55:23.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:23.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:23.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:24.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:24.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:24.571 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T03:55:24.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T03:55:24.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:24.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:25.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:26.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:26.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:26.017 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T03:55:26.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T03:55:26.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:26.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:26.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:27.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:27.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:27.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T03:55:27.592 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T03:55:27.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:27.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:28.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:29.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:29.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:29.326 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T03:55:29.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T03:55:29.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:29.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:30.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:31.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:31.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:31.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T03:55:31.410 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T03:55:31.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:31.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:32.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:33.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:33.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:33.173 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T03:55:33.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T03:55:33.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:33.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:34.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:35.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:35.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:35.036 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T03:55:35.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T03:55:35.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:35.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:36.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:37.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:37.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:37.352 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T03:55:37.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T03:55:37.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:37.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:37.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:55:38.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:55:38.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:55:38.916 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T03:55:38.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T03:55:38.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:55:38.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:55:39.375 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/454657740,v1:127.0.0.1:6819/454657740] [v2:127.0.0.1:6820/454657740,v1:127.0.0.1:6821/454657740] exists,up 8e9f8cf3-0b08-482a-b7a7-7f57e65f91e0 2024-09-16T03:55:39.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:55:39.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:55:39.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:55:39.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:444: TEST_backfill_multi_partial: ceph osd set-backfillfull-ratio .85 2024-09-16T03:55:40.140 INFO:tasks.workunit.client.0.smithi026.stderr:osd set-backfillfull-ratio 0.85 2024-09-16T03:55:40.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:446: TEST_backfill_multi_partial: ceph osd set-require-min-compat-client luminous 2024-09-16T03:55:41.011 INFO:tasks.workunit.client.0.smithi026.stderr:set require_min_compat_client to luminous 2024-09-16T03:55:41.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:447: TEST_backfill_multi_partial: create_pool fillpool 1 1 2024-09-16T03:55:41.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create fillpool 1 1 2024-09-16T03:55:41.560 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'fillpool' already exists 2024-09-16T03:55:41.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:55:42.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:448: TEST_backfill_multi_partial: ceph osd pool set fillpool size 1 --yes-i-really-mean-it 2024-09-16T03:55:43.849 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 1 2024-09-16T03:55:43.863 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:449: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:55:43.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:449: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:55:43.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:451: TEST_backfill_multi_partial: create_pool test1 1 1 2024-09-16T03:55:43.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test1 1 1 2024-09-16T03:55:44.476 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' already exists 2024-09-16T03:55:44.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:55:45.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:452: TEST_backfill_multi_partial: ceph osd pool set test1 size 2 2024-09-16T03:55:46.804 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 2 size to 2 2024-09-16T03:55:46.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:449: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:55:46.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:451: TEST_backfill_multi_partial: create_pool test2 1 1 2024-09-16T03:55:46.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test2 1 1 2024-09-16T03:55:47.326 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' already exists 2024-09-16T03:55:47.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T03:55:48.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:452: TEST_backfill_multi_partial: ceph osd pool set test2 size 2 2024-09-16T03:55:49.244 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 3 size to 2 2024-09-16T03:55:49.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:455: TEST_backfill_multi_partial: wait_for_clean 2024-09-16T03:55:49.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T03:55:49.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T03:55:49.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T03:55:49.256 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T03:55:49.256 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T03:55:49.256 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T03:55:49.256 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T03:55:49.257 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T03:55:49.257 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T03:55:49.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T03:55:49.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T03:55:49.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T03:55:49.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T03:55:49.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T03:55:49.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T03:55:49.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T03:55:49.875 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:55:49.875 INFO:tasks.workunit.client.0.smithi026.stderr:2' 2024-09-16T03:55:49.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T03:55:49.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:55:49.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T03:55:50.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836501 2024-09-16T03:55:50.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836501 2024-09-16T03:55:50.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836501' 2024-09-16T03:55:50.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:55:50.036 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T03:55:50.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672976 2024-09-16T03:55:50.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672976 2024-09-16T03:55:50.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836501 1-42949672976' 2024-09-16T03:55:50.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T03:55:50.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T03:55:50.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509448 2024-09-16T03:55:50.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509448 2024-09-16T03:55:50.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836501 1-42949672976 2-64424509448' 2024-09-16T03:55:50.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:55:50.283 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836501 2024-09-16T03:55:50.283 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:55:50.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T03:55:50.284 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836501 2024-09-16T03:55:50.284 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:55:50.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836501 2024-09-16T03:55:50.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836501' 2024-09-16T03:55:50.285 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836501 2024-09-16T03:55:50.285 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:55:50.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836498 -lt 21474836501 2024-09-16T03:55:50.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T03:55:51.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T03:55:51.722 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T03:55:52.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836501 -lt 21474836501 2024-09-16T03:55:52.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:55:52.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672976 2024-09-16T03:55:52.173 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:55:52.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T03:55:52.174 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672976 2024-09-16T03:55:52.174 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:55:52.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672976 2024-09-16T03:55:52.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672976' 2024-09-16T03:55:52.175 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672976 2024-09-16T03:55:52.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T03:55:52.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672976 -lt 42949672976 2024-09-16T03:55:52.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T03:55:52.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509448 2024-09-16T03:55:52.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T03:55:52.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T03:55:52.617 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509448 2024-09-16T03:55:52.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T03:55:52.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509448 2024-09-16T03:55:52.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509448' 2024-09-16T03:55:52.619 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509448 2024-09-16T03:55:52.619 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T03:55:53.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509448 -lt 64424509448 2024-09-16T03:55:53.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T03:55:53.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:55:53.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:55:53.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 3 == 0 2024-09-16T03:55:53.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T03:55:53.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T03:55:53.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T03:55:53.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T03:55:53.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T03:55:53.588 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T03:55:53.588 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T03:55:54.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=3 2024-09-16T03:55:54.004 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T03:55:54.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T03:55:54.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T03:55:54.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 3 = 3 2024-09-16T03:55:54.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T03:55:54.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T03:55:54.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:462: TEST_backfill_multi_partial: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=2611 count=1 2024-09-16T03:55:54.558 INFO:tasks.workunit.client.0.smithi026.stderr:1+0 records in 2024-09-16T03:55:54.558 INFO:tasks.workunit.client.0.smithi026.stderr:1+0 records out 2024-09-16T03:55:54.558 INFO:tasks.workunit.client.0.smithi026.stderr:2611 bytes (2.6 kB, 2.5 KiB) copied, 8.1401e-05 s, 32.1 MB/s 2024-09-16T03:55:54.559 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: seq 1 600 2024-09-16T03:55:54.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:54.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-1 td/osd-backfill-space/datafile 2024-09-16T03:55:54.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:54.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-2 td/osd-backfill-space/datafile 2024-09-16T03:55:54.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:54.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-3 td/osd-backfill-space/datafile 2024-09-16T03:55:54.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:54.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-4 td/osd-backfill-space/datafile 2024-09-16T03:55:55.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:55.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-5 td/osd-backfill-space/datafile 2024-09-16T03:55:55.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:55.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-6 td/osd-backfill-space/datafile 2024-09-16T03:55:55.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:55.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-7 td/osd-backfill-space/datafile 2024-09-16T03:55:55.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:55.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-8 td/osd-backfill-space/datafile 2024-09-16T03:55:55.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:55.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-9 td/osd-backfill-space/datafile 2024-09-16T03:55:55.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:55.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-10 td/osd-backfill-space/datafile 2024-09-16T03:55:55.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:55.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-11 td/osd-backfill-space/datafile 2024-09-16T03:55:55.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:55.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-12 td/osd-backfill-space/datafile 2024-09-16T03:55:55.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:55.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-13 td/osd-backfill-space/datafile 2024-09-16T03:55:55.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:55.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-14 td/osd-backfill-space/datafile 2024-09-16T03:55:55.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:55.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-15 td/osd-backfill-space/datafile 2024-09-16T03:55:56.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:56.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-16 td/osd-backfill-space/datafile 2024-09-16T03:55:56.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:56.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-17 td/osd-backfill-space/datafile 2024-09-16T03:55:56.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:56.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-18 td/osd-backfill-space/datafile 2024-09-16T03:55:56.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:56.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-19 td/osd-backfill-space/datafile 2024-09-16T03:55:56.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:56.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-20 td/osd-backfill-space/datafile 2024-09-16T03:55:56.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:56.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-21 td/osd-backfill-space/datafile 2024-09-16T03:55:56.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:56.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-22 td/osd-backfill-space/datafile 2024-09-16T03:55:56.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:56.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-23 td/osd-backfill-space/datafile 2024-09-16T03:55:56.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:56.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-24 td/osd-backfill-space/datafile 2024-09-16T03:55:56.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:56.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-25 td/osd-backfill-space/datafile 2024-09-16T03:55:56.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:56.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-26 td/osd-backfill-space/datafile 2024-09-16T03:55:57.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:57.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-27 td/osd-backfill-space/datafile 2024-09-16T03:55:57.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:57.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-28 td/osd-backfill-space/datafile 2024-09-16T03:55:57.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:57.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-29 td/osd-backfill-space/datafile 2024-09-16T03:55:57.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:57.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-30 td/osd-backfill-space/datafile 2024-09-16T03:55:57.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:57.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-31 td/osd-backfill-space/datafile 2024-09-16T03:55:57.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:57.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-32 td/osd-backfill-space/datafile 2024-09-16T03:55:57.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:57.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-33 td/osd-backfill-space/datafile 2024-09-16T03:55:57.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:57.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-34 td/osd-backfill-space/datafile 2024-09-16T03:55:57.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:57.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-35 td/osd-backfill-space/datafile 2024-09-16T03:55:57.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:57.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-36 td/osd-backfill-space/datafile 2024-09-16T03:55:57.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:57.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-37 td/osd-backfill-space/datafile 2024-09-16T03:55:57.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:57.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-38 td/osd-backfill-space/datafile 2024-09-16T03:55:58.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:58.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-39 td/osd-backfill-space/datafile 2024-09-16T03:55:58.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:58.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-40 td/osd-backfill-space/datafile 2024-09-16T03:55:58.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:58.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-41 td/osd-backfill-space/datafile 2024-09-16T03:55:58.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:58.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-42 td/osd-backfill-space/datafile 2024-09-16T03:55:58.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:58.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-43 td/osd-backfill-space/datafile 2024-09-16T03:55:58.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:58.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-44 td/osd-backfill-space/datafile 2024-09-16T03:55:58.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:58.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-45 td/osd-backfill-space/datafile 2024-09-16T03:55:58.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:58.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-46 td/osd-backfill-space/datafile 2024-09-16T03:55:58.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:58.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-47 td/osd-backfill-space/datafile 2024-09-16T03:55:58.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:58.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-48 td/osd-backfill-space/datafile 2024-09-16T03:55:58.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:58.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-49 td/osd-backfill-space/datafile 2024-09-16T03:55:59.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:59.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-50 td/osd-backfill-space/datafile 2024-09-16T03:55:59.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:59.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-51 td/osd-backfill-space/datafile 2024-09-16T03:55:59.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:59.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-52 td/osd-backfill-space/datafile 2024-09-16T03:55:59.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:59.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-53 td/osd-backfill-space/datafile 2024-09-16T03:55:59.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:59.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-54 td/osd-backfill-space/datafile 2024-09-16T03:55:59.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:59.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-55 td/osd-backfill-space/datafile 2024-09-16T03:55:59.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:59.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-56 td/osd-backfill-space/datafile 2024-09-16T03:55:59.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:59.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-57 td/osd-backfill-space/datafile 2024-09-16T03:55:59.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:59.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-58 td/osd-backfill-space/datafile 2024-09-16T03:55:59.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:59.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-59 td/osd-backfill-space/datafile 2024-09-16T03:55:59.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:55:59.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-60 td/osd-backfill-space/datafile 2024-09-16T03:56:00.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:00.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-61 td/osd-backfill-space/datafile 2024-09-16T03:56:00.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:00.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-62 td/osd-backfill-space/datafile 2024-09-16T03:56:00.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:00.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-63 td/osd-backfill-space/datafile 2024-09-16T03:56:00.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:00.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-64 td/osd-backfill-space/datafile 2024-09-16T03:56:00.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:00.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-65 td/osd-backfill-space/datafile 2024-09-16T03:56:00.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:00.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-66 td/osd-backfill-space/datafile 2024-09-16T03:56:00.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:00.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-67 td/osd-backfill-space/datafile 2024-09-16T03:56:00.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:00.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-68 td/osd-backfill-space/datafile 2024-09-16T03:56:00.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:00.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-69 td/osd-backfill-space/datafile 2024-09-16T03:56:00.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:00.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-70 td/osd-backfill-space/datafile 2024-09-16T03:56:00.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:00.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-71 td/osd-backfill-space/datafile 2024-09-16T03:56:01.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:01.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-72 td/osd-backfill-space/datafile 2024-09-16T03:56:01.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:01.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-73 td/osd-backfill-space/datafile 2024-09-16T03:56:01.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:01.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-74 td/osd-backfill-space/datafile 2024-09-16T03:56:01.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:01.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-75 td/osd-backfill-space/datafile 2024-09-16T03:56:01.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:01.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-76 td/osd-backfill-space/datafile 2024-09-16T03:56:01.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:01.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-77 td/osd-backfill-space/datafile 2024-09-16T03:56:01.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:01.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-78 td/osd-backfill-space/datafile 2024-09-16T03:56:01.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:01.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-79 td/osd-backfill-space/datafile 2024-09-16T03:56:01.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:01.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-80 td/osd-backfill-space/datafile 2024-09-16T03:56:01.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:01.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-81 td/osd-backfill-space/datafile 2024-09-16T03:56:01.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:01.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-82 td/osd-backfill-space/datafile 2024-09-16T03:56:02.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:02.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-83 td/osd-backfill-space/datafile 2024-09-16T03:56:02.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:02.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-84 td/osd-backfill-space/datafile 2024-09-16T03:56:02.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:02.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-85 td/osd-backfill-space/datafile 2024-09-16T03:56:02.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:02.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-86 td/osd-backfill-space/datafile 2024-09-16T03:56:02.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:02.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-87 td/osd-backfill-space/datafile 2024-09-16T03:56:02.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:02.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-88 td/osd-backfill-space/datafile 2024-09-16T03:56:02.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:02.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-89 td/osd-backfill-space/datafile 2024-09-16T03:56:02.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:02.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-90 td/osd-backfill-space/datafile 2024-09-16T03:56:02.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:02.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-91 td/osd-backfill-space/datafile 2024-09-16T03:56:02.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:02.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-92 td/osd-backfill-space/datafile 2024-09-16T03:56:02.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:02.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-93 td/osd-backfill-space/datafile 2024-09-16T03:56:03.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:03.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-94 td/osd-backfill-space/datafile 2024-09-16T03:56:03.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:03.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-95 td/osd-backfill-space/datafile 2024-09-16T03:56:03.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:03.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-96 td/osd-backfill-space/datafile 2024-09-16T03:56:03.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:03.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-97 td/osd-backfill-space/datafile 2024-09-16T03:56:03.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:03.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-98 td/osd-backfill-space/datafile 2024-09-16T03:56:03.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:03.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-99 td/osd-backfill-space/datafile 2024-09-16T03:56:03.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:03.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-100 td/osd-backfill-space/datafile 2024-09-16T03:56:03.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:03.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-101 td/osd-backfill-space/datafile 2024-09-16T03:56:03.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:03.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-102 td/osd-backfill-space/datafile 2024-09-16T03:56:03.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:03.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-103 td/osd-backfill-space/datafile 2024-09-16T03:56:03.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:03.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-104 td/osd-backfill-space/datafile 2024-09-16T03:56:03.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:03.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-105 td/osd-backfill-space/datafile 2024-09-16T03:56:04.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:04.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-106 td/osd-backfill-space/datafile 2024-09-16T03:56:04.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:04.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-107 td/osd-backfill-space/datafile 2024-09-16T03:56:04.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:04.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-108 td/osd-backfill-space/datafile 2024-09-16T03:56:04.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:04.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-109 td/osd-backfill-space/datafile 2024-09-16T03:56:04.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:04.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-110 td/osd-backfill-space/datafile 2024-09-16T03:56:04.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:04.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-111 td/osd-backfill-space/datafile 2024-09-16T03:56:04.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:04.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-112 td/osd-backfill-space/datafile 2024-09-16T03:56:04.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:04.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-113 td/osd-backfill-space/datafile 2024-09-16T03:56:04.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:04.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-114 td/osd-backfill-space/datafile 2024-09-16T03:56:04.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:04.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-115 td/osd-backfill-space/datafile 2024-09-16T03:56:04.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:04.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-116 td/osd-backfill-space/datafile 2024-09-16T03:56:05.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:05.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-117 td/osd-backfill-space/datafile 2024-09-16T03:56:05.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:05.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-118 td/osd-backfill-space/datafile 2024-09-16T03:56:05.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:05.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-119 td/osd-backfill-space/datafile 2024-09-16T03:56:05.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:05.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-120 td/osd-backfill-space/datafile 2024-09-16T03:56:05.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:05.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-121 td/osd-backfill-space/datafile 2024-09-16T03:56:05.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:05.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-122 td/osd-backfill-space/datafile 2024-09-16T03:56:05.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:05.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-123 td/osd-backfill-space/datafile 2024-09-16T03:56:05.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:05.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-124 td/osd-backfill-space/datafile 2024-09-16T03:56:05.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:05.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-125 td/osd-backfill-space/datafile 2024-09-16T03:56:05.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:05.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-126 td/osd-backfill-space/datafile 2024-09-16T03:56:05.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:05.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-127 td/osd-backfill-space/datafile 2024-09-16T03:56:05.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:05.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-128 td/osd-backfill-space/datafile 2024-09-16T03:56:06.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:06.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-129 td/osd-backfill-space/datafile 2024-09-16T03:56:06.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:06.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-130 td/osd-backfill-space/datafile 2024-09-16T03:56:06.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:06.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-131 td/osd-backfill-space/datafile 2024-09-16T03:56:06.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:06.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-132 td/osd-backfill-space/datafile 2024-09-16T03:56:06.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:06.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-133 td/osd-backfill-space/datafile 2024-09-16T03:56:06.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:06.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-134 td/osd-backfill-space/datafile 2024-09-16T03:56:06.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:06.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-135 td/osd-backfill-space/datafile 2024-09-16T03:56:06.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:06.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-136 td/osd-backfill-space/datafile 2024-09-16T03:56:06.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:06.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-137 td/osd-backfill-space/datafile 2024-09-16T03:56:06.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:06.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-138 td/osd-backfill-space/datafile 2024-09-16T03:56:06.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:06.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-139 td/osd-backfill-space/datafile 2024-09-16T03:56:07.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:07.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-140 td/osd-backfill-space/datafile 2024-09-16T03:56:07.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:07.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-141 td/osd-backfill-space/datafile 2024-09-16T03:56:07.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:07.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-142 td/osd-backfill-space/datafile 2024-09-16T03:56:07.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:07.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-143 td/osd-backfill-space/datafile 2024-09-16T03:56:07.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:07.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-144 td/osd-backfill-space/datafile 2024-09-16T03:56:07.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:07.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-145 td/osd-backfill-space/datafile 2024-09-16T03:56:07.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:07.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-146 td/osd-backfill-space/datafile 2024-09-16T03:56:07.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:07.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-147 td/osd-backfill-space/datafile 2024-09-16T03:56:07.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:07.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-148 td/osd-backfill-space/datafile 2024-09-16T03:56:07.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:07.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-149 td/osd-backfill-space/datafile 2024-09-16T03:56:07.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:07.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-150 td/osd-backfill-space/datafile 2024-09-16T03:56:08.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:08.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-151 td/osd-backfill-space/datafile 2024-09-16T03:56:08.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:08.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-152 td/osd-backfill-space/datafile 2024-09-16T03:56:08.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:08.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-153 td/osd-backfill-space/datafile 2024-09-16T03:56:08.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:08.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-154 td/osd-backfill-space/datafile 2024-09-16T03:56:08.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:08.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-155 td/osd-backfill-space/datafile 2024-09-16T03:56:08.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:08.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-156 td/osd-backfill-space/datafile 2024-09-16T03:56:08.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:08.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-157 td/osd-backfill-space/datafile 2024-09-16T03:56:08.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:08.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-158 td/osd-backfill-space/datafile 2024-09-16T03:56:08.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:08.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-159 td/osd-backfill-space/datafile 2024-09-16T03:56:08.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:08.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-160 td/osd-backfill-space/datafile 2024-09-16T03:56:08.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:08.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-161 td/osd-backfill-space/datafile 2024-09-16T03:56:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-162 td/osd-backfill-space/datafile 2024-09-16T03:56:09.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:09.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-163 td/osd-backfill-space/datafile 2024-09-16T03:56:09.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:09.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-164 td/osd-backfill-space/datafile 2024-09-16T03:56:09.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:09.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-165 td/osd-backfill-space/datafile 2024-09-16T03:56:09.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:09.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-166 td/osd-backfill-space/datafile 2024-09-16T03:56:09.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:09.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-167 td/osd-backfill-space/datafile 2024-09-16T03:56:09.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:09.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-168 td/osd-backfill-space/datafile 2024-09-16T03:56:09.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:09.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-169 td/osd-backfill-space/datafile 2024-09-16T03:56:09.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:09.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-170 td/osd-backfill-space/datafile 2024-09-16T03:56:09.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:09.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-171 td/osd-backfill-space/datafile 2024-09-16T03:56:09.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:09.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-172 td/osd-backfill-space/datafile 2024-09-16T03:56:09.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:09.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-173 td/osd-backfill-space/datafile 2024-09-16T03:56:10.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:10.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-174 td/osd-backfill-space/datafile 2024-09-16T03:56:10.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:10.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-175 td/osd-backfill-space/datafile 2024-09-16T03:56:10.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:10.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-176 td/osd-backfill-space/datafile 2024-09-16T03:56:10.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:10.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-177 td/osd-backfill-space/datafile 2024-09-16T03:56:10.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:10.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-178 td/osd-backfill-space/datafile 2024-09-16T03:56:10.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:10.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-179 td/osd-backfill-space/datafile 2024-09-16T03:56:10.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:10.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-180 td/osd-backfill-space/datafile 2024-09-16T03:56:10.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:10.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-181 td/osd-backfill-space/datafile 2024-09-16T03:56:10.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:10.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-182 td/osd-backfill-space/datafile 2024-09-16T03:56:10.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:10.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-183 td/osd-backfill-space/datafile 2024-09-16T03:56:10.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:10.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-184 td/osd-backfill-space/datafile 2024-09-16T03:56:11.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:11.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-185 td/osd-backfill-space/datafile 2024-09-16T03:56:11.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:11.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-186 td/osd-backfill-space/datafile 2024-09-16T03:56:11.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:11.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-187 td/osd-backfill-space/datafile 2024-09-16T03:56:11.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:11.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-188 td/osd-backfill-space/datafile 2024-09-16T03:56:11.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:11.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-189 td/osd-backfill-space/datafile 2024-09-16T03:56:11.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:11.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-190 td/osd-backfill-space/datafile 2024-09-16T03:56:11.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:11.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-191 td/osd-backfill-space/datafile 2024-09-16T03:56:11.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:11.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-192 td/osd-backfill-space/datafile 2024-09-16T03:56:11.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:11.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-193 td/osd-backfill-space/datafile 2024-09-16T03:56:11.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:11.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-194 td/osd-backfill-space/datafile 2024-09-16T03:56:11.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:11.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-195 td/osd-backfill-space/datafile 2024-09-16T03:56:11.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:11.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-196 td/osd-backfill-space/datafile 2024-09-16T03:56:12.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:12.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-197 td/osd-backfill-space/datafile 2024-09-16T03:56:12.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:12.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-198 td/osd-backfill-space/datafile 2024-09-16T03:56:12.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:12.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-199 td/osd-backfill-space/datafile 2024-09-16T03:56:12.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:12.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-200 td/osd-backfill-space/datafile 2024-09-16T03:56:12.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:12.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-201 td/osd-backfill-space/datafile 2024-09-16T03:56:12.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:12.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-202 td/osd-backfill-space/datafile 2024-09-16T03:56:12.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:12.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-203 td/osd-backfill-space/datafile 2024-09-16T03:56:12.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:12.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-204 td/osd-backfill-space/datafile 2024-09-16T03:56:12.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:12.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-205 td/osd-backfill-space/datafile 2024-09-16T03:56:12.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:12.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-206 td/osd-backfill-space/datafile 2024-09-16T03:56:12.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:12.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-207 td/osd-backfill-space/datafile 2024-09-16T03:56:12.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:12.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-208 td/osd-backfill-space/datafile 2024-09-16T03:56:13.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:13.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-209 td/osd-backfill-space/datafile 2024-09-16T03:56:13.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:13.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-210 td/osd-backfill-space/datafile 2024-09-16T03:56:13.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:13.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-211 td/osd-backfill-space/datafile 2024-09-16T03:56:13.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:13.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-212 td/osd-backfill-space/datafile 2024-09-16T03:56:13.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:13.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-213 td/osd-backfill-space/datafile 2024-09-16T03:56:13.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:13.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-214 td/osd-backfill-space/datafile 2024-09-16T03:56:13.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:13.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-215 td/osd-backfill-space/datafile 2024-09-16T03:56:13.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:13.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-216 td/osd-backfill-space/datafile 2024-09-16T03:56:13.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:13.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-217 td/osd-backfill-space/datafile 2024-09-16T03:56:13.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:13.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-218 td/osd-backfill-space/datafile 2024-09-16T03:56:13.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:13.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-219 td/osd-backfill-space/datafile 2024-09-16T03:56:14.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:14.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-220 td/osd-backfill-space/datafile 2024-09-16T03:56:14.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:14.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-221 td/osd-backfill-space/datafile 2024-09-16T03:56:14.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:14.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-222 td/osd-backfill-space/datafile 2024-09-16T03:56:14.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:14.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-223 td/osd-backfill-space/datafile 2024-09-16T03:56:14.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:14.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-224 td/osd-backfill-space/datafile 2024-09-16T03:56:14.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:14.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-225 td/osd-backfill-space/datafile 2024-09-16T03:56:14.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:14.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-226 td/osd-backfill-space/datafile 2024-09-16T03:56:14.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:14.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-227 td/osd-backfill-space/datafile 2024-09-16T03:56:14.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:14.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-228 td/osd-backfill-space/datafile 2024-09-16T03:56:14.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:14.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-229 td/osd-backfill-space/datafile 2024-09-16T03:56:14.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:14.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-230 td/osd-backfill-space/datafile 2024-09-16T03:56:14.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:14.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-231 td/osd-backfill-space/datafile 2024-09-16T03:56:15.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:15.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-232 td/osd-backfill-space/datafile 2024-09-16T03:56:15.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:15.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-233 td/osd-backfill-space/datafile 2024-09-16T03:56:15.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:15.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-234 td/osd-backfill-space/datafile 2024-09-16T03:56:15.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:15.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-235 td/osd-backfill-space/datafile 2024-09-16T03:56:15.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:15.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-236 td/osd-backfill-space/datafile 2024-09-16T03:56:15.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:15.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-237 td/osd-backfill-space/datafile 2024-09-16T03:56:15.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:15.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-238 td/osd-backfill-space/datafile 2024-09-16T03:56:15.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:15.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-239 td/osd-backfill-space/datafile 2024-09-16T03:56:15.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:15.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-240 td/osd-backfill-space/datafile 2024-09-16T03:56:15.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:15.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-241 td/osd-backfill-space/datafile 2024-09-16T03:56:15.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:15.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-242 td/osd-backfill-space/datafile 2024-09-16T03:56:16.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:16.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-243 td/osd-backfill-space/datafile 2024-09-16T03:56:16.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:16.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-244 td/osd-backfill-space/datafile 2024-09-16T03:56:16.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:16.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-245 td/osd-backfill-space/datafile 2024-09-16T03:56:16.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:16.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-246 td/osd-backfill-space/datafile 2024-09-16T03:56:16.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:16.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-247 td/osd-backfill-space/datafile 2024-09-16T03:56:16.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:16.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-248 td/osd-backfill-space/datafile 2024-09-16T03:56:16.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:16.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-249 td/osd-backfill-space/datafile 2024-09-16T03:56:16.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:16.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-250 td/osd-backfill-space/datafile 2024-09-16T03:56:16.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:16.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-251 td/osd-backfill-space/datafile 2024-09-16T03:56:16.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:16.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-252 td/osd-backfill-space/datafile 2024-09-16T03:56:16.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:16.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-253 td/osd-backfill-space/datafile 2024-09-16T03:56:16.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:16.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-254 td/osd-backfill-space/datafile 2024-09-16T03:56:17.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:17.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-255 td/osd-backfill-space/datafile 2024-09-16T03:56:17.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:17.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-256 td/osd-backfill-space/datafile 2024-09-16T03:56:17.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:17.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-257 td/osd-backfill-space/datafile 2024-09-16T03:56:17.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:17.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-258 td/osd-backfill-space/datafile 2024-09-16T03:56:17.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:17.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-259 td/osd-backfill-space/datafile 2024-09-16T03:56:17.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:17.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-260 td/osd-backfill-space/datafile 2024-09-16T03:56:17.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:17.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-261 td/osd-backfill-space/datafile 2024-09-16T03:56:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-262 td/osd-backfill-space/datafile 2024-09-16T03:56:18.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:18.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-263 td/osd-backfill-space/datafile 2024-09-16T03:56:18.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:18.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-264 td/osd-backfill-space/datafile 2024-09-16T03:56:18.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:18.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-265 td/osd-backfill-space/datafile 2024-09-16T03:56:18.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:18.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-266 td/osd-backfill-space/datafile 2024-09-16T03:56:18.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:18.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-267 td/osd-backfill-space/datafile 2024-09-16T03:56:18.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:18.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-268 td/osd-backfill-space/datafile 2024-09-16T03:56:18.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:18.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-269 td/osd-backfill-space/datafile 2024-09-16T03:56:18.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:18.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-270 td/osd-backfill-space/datafile 2024-09-16T03:56:18.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:18.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-271 td/osd-backfill-space/datafile 2024-09-16T03:56:18.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:18.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-272 td/osd-backfill-space/datafile 2024-09-16T03:56:19.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:19.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-273 td/osd-backfill-space/datafile 2024-09-16T03:56:19.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:19.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-274 td/osd-backfill-space/datafile 2024-09-16T03:56:19.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:19.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-275 td/osd-backfill-space/datafile 2024-09-16T03:56:19.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:19.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-276 td/osd-backfill-space/datafile 2024-09-16T03:56:19.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:19.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-277 td/osd-backfill-space/datafile 2024-09-16T03:56:19.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:19.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-278 td/osd-backfill-space/datafile 2024-09-16T03:56:19.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:19.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-279 td/osd-backfill-space/datafile 2024-09-16T03:56:19.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:19.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-280 td/osd-backfill-space/datafile 2024-09-16T03:56:19.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:19.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-281 td/osd-backfill-space/datafile 2024-09-16T03:56:19.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:19.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-282 td/osd-backfill-space/datafile 2024-09-16T03:56:19.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:19.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-283 td/osd-backfill-space/datafile 2024-09-16T03:56:20.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:20.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-284 td/osd-backfill-space/datafile 2024-09-16T03:56:20.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:20.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-285 td/osd-backfill-space/datafile 2024-09-16T03:56:20.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:20.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-286 td/osd-backfill-space/datafile 2024-09-16T03:56:20.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:20.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-287 td/osd-backfill-space/datafile 2024-09-16T03:56:20.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:20.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-288 td/osd-backfill-space/datafile 2024-09-16T03:56:20.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:20.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-289 td/osd-backfill-space/datafile 2024-09-16T03:56:20.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:20.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-290 td/osd-backfill-space/datafile 2024-09-16T03:56:20.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:20.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-291 td/osd-backfill-space/datafile 2024-09-16T03:56:20.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:20.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-292 td/osd-backfill-space/datafile 2024-09-16T03:56:20.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:20.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-293 td/osd-backfill-space/datafile 2024-09-16T03:56:20.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:20.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-294 td/osd-backfill-space/datafile 2024-09-16T03:56:20.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:20.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-295 td/osd-backfill-space/datafile 2024-09-16T03:56:21.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:21.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-296 td/osd-backfill-space/datafile 2024-09-16T03:56:21.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:21.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-297 td/osd-backfill-space/datafile 2024-09-16T03:56:21.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:21.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-298 td/osd-backfill-space/datafile 2024-09-16T03:56:21.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:21.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-299 td/osd-backfill-space/datafile 2024-09-16T03:56:21.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:21.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-300 td/osd-backfill-space/datafile 2024-09-16T03:56:21.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:21.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-301 td/osd-backfill-space/datafile 2024-09-16T03:56:21.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:21.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-302 td/osd-backfill-space/datafile 2024-09-16T03:56:21.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:21.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-303 td/osd-backfill-space/datafile 2024-09-16T03:56:21.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:21.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-304 td/osd-backfill-space/datafile 2024-09-16T03:56:21.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:21.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-305 td/osd-backfill-space/datafile 2024-09-16T03:56:21.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:21.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-306 td/osd-backfill-space/datafile 2024-09-16T03:56:22.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:22.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-307 td/osd-backfill-space/datafile 2024-09-16T03:56:22.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:22.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-308 td/osd-backfill-space/datafile 2024-09-16T03:56:22.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:22.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-309 td/osd-backfill-space/datafile 2024-09-16T03:56:22.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:22.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-310 td/osd-backfill-space/datafile 2024-09-16T03:56:22.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:22.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-311 td/osd-backfill-space/datafile 2024-09-16T03:56:22.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:22.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-312 td/osd-backfill-space/datafile 2024-09-16T03:56:22.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:22.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-313 td/osd-backfill-space/datafile 2024-09-16T03:56:22.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:22.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-314 td/osd-backfill-space/datafile 2024-09-16T03:56:22.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:22.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-315 td/osd-backfill-space/datafile 2024-09-16T03:56:22.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:22.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-316 td/osd-backfill-space/datafile 2024-09-16T03:56:22.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:22.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-317 td/osd-backfill-space/datafile 2024-09-16T03:56:22.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:22.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-318 td/osd-backfill-space/datafile 2024-09-16T03:56:23.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:23.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-319 td/osd-backfill-space/datafile 2024-09-16T03:56:23.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:23.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-320 td/osd-backfill-space/datafile 2024-09-16T03:56:23.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:23.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-321 td/osd-backfill-space/datafile 2024-09-16T03:56:23.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:23.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-322 td/osd-backfill-space/datafile 2024-09-16T03:56:23.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:23.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-323 td/osd-backfill-space/datafile 2024-09-16T03:56:23.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:23.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-324 td/osd-backfill-space/datafile 2024-09-16T03:56:23.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:23.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-325 td/osd-backfill-space/datafile 2024-09-16T03:56:23.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:23.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-326 td/osd-backfill-space/datafile 2024-09-16T03:56:23.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:23.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-327 td/osd-backfill-space/datafile 2024-09-16T03:56:23.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:23.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-328 td/osd-backfill-space/datafile 2024-09-16T03:56:23.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:23.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-329 td/osd-backfill-space/datafile 2024-09-16T03:56:24.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:24.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-330 td/osd-backfill-space/datafile 2024-09-16T03:56:24.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:24.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-331 td/osd-backfill-space/datafile 2024-09-16T03:56:24.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:24.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-332 td/osd-backfill-space/datafile 2024-09-16T03:56:24.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:24.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-333 td/osd-backfill-space/datafile 2024-09-16T03:56:24.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:24.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-334 td/osd-backfill-space/datafile 2024-09-16T03:56:24.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:24.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-335 td/osd-backfill-space/datafile 2024-09-16T03:56:24.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:24.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-336 td/osd-backfill-space/datafile 2024-09-16T03:56:24.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:24.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-337 td/osd-backfill-space/datafile 2024-09-16T03:56:24.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:24.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-338 td/osd-backfill-space/datafile 2024-09-16T03:56:24.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:24.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-339 td/osd-backfill-space/datafile 2024-09-16T03:56:24.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:24.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-340 td/osd-backfill-space/datafile 2024-09-16T03:56:25.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:25.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-341 td/osd-backfill-space/datafile 2024-09-16T03:56:25.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:25.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-342 td/osd-backfill-space/datafile 2024-09-16T03:56:25.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:25.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-343 td/osd-backfill-space/datafile 2024-09-16T03:56:25.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:25.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-344 td/osd-backfill-space/datafile 2024-09-16T03:56:25.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:25.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-345 td/osd-backfill-space/datafile 2024-09-16T03:56:25.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:25.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-346 td/osd-backfill-space/datafile 2024-09-16T03:56:25.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:25.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-347 td/osd-backfill-space/datafile 2024-09-16T03:56:25.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:25.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-348 td/osd-backfill-space/datafile 2024-09-16T03:56:25.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:25.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-349 td/osd-backfill-space/datafile 2024-09-16T03:56:25.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:25.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-350 td/osd-backfill-space/datafile 2024-09-16T03:56:25.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:25.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-351 td/osd-backfill-space/datafile 2024-09-16T03:56:26.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:26.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-352 td/osd-backfill-space/datafile 2024-09-16T03:56:26.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:26.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-353 td/osd-backfill-space/datafile 2024-09-16T03:56:26.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:26.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-354 td/osd-backfill-space/datafile 2024-09-16T03:56:26.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:26.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-355 td/osd-backfill-space/datafile 2024-09-16T03:56:26.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:26.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-356 td/osd-backfill-space/datafile 2024-09-16T03:56:26.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:26.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-357 td/osd-backfill-space/datafile 2024-09-16T03:56:26.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:26.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-358 td/osd-backfill-space/datafile 2024-09-16T03:56:26.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:26.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-359 td/osd-backfill-space/datafile 2024-09-16T03:56:26.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:26.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-360 td/osd-backfill-space/datafile 2024-09-16T03:56:26.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:26.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-361 td/osd-backfill-space/datafile 2024-09-16T03:56:26.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:26.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-362 td/osd-backfill-space/datafile 2024-09-16T03:56:26.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:26.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-363 td/osd-backfill-space/datafile 2024-09-16T03:56:27.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:27.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-364 td/osd-backfill-space/datafile 2024-09-16T03:56:27.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:27.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-365 td/osd-backfill-space/datafile 2024-09-16T03:56:27.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:27.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-366 td/osd-backfill-space/datafile 2024-09-16T03:56:27.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:27.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-367 td/osd-backfill-space/datafile 2024-09-16T03:56:27.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:27.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-368 td/osd-backfill-space/datafile 2024-09-16T03:56:27.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:27.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-369 td/osd-backfill-space/datafile 2024-09-16T03:56:27.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:27.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-370 td/osd-backfill-space/datafile 2024-09-16T03:56:27.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:27.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-371 td/osd-backfill-space/datafile 2024-09-16T03:56:27.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:27.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-372 td/osd-backfill-space/datafile 2024-09-16T03:56:27.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:27.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-373 td/osd-backfill-space/datafile 2024-09-16T03:56:27.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:27.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-374 td/osd-backfill-space/datafile 2024-09-16T03:56:28.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:28.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-375 td/osd-backfill-space/datafile 2024-09-16T03:56:28.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:28.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-376 td/osd-backfill-space/datafile 2024-09-16T03:56:28.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:28.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-377 td/osd-backfill-space/datafile 2024-09-16T03:56:28.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:28.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-378 td/osd-backfill-space/datafile 2024-09-16T03:56:28.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:28.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-379 td/osd-backfill-space/datafile 2024-09-16T03:56:28.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:28.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-380 td/osd-backfill-space/datafile 2024-09-16T03:56:28.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:28.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-381 td/osd-backfill-space/datafile 2024-09-16T03:56:28.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:28.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-382 td/osd-backfill-space/datafile 2024-09-16T03:56:28.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:28.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-383 td/osd-backfill-space/datafile 2024-09-16T03:56:28.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:28.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-384 td/osd-backfill-space/datafile 2024-09-16T03:56:28.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:28.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-385 td/osd-backfill-space/datafile 2024-09-16T03:56:29.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:29.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-386 td/osd-backfill-space/datafile 2024-09-16T03:56:29.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:29.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-387 td/osd-backfill-space/datafile 2024-09-16T03:56:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-388 td/osd-backfill-space/datafile 2024-09-16T03:56:29.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:29.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-389 td/osd-backfill-space/datafile 2024-09-16T03:56:29.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:29.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-390 td/osd-backfill-space/datafile 2024-09-16T03:56:29.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:29.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-391 td/osd-backfill-space/datafile 2024-09-16T03:56:29.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:29.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-392 td/osd-backfill-space/datafile 2024-09-16T03:56:29.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:29.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-393 td/osd-backfill-space/datafile 2024-09-16T03:56:29.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:29.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-394 td/osd-backfill-space/datafile 2024-09-16T03:56:29.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:29.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-395 td/osd-backfill-space/datafile 2024-09-16T03:56:29.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:29.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-396 td/osd-backfill-space/datafile 2024-09-16T03:56:30.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:30.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-397 td/osd-backfill-space/datafile 2024-09-16T03:56:30.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:30.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-398 td/osd-backfill-space/datafile 2024-09-16T03:56:30.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:30.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-399 td/osd-backfill-space/datafile 2024-09-16T03:56:30.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:30.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-400 td/osd-backfill-space/datafile 2024-09-16T03:56:30.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:30.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-401 td/osd-backfill-space/datafile 2024-09-16T03:56:30.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:30.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-402 td/osd-backfill-space/datafile 2024-09-16T03:56:30.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:30.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-403 td/osd-backfill-space/datafile 2024-09-16T03:56:30.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:30.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-404 td/osd-backfill-space/datafile 2024-09-16T03:56:30.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:30.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-405 td/osd-backfill-space/datafile 2024-09-16T03:56:30.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:30.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-406 td/osd-backfill-space/datafile 2024-09-16T03:56:30.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:30.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-407 td/osd-backfill-space/datafile 2024-09-16T03:56:31.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:31.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-408 td/osd-backfill-space/datafile 2024-09-16T03:56:31.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:31.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-409 td/osd-backfill-space/datafile 2024-09-16T03:56:31.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:31.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-410 td/osd-backfill-space/datafile 2024-09-16T03:56:31.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:31.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-411 td/osd-backfill-space/datafile 2024-09-16T03:56:31.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:31.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-412 td/osd-backfill-space/datafile 2024-09-16T03:56:31.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:31.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-413 td/osd-backfill-space/datafile 2024-09-16T03:56:31.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:31.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-414 td/osd-backfill-space/datafile 2024-09-16T03:56:31.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:31.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-415 td/osd-backfill-space/datafile 2024-09-16T03:56:31.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:31.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-416 td/osd-backfill-space/datafile 2024-09-16T03:56:31.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:31.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-417 td/osd-backfill-space/datafile 2024-09-16T03:56:31.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:31.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-418 td/osd-backfill-space/datafile 2024-09-16T03:56:32.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:32.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-419 td/osd-backfill-space/datafile 2024-09-16T03:56:32.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:32.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-420 td/osd-backfill-space/datafile 2024-09-16T03:56:32.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:32.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-421 td/osd-backfill-space/datafile 2024-09-16T03:56:32.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:32.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-422 td/osd-backfill-space/datafile 2024-09-16T03:56:32.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:32.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-423 td/osd-backfill-space/datafile 2024-09-16T03:56:32.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:32.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-424 td/osd-backfill-space/datafile 2024-09-16T03:56:32.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:32.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-425 td/osd-backfill-space/datafile 2024-09-16T03:56:32.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:32.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-426 td/osd-backfill-space/datafile 2024-09-16T03:56:32.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:32.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-427 td/osd-backfill-space/datafile 2024-09-16T03:56:32.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:32.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-428 td/osd-backfill-space/datafile 2024-09-16T03:56:32.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:32.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-429 td/osd-backfill-space/datafile 2024-09-16T03:56:32.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:32.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-430 td/osd-backfill-space/datafile 2024-09-16T03:56:33.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:33.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-431 td/osd-backfill-space/datafile 2024-09-16T03:56:33.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:33.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-432 td/osd-backfill-space/datafile 2024-09-16T03:56:33.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:33.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-433 td/osd-backfill-space/datafile 2024-09-16T03:56:33.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:33.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-434 td/osd-backfill-space/datafile 2024-09-16T03:56:33.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:33.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-435 td/osd-backfill-space/datafile 2024-09-16T03:56:33.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:33.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-436 td/osd-backfill-space/datafile 2024-09-16T03:56:33.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:33.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-437 td/osd-backfill-space/datafile 2024-09-16T03:56:33.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:33.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-438 td/osd-backfill-space/datafile 2024-09-16T03:56:33.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:33.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-439 td/osd-backfill-space/datafile 2024-09-16T03:56:33.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:33.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-440 td/osd-backfill-space/datafile 2024-09-16T03:56:33.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:33.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-441 td/osd-backfill-space/datafile 2024-09-16T03:56:34.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:34.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-442 td/osd-backfill-space/datafile 2024-09-16T03:56:34.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:34.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-443 td/osd-backfill-space/datafile 2024-09-16T03:56:34.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:34.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-444 td/osd-backfill-space/datafile 2024-09-16T03:56:34.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:34.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-445 td/osd-backfill-space/datafile 2024-09-16T03:56:34.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:34.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-446 td/osd-backfill-space/datafile 2024-09-16T03:56:34.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:34.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-447 td/osd-backfill-space/datafile 2024-09-16T03:56:34.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:34.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-448 td/osd-backfill-space/datafile 2024-09-16T03:56:34.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:34.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-449 td/osd-backfill-space/datafile 2024-09-16T03:56:34.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:34.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-450 td/osd-backfill-space/datafile 2024-09-16T03:56:34.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:34.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-451 td/osd-backfill-space/datafile 2024-09-16T03:56:34.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:34.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-452 td/osd-backfill-space/datafile 2024-09-16T03:56:35.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:35.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-453 td/osd-backfill-space/datafile 2024-09-16T03:56:35.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:35.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-454 td/osd-backfill-space/datafile 2024-09-16T03:56:35.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:35.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-455 td/osd-backfill-space/datafile 2024-09-16T03:56:35.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:35.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-456 td/osd-backfill-space/datafile 2024-09-16T03:56:35.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:35.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-457 td/osd-backfill-space/datafile 2024-09-16T03:56:35.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:35.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-458 td/osd-backfill-space/datafile 2024-09-16T03:56:35.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:35.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-459 td/osd-backfill-space/datafile 2024-09-16T03:56:35.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:35.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-460 td/osd-backfill-space/datafile 2024-09-16T03:56:35.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:35.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-461 td/osd-backfill-space/datafile 2024-09-16T03:56:35.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:35.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-462 td/osd-backfill-space/datafile 2024-09-16T03:56:35.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:35.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-463 td/osd-backfill-space/datafile 2024-09-16T03:56:36.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:36.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-464 td/osd-backfill-space/datafile 2024-09-16T03:56:36.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:36.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-465 td/osd-backfill-space/datafile 2024-09-16T03:56:36.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:36.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-466 td/osd-backfill-space/datafile 2024-09-16T03:56:36.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:36.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-467 td/osd-backfill-space/datafile 2024-09-16T03:56:36.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:36.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-468 td/osd-backfill-space/datafile 2024-09-16T03:56:36.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:36.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-469 td/osd-backfill-space/datafile 2024-09-16T03:56:36.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:36.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-470 td/osd-backfill-space/datafile 2024-09-16T03:56:36.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:36.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-471 td/osd-backfill-space/datafile 2024-09-16T03:56:36.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:36.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-472 td/osd-backfill-space/datafile 2024-09-16T03:56:36.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:36.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-473 td/osd-backfill-space/datafile 2024-09-16T03:56:36.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:36.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-474 td/osd-backfill-space/datafile 2024-09-16T03:56:37.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:37.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-475 td/osd-backfill-space/datafile 2024-09-16T03:56:37.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:37.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-476 td/osd-backfill-space/datafile 2024-09-16T03:56:37.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:37.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-477 td/osd-backfill-space/datafile 2024-09-16T03:56:37.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:37.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-478 td/osd-backfill-space/datafile 2024-09-16T03:56:37.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:37.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-479 td/osd-backfill-space/datafile 2024-09-16T03:56:37.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:37.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-480 td/osd-backfill-space/datafile 2024-09-16T03:56:37.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:37.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-481 td/osd-backfill-space/datafile 2024-09-16T03:56:37.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:37.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-482 td/osd-backfill-space/datafile 2024-09-16T03:56:37.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:37.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-483 td/osd-backfill-space/datafile 2024-09-16T03:56:37.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:37.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-484 td/osd-backfill-space/datafile 2024-09-16T03:56:37.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:37.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-485 td/osd-backfill-space/datafile 2024-09-16T03:56:37.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:37.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-486 td/osd-backfill-space/datafile 2024-09-16T03:56:38.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:38.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-487 td/osd-backfill-space/datafile 2024-09-16T03:56:38.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:38.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-488 td/osd-backfill-space/datafile 2024-09-16T03:56:38.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:38.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-489 td/osd-backfill-space/datafile 2024-09-16T03:56:38.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:38.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-490 td/osd-backfill-space/datafile 2024-09-16T03:56:38.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:38.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-491 td/osd-backfill-space/datafile 2024-09-16T03:56:38.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:38.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-492 td/osd-backfill-space/datafile 2024-09-16T03:56:38.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:38.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-493 td/osd-backfill-space/datafile 2024-09-16T03:56:38.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:38.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-494 td/osd-backfill-space/datafile 2024-09-16T03:56:38.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:38.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-495 td/osd-backfill-space/datafile 2024-09-16T03:56:38.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:38.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-496 td/osd-backfill-space/datafile 2024-09-16T03:56:38.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:38.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-497 td/osd-backfill-space/datafile 2024-09-16T03:56:39.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:39.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-498 td/osd-backfill-space/datafile 2024-09-16T03:56:39.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:39.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-499 td/osd-backfill-space/datafile 2024-09-16T03:56:39.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:39.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-500 td/osd-backfill-space/datafile 2024-09-16T03:56:39.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:39.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-501 td/osd-backfill-space/datafile 2024-09-16T03:56:39.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:39.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-502 td/osd-backfill-space/datafile 2024-09-16T03:56:39.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:39.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-503 td/osd-backfill-space/datafile 2024-09-16T03:56:39.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:39.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-504 td/osd-backfill-space/datafile 2024-09-16T03:56:39.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:39.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-505 td/osd-backfill-space/datafile 2024-09-16T03:56:39.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:39.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-506 td/osd-backfill-space/datafile 2024-09-16T03:56:39.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:39.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-507 td/osd-backfill-space/datafile 2024-09-16T03:56:39.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:39.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-508 td/osd-backfill-space/datafile 2024-09-16T03:56:40.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:40.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-509 td/osd-backfill-space/datafile 2024-09-16T03:56:40.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:40.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-510 td/osd-backfill-space/datafile 2024-09-16T03:56:40.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:40.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-511 td/osd-backfill-space/datafile 2024-09-16T03:56:40.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:40.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-512 td/osd-backfill-space/datafile 2024-09-16T03:56:40.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:40.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-513 td/osd-backfill-space/datafile 2024-09-16T03:56:40.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:40.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-514 td/osd-backfill-space/datafile 2024-09-16T03:56:40.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:40.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-515 td/osd-backfill-space/datafile 2024-09-16T03:56:40.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:40.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-516 td/osd-backfill-space/datafile 2024-09-16T03:56:40.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:40.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-517 td/osd-backfill-space/datafile 2024-09-16T03:56:40.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:40.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-518 td/osd-backfill-space/datafile 2024-09-16T03:56:40.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:40.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-519 td/osd-backfill-space/datafile 2024-09-16T03:56:40.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:40.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-520 td/osd-backfill-space/datafile 2024-09-16T03:56:41.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:41.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-521 td/osd-backfill-space/datafile 2024-09-16T03:56:41.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:41.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-522 td/osd-backfill-space/datafile 2024-09-16T03:56:41.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:41.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-523 td/osd-backfill-space/datafile 2024-09-16T03:56:41.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:41.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-524 td/osd-backfill-space/datafile 2024-09-16T03:56:41.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:41.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-525 td/osd-backfill-space/datafile 2024-09-16T03:56:41.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:41.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-526 td/osd-backfill-space/datafile 2024-09-16T03:56:41.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:41.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-527 td/osd-backfill-space/datafile 2024-09-16T03:56:41.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:41.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-528 td/osd-backfill-space/datafile 2024-09-16T03:56:41.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:41.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-529 td/osd-backfill-space/datafile 2024-09-16T03:56:41.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:41.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-530 td/osd-backfill-space/datafile 2024-09-16T03:56:41.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:41.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-531 td/osd-backfill-space/datafile 2024-09-16T03:56:41.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:41.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-532 td/osd-backfill-space/datafile 2024-09-16T03:56:42.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-533 td/osd-backfill-space/datafile 2024-09-16T03:56:42.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-534 td/osd-backfill-space/datafile 2024-09-16T03:56:42.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-535 td/osd-backfill-space/datafile 2024-09-16T03:56:42.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-536 td/osd-backfill-space/datafile 2024-09-16T03:56:42.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-537 td/osd-backfill-space/datafile 2024-09-16T03:56:42.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-538 td/osd-backfill-space/datafile 2024-09-16T03:56:42.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-539 td/osd-backfill-space/datafile 2024-09-16T03:56:42.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-540 td/osd-backfill-space/datafile 2024-09-16T03:56:42.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-541 td/osd-backfill-space/datafile 2024-09-16T03:56:42.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-542 td/osd-backfill-space/datafile 2024-09-16T03:56:42.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-543 td/osd-backfill-space/datafile 2024-09-16T03:56:42.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-544 td/osd-backfill-space/datafile 2024-09-16T03:56:42.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-545 td/osd-backfill-space/datafile 2024-09-16T03:56:42.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-546 td/osd-backfill-space/datafile 2024-09-16T03:56:42.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:42.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-547 td/osd-backfill-space/datafile 2024-09-16T03:56:43.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-548 td/osd-backfill-space/datafile 2024-09-16T03:56:43.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-549 td/osd-backfill-space/datafile 2024-09-16T03:56:43.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-550 td/osd-backfill-space/datafile 2024-09-16T03:56:43.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-551 td/osd-backfill-space/datafile 2024-09-16T03:56:43.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-552 td/osd-backfill-space/datafile 2024-09-16T03:56:43.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-553 td/osd-backfill-space/datafile 2024-09-16T03:56:43.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-554 td/osd-backfill-space/datafile 2024-09-16T03:56:43.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-555 td/osd-backfill-space/datafile 2024-09-16T03:56:43.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-556 td/osd-backfill-space/datafile 2024-09-16T03:56:43.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-557 td/osd-backfill-space/datafile 2024-09-16T03:56:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-558 td/osd-backfill-space/datafile 2024-09-16T03:56:43.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-559 td/osd-backfill-space/datafile 2024-09-16T03:56:43.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-560 td/osd-backfill-space/datafile 2024-09-16T03:56:43.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:43.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-561 td/osd-backfill-space/datafile 2024-09-16T03:56:44.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-562 td/osd-backfill-space/datafile 2024-09-16T03:56:44.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-563 td/osd-backfill-space/datafile 2024-09-16T03:56:44.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-564 td/osd-backfill-space/datafile 2024-09-16T03:56:44.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-565 td/osd-backfill-space/datafile 2024-09-16T03:56:44.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-566 td/osd-backfill-space/datafile 2024-09-16T03:56:44.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-567 td/osd-backfill-space/datafile 2024-09-16T03:56:44.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-568 td/osd-backfill-space/datafile 2024-09-16T03:56:44.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-569 td/osd-backfill-space/datafile 2024-09-16T03:56:44.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-570 td/osd-backfill-space/datafile 2024-09-16T03:56:44.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-571 td/osd-backfill-space/datafile 2024-09-16T03:56:44.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-572 td/osd-backfill-space/datafile 2024-09-16T03:56:44.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-573 td/osd-backfill-space/datafile 2024-09-16T03:56:44.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:44.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-574 td/osd-backfill-space/datafile 2024-09-16T03:56:45.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-575 td/osd-backfill-space/datafile 2024-09-16T03:56:45.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-576 td/osd-backfill-space/datafile 2024-09-16T03:56:45.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-577 td/osd-backfill-space/datafile 2024-09-16T03:56:45.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-578 td/osd-backfill-space/datafile 2024-09-16T03:56:45.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-579 td/osd-backfill-space/datafile 2024-09-16T03:56:45.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-580 td/osd-backfill-space/datafile 2024-09-16T03:56:45.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-581 td/osd-backfill-space/datafile 2024-09-16T03:56:45.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-582 td/osd-backfill-space/datafile 2024-09-16T03:56:45.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-583 td/osd-backfill-space/datafile 2024-09-16T03:56:45.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-584 td/osd-backfill-space/datafile 2024-09-16T03:56:45.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-585 td/osd-backfill-space/datafile 2024-09-16T03:56:45.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-586 td/osd-backfill-space/datafile 2024-09-16T03:56:45.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-587 td/osd-backfill-space/datafile 2024-09-16T03:56:45.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:45.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-588 td/osd-backfill-space/datafile 2024-09-16T03:56:46.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:46.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-589 td/osd-backfill-space/datafile 2024-09-16T03:56:46.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:46.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-590 td/osd-backfill-space/datafile 2024-09-16T03:56:46.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:46.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-591 td/osd-backfill-space/datafile 2024-09-16T03:56:46.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:46.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-592 td/osd-backfill-space/datafile 2024-09-16T03:56:46.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:46.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-593 td/osd-backfill-space/datafile 2024-09-16T03:56:46.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:46.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-594 td/osd-backfill-space/datafile 2024-09-16T03:56:46.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:46.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-595 td/osd-backfill-space/datafile 2024-09-16T03:56:46.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:46.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-596 td/osd-backfill-space/datafile 2024-09-16T03:56:46.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:46.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-597 td/osd-backfill-space/datafile 2024-09-16T03:56:46.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:46.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-598 td/osd-backfill-space/datafile 2024-09-16T03:56:46.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:46.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-599 td/osd-backfill-space/datafile 2024-09-16T03:56:46.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:463: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:46.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:465: TEST_backfill_multi_partial: rados -p fillpool put obj-fill-600 td/osd-backfill-space/datafile 2024-09-16T03:56:46.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:468: TEST_backfill_multi_partial: get_primary fillpool obj-fill-1 2024-09-16T03:56:46.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=fillpool 2024-09-16T03:56:46.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj-fill-1 2024-09-16T03:56:46.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map fillpool obj-fill-1 2024-09-16T03:56:46.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T03:56:47.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:468: TEST_backfill_multi_partial: local fillosd=1 2024-09-16T03:56:47.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:469: TEST_backfill_multi_partial: expr 1 + 1 2024-09-16T03:56:47.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:469: TEST_backfill_multi_partial: osd=2 2024-09-16T03:56:47.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:470: TEST_backfill_multi_partial: '[' 2 = 3 ']' 2024-09-16T03:56:47.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:474: TEST_backfill_multi_partial: kill_daemon td/osd-backfill-space/osd.1.pid TERM 2024-09-16T03:56:47.383 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: cat td/osd-backfill-space/osd.1.pid 2024-09-16T03:56:47.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: local pid=149353 2024-09-16T03:56:47.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:247: kill_daemon: local send_signal=TERM 2024-09-16T03:56:47.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:248: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2024-09-16T03:56:47.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:249: kill_daemon: local exit_code=1 2024-09-16T03:56:47.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T03:56:47.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -TERM 149353 2024-09-16T03:56:47.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2024-09-16T03:56:47.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2024-09-16T03:56:47.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.1 2024-09-16T03:56:47.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T03:56:47.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 149353 2024-09-16T03:56:47.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2024-09-16T03:56:47.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2024-09-16T03:56:47.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.2 2024-09-16T03:56:47.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T03:56:47.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 149353 2024-09-16T03:56:47.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: exit_code=0 2024-09-16T03:56:47.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: break 2024-09-16T03:56:47.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: return 0 2024-09-16T03:56:47.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:475: TEST_backfill_multi_partial: ceph osd out osd.1 2024-09-16T03:56:48.259 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. 2024-09-16T03:56:48.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:477: TEST_backfill_multi_partial: _objectstore_tool_nodown td/osd-backfill-space 1 --op export-remove --pgid 1.0 --file td/osd-backfill-space/fillexport.out 2024-09-16T03:56:48.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2024-09-16T03:56:48.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2024-09-16T03:56:48.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2024-09-16T03:56:48.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2024-09-16T03:56:48.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/1 2024-09-16T03:56:48.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/1 --op export-remove --pgid 1.0 --file td/osd-backfill-space/fillexport.out 2024-09-16T03:56:50.540 INFO:tasks.workunit.client.0.smithi026.stderr:Exporting 1.0 info 1.0( v 36'600 (36'500,36'600] local-lis/les=23/25 n=600 ec=21/21 lis/c=23/23 les/c/f=25/25/0 sis=23) 2024-09-16T03:56:50.546 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0002d87b:::obj-fill-318:head# 2024-09-16T03:56:50.552 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:00676868:::obj-fill-583:head# 2024-09-16T03:56:50.558 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:00f4514e:::obj-fill-547:head# 2024-09-16T03:56:50.559 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:01596a3c:::obj-fill-533:head# 2024-09-16T03:56:50.559 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0285e89c:::obj-fill-190:head# 2024-09-16T03:56:50.560 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:02bd591e:::obj-fill-463:head# 2024-09-16T03:56:50.563 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:02c01ffe:::obj-fill-28:head# 2024-09-16T03:56:50.564 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:03ada31e:::obj-fill-285:head# 2024-09-16T03:56:50.564 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:03b07c3f:::obj-fill-568:head# 2024-09-16T03:56:50.566 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:03b85770:::obj-fill-573:head# 2024-09-16T03:56:50.567 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:03dcbe89:::obj-fill-375:head# 2024-09-16T03:56:50.567 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:04231826:::obj-fill-594:head# 2024-09-16T03:56:50.567 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:04d48684:::obj-fill-421:head# 2024-09-16T03:56:50.567 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:05385fcc:::obj-fill-299:head# 2024-09-16T03:56:50.568 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:05785d38:::obj-fill-159:head# 2024-09-16T03:56:50.568 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:057ec231:::obj-fill-138:head# 2024-09-16T03:56:50.569 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:06058b5e:::obj-fill-569:head# 2024-09-16T03:56:50.570 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:06d2a3d9:::obj-fill-284:head# 2024-09-16T03:56:50.570 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:07597b63:::obj-fill-459:head# 2024-09-16T03:56:50.570 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:075f4069:::obj-fill-550:head# 2024-09-16T03:56:50.570 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:08234052:::obj-fill-17:head# 2024-09-16T03:56:50.571 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:091ce2ec:::obj-fill-472:head# 2024-09-16T03:56:50.571 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:095fd509:::obj-fill-210:head# 2024-09-16T03:56:50.575 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0a52a594:::obj-fill-116:head# 2024-09-16T03:56:50.575 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0a63716b:::obj-fill-225:head# 2024-09-16T03:56:50.576 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0b0fa6fb:::obj-fill-541:head# 2024-09-16T03:56:50.576 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0b673f72:::obj-fill-232:head# 2024-09-16T03:56:50.577 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0bbcd1b2:::obj-fill-582:head# 2024-09-16T03:56:50.577 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0caf8ce3:::obj-fill-214:head# 2024-09-16T03:56:50.578 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0d94b9fb:::obj-fill-415:head# 2024-09-16T03:56:50.579 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0de4e6f7:::obj-fill-94:head# 2024-09-16T03:56:50.579 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0ef75768:::obj-fill-489:head# 2024-09-16T03:56:50.581 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0f67284f:::obj-fill-213:head# 2024-09-16T03:56:50.583 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:0f823df2:::obj-fill-234:head# 2024-09-16T03:56:50.584 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1005c08d:::obj-fill-490:head# 2024-09-16T03:56:50.585 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1039525f:::obj-fill-369:head# 2024-09-16T03:56:50.586 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:105fb36c:::obj-fill-226:head# 2024-09-16T03:56:50.587 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:111abdeb:::obj-fill-554:head# 2024-09-16T03:56:50.587 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:11392f3d:::obj-fill-453:head# 2024-09-16T03:56:50.588 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1169976c:::obj-fill-417:head# 2024-09-16T03:56:50.588 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:11840a2a:::obj-fill-477:head# 2024-09-16T03:56:50.589 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:11a4832e:::obj-fill-279:head# 2024-09-16T03:56:50.590 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:11a4d2f6:::obj-fill-256:head# 2024-09-16T03:56:50.590 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:12d52a31:::obj-fill-22:head# 2024-09-16T03:56:50.591 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:133c45db:::obj-fill-257:head# 2024-09-16T03:56:50.591 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:13563256:::obj-fill-150:head# 2024-09-16T03:56:50.592 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:13c09e00:::obj-fill-71:head# 2024-09-16T03:56:50.592 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:13e9fbed:::obj-fill-242:head# 2024-09-16T03:56:50.592 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:13fae6c2:::obj-fill-163:head# 2024-09-16T03:56:50.593 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:145025e0:::obj-fill-543:head# 2024-09-16T03:56:50.593 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:14517c84:::obj-fill-13:head# 2024-09-16T03:56:50.593 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:14802e9c:::obj-fill-127:head# 2024-09-16T03:56:50.594 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:150f1c96:::obj-fill-62:head# 2024-09-16T03:56:50.594 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:155e90a2:::obj-fill-537:head# 2024-09-16T03:56:50.594 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1632c776:::obj-fill-262:head# 2024-09-16T03:56:50.595 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:163bde28:::obj-fill-523:head# 2024-09-16T03:56:50.595 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:169c4ad0:::obj-fill-85:head# 2024-09-16T03:56:50.595 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:16c4da1d:::obj-fill-436:head# 2024-09-16T03:56:50.596 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:17b28c32:::obj-fill-345:head# 2024-09-16T03:56:50.596 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:17b34255:::obj-fill-577:head# 2024-09-16T03:56:50.599 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:17d2541f:::obj-fill-426:head# 2024-09-16T03:56:50.600 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:17ea19f2:::obj-fill-542:head# 2024-09-16T03:56:50.600 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:189155ea:::obj-fill-496:head# 2024-09-16T03:56:50.601 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:191a6d81:::obj-fill-548:head# 2024-09-16T03:56:50.601 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1a964993:::obj-fill-576:head# 2024-09-16T03:56:50.602 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1aa623dc:::obj-fill-356:head# 2024-09-16T03:56:50.602 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1abe5c38:::obj-fill-561:head# 2024-09-16T03:56:50.602 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1bddc06b:::obj-fill-7:head# 2024-09-16T03:56:50.604 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1be86b71:::obj-fill-295:head# 2024-09-16T03:56:50.604 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1c499bca:::obj-fill-240:head# 2024-09-16T03:56:50.605 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1c545e27:::obj-fill-509:head# 2024-09-16T03:56:50.605 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1c63c8f4:::obj-fill-4:head# 2024-09-16T03:56:50.605 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1d5a8f59:::obj-fill-377:head# 2024-09-16T03:56:50.606 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1d85b5df:::obj-fill-201:head# 2024-09-16T03:56:50.606 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1d9a0d5b:::obj-fill-581:head# 2024-09-16T03:56:50.607 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1dcf5667:::obj-fill-488:head# 2024-09-16T03:56:50.607 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1fa3090d:::obj-fill-458:head# 2024-09-16T03:56:50.607 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1fe937f6:::obj-fill-337:head# 2024-09-16T03:56:50.608 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:1ff54542:::obj-fill-349:head# 2024-09-16T03:56:50.608 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:20d9e0ca:::obj-fill-367:head# 2024-09-16T03:56:50.608 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:21b8e3bb:::obj-fill-538:head# 2024-09-16T03:56:50.609 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:227183d4:::obj-fill-235:head# 2024-09-16T03:56:50.609 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:229e5e5d:::obj-fill-522:head# 2024-09-16T03:56:50.610 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:234f8861:::obj-fill-476:head# 2024-09-16T03:56:50.610 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:23ac2c9d:::obj-fill-471:head# 2024-09-16T03:56:50.611 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:25db1742:::obj-fill-200:head# 2024-09-16T03:56:50.611 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:264f8545:::obj-fill-230:head# 2024-09-16T03:56:50.612 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:267ba97f:::obj-fill-493:head# 2024-09-16T03:56:50.612 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:26b067e8:::obj-fill-208:head# 2024-09-16T03:56:50.612 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:26f521cb:::obj-fill-300:head# 2024-09-16T03:56:50.613 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:27e70a11:::obj-fill-368:head# 2024-09-16T03:56:50.613 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:29357d4a:::obj-fill-456:head# 2024-09-16T03:56:50.614 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:29f2567e:::obj-fill-414:head# 2024-09-16T03:56:50.614 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2a10cbb6:::obj-fill-228:head# 2024-09-16T03:56:50.615 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2a1519a6:::obj-fill-148:head# 2024-09-16T03:56:50.615 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2a686ca6:::obj-fill-411:head# 2024-09-16T03:56:50.616 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2ab3f384:::obj-fill-77:head# 2024-09-16T03:56:50.616 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2ae6a1d0:::obj-fill-187:head# 2024-09-16T03:56:50.617 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2b890959:::obj-fill-222:head# 2024-09-16T03:56:50.617 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2bcc26c4:::obj-fill-114:head# 2024-09-16T03:56:50.617 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2bd3a3a2:::obj-fill-281:head# 2024-09-16T03:56:50.618 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2c1a21d7:::obj-fill-505:head# 2024-09-16T03:56:50.618 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2c255347:::obj-fill-95:head# 2024-09-16T03:56:50.619 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2c2a3f62:::obj-fill-131:head# 2024-09-16T03:56:50.619 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2c7d92ce:::obj-fill-442:head# 2024-09-16T03:56:50.620 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2d1ad117:::obj-fill-443:head# 2024-09-16T03:56:50.620 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2d57b2f7:::obj-fill-192:head# 2024-09-16T03:56:50.620 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2d7b53ea:::obj-fill-79:head# 2024-09-16T03:56:50.621 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2db25266:::obj-fill-121:head# 2024-09-16T03:56:50.621 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2e27853e:::obj-fill-473:head# 2024-09-16T03:56:50.621 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2f12cb21:::obj-fill-386:head# 2024-09-16T03:56:50.622 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2f957332:::obj-fill-422:head# 2024-09-16T03:56:50.622 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:2feae493:::obj-fill-301:head# 2024-09-16T03:56:50.623 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:302c95d2:::obj-fill-110:head# 2024-09-16T03:56:50.623 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:302d6b76:::obj-fill-374:head# 2024-09-16T03:56:50.624 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:30581f34:::obj-fill-313:head# 2024-09-16T03:56:50.624 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:307e86ac:::obj-fill-381:head# 2024-09-16T03:56:50.624 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:30ab77bf:::obj-fill-275:head# 2024-09-16T03:56:50.625 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:31127e6d:::obj-fill-250:head# 2024-09-16T03:56:50.625 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:32c93500:::obj-fill-155:head# 2024-09-16T03:56:50.626 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:339880b7:::obj-fill-227:head# 2024-09-16T03:56:50.626 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:34069e1e:::obj-fill-292:head# 2024-09-16T03:56:50.627 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:346dff31:::obj-fill-157:head# 2024-09-16T03:56:50.627 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:34ade0f1:::obj-fill-575:head# 2024-09-16T03:56:50.627 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:34bbae43:::obj-fill-90:head# 2024-09-16T03:56:50.627 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:34e97cf8:::obj-fill-334:head# 2024-09-16T03:56:50.628 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:35d7ccc2:::obj-fill-510:head# 2024-09-16T03:56:50.628 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:35f519b6:::obj-fill-513:head# 2024-09-16T03:56:50.628 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:364727e8:::obj-fill-130:head# 2024-09-16T03:56:50.629 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:364c0361:::obj-fill-586:head# 2024-09-16T03:56:50.629 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:368e7baf:::obj-fill-546:head# 2024-09-16T03:56:50.630 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:36ffb224:::obj-fill-82:head# 2024-09-16T03:56:50.630 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:371cb800:::obj-fill-330:head# 2024-09-16T03:56:50.631 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:37d5378d:::obj-fill-175:head# 2024-09-16T03:56:50.631 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:385593f3:::obj-fill-325:head# 2024-09-16T03:56:50.631 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:388d5073:::obj-fill-317:head# 2024-09-16T03:56:50.632 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:394af079:::obj-fill-59:head# 2024-09-16T03:56:50.632 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:3a41ad37:::obj-fill-409:head# 2024-09-16T03:56:50.633 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:3b3c63d2:::obj-fill-136:head# 2024-09-16T03:56:50.633 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:3bb50131:::obj-fill-512:head# 2024-09-16T03:56:50.634 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:3bb52bb5:::obj-fill-188:head# 2024-09-16T03:56:50.634 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:3c0683d1:::obj-fill-372:head# 2024-09-16T03:56:50.634 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:3c67d3f4:::obj-fill-249:head# 2024-09-16T03:56:50.635 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:3c6a4a4c:::obj-fill-495:head# 2024-09-16T03:56:50.635 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:3c7fc8c9:::obj-fill-324:head# 2024-09-16T03:56:50.635 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:3d940c50:::obj-fill-591:head# 2024-09-16T03:56:50.636 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:3ed5508e:::obj-fill-558:head# 2024-09-16T03:56:50.636 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:3f598316:::obj-fill-389:head# 2024-09-16T03:56:50.636 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:401cd0ce:::obj-fill-251:head# 2024-09-16T03:56:50.637 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:40fae006:::obj-fill-14:head# 2024-09-16T03:56:50.637 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4120b10f:::obj-fill-165:head# 2024-09-16T03:56:50.638 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:41b382c2:::obj-fill-289:head# 2024-09-16T03:56:50.638 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4277cdea:::obj-fill-319:head# 2024-09-16T03:56:50.638 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:42978c3c:::obj-fill-174:head# 2024-09-16T03:56:50.639 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:42b08dc2:::obj-fill-553:head# 2024-09-16T03:56:50.639 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:42ec4bf6:::obj-fill-209:head# 2024-09-16T03:56:50.640 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:430c129d:::obj-fill-448:head# 2024-09-16T03:56:50.640 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4335d553:::obj-fill-600:head# 2024-09-16T03:56:50.641 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:44804f62:::obj-fill-532:head# 2024-09-16T03:56:50.641 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:44954d54:::obj-fill-2:head# 2024-09-16T03:56:50.641 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4502f904:::obj-fill-429:head# 2024-09-16T03:56:50.642 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4568ddcb:::obj-fill-382:head# 2024-09-16T03:56:50.642 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:45939974:::obj-fill-563:head# 2024-09-16T03:56:50.643 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:462a5bbd:::obj-fill-567:head# 2024-09-16T03:56:50.643 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:47773ae4:::obj-fill-307:head# 2024-09-16T03:56:50.643 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4802b263:::obj-fill-387:head# 2024-09-16T03:56:50.644 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:483d938e:::obj-fill-128:head# 2024-09-16T03:56:50.644 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:48a7ad29:::obj-fill-147:head# 2024-09-16T03:56:50.645 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:493b61ce:::obj-fill-454:head# 2024-09-16T03:56:50.645 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4afb70fe:::obj-fill-186:head# 2024-09-16T03:56:50.645 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4bff08e3:::obj-fill-352:head# 2024-09-16T03:56:50.646 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4c01eabe:::obj-fill-370:head# 2024-09-16T03:56:50.646 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4c131560:::obj-fill-6:head# 2024-09-16T03:56:50.646 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4c4c5e14:::obj-fill-350:head# 2024-09-16T03:56:50.647 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4c80dc2c:::obj-fill-357:head# 2024-09-16T03:56:50.647 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4c9dee9b:::obj-fill-540:head# 2024-09-16T03:56:50.648 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4ce40c18:::obj-fill-280:head# 2024-09-16T03:56:50.648 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4d854fc3:::obj-fill-585:head# 2024-09-16T03:56:50.648 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:4f615b53:::obj-fill-101:head# 2024-09-16T03:56:50.649 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5042b30f:::obj-fill-84:head# 2024-09-16T03:56:50.649 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:507dc08b:::obj-fill-336:head# 2024-09-16T03:56:50.650 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:512fcf5a:::obj-fill-169:head# 2024-09-16T03:56:50.650 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:51a0c8f8:::obj-fill-578:head# 2024-09-16T03:56:50.650 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:51fd05a2:::obj-fill-425:head# 2024-09-16T03:56:50.651 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:52400ebc:::obj-fill-81:head# 2024-09-16T03:56:50.651 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5288d40c:::obj-fill-16:head# 2024-09-16T03:56:50.652 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5295b0ee:::obj-fill-224:head# 2024-09-16T03:56:50.652 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:531e4c60:::obj-fill-103:head# 2024-09-16T03:56:50.652 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:54259f28:::obj-fill-584:head# 2024-09-16T03:56:50.653 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:542d619c:::obj-fill-528:head# 2024-09-16T03:56:50.653 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5503ca3e:::obj-fill-494:head# 2024-09-16T03:56:50.653 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5555c48b:::obj-fill-403:head# 2024-09-16T03:56:50.654 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:558d1ec7:::obj-fill-447:head# 2024-09-16T03:56:50.654 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:55aa2233:::obj-fill-21:head# 2024-09-16T03:56:50.655 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:55aaf8c4:::obj-fill-29:head# 2024-09-16T03:56:50.656 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:55e246e1:::obj-fill-65:head# 2024-09-16T03:56:50.656 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:563b14a8:::obj-fill-120:head# 2024-09-16T03:56:50.657 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:56e1df25:::obj-fill-305:head# 2024-09-16T03:56:50.657 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5702979c:::obj-fill-73:head# 2024-09-16T03:56:50.657 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:570722ba:::obj-fill-219:head# 2024-09-16T03:56:50.658 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:57f7a09b:::obj-fill-571:head# 2024-09-16T03:56:50.658 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:585309ba:::obj-fill-144:head# 2024-09-16T03:56:50.658 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:585c7c9c:::obj-fill-437:head# 2024-09-16T03:56:50.659 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:587c63db:::obj-fill-182:head# 2024-09-16T03:56:50.659 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:58f34d6b:::obj-fill-598:head# 2024-09-16T03:56:50.660 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:58f40088:::obj-fill-298:head# 2024-09-16T03:56:50.660 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:591e150c:::obj-fill-32:head# 2024-09-16T03:56:50.661 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:59971ddb:::obj-fill-559:head# 2024-09-16T03:56:50.661 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5adafca4:::obj-fill-56:head# 2024-09-16T03:56:50.661 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5b32b04f:::obj-fill-484:head# 2024-09-16T03:56:50.662 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5bdaeb16:::obj-fill-99:head# 2024-09-16T03:56:50.662 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5c1d6f4b:::obj-fill-133:head# 2024-09-16T03:56:50.663 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5c92b8f1:::obj-fill-255:head# 2024-09-16T03:56:50.663 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5ca4850f:::obj-fill-238:head# 2024-09-16T03:56:50.663 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5d928a5b:::obj-fill-395:head# 2024-09-16T03:56:50.664 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5dd49320:::obj-fill-423:head# 2024-09-16T03:56:50.664 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5e7bc368:::obj-fill-506:head# 2024-09-16T03:56:50.664 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5ebd5ee3:::obj-fill-322:head# 2024-09-16T03:56:50.665 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5edeedf1:::obj-fill-557:head# 2024-09-16T03:56:50.665 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:5facf8e2:::obj-fill-15:head# 2024-09-16T03:56:50.666 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:603a2c76:::obj-fill-439:head# 2024-09-16T03:56:50.666 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:60b30714:::obj-fill-53:head# 2024-09-16T03:56:50.667 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:612b4a8a:::obj-fill-412:head# 2024-09-16T03:56:50.667 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:61a111b6:::obj-fill-87:head# 2024-09-16T03:56:50.668 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:63a0e8a2:::obj-fill-266:head# 2024-09-16T03:56:50.668 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:63aa4d60:::obj-fill-68:head# 2024-09-16T03:56:50.669 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:63ac5b95:::obj-fill-405:head# 2024-09-16T03:56:50.669 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6415a9e3:::obj-fill-400:head# 2024-09-16T03:56:50.669 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:64ba03ae:::obj-fill-20:head# 2024-09-16T03:56:50.670 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6512f015:::obj-fill-597:head# 2024-09-16T03:56:50.670 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:65433104:::obj-fill-504:head# 2024-09-16T03:56:50.670 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:65950c58:::obj-fill-86:head# 2024-09-16T03:56:50.670 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:65b6b2d7:::obj-fill-39:head# 2024-09-16T03:56:50.671 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:661c8afd:::obj-fill-267:head# 2024-09-16T03:56:50.671 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:66f87c94:::obj-fill-229:head# 2024-09-16T03:56:50.672 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:67292cef:::obj-fill-93:head# 2024-09-16T03:56:50.672 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:67f0e12c:::obj-fill-363:head# 2024-09-16T03:56:50.673 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:696eb83b:::obj-fill-185:head# 2024-09-16T03:56:50.673 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6b33981c:::obj-fill-259:head# 2024-09-16T03:56:50.673 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6b5a527c:::obj-fill-485:head# 2024-09-16T03:56:50.674 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6b6f1852:::obj-fill-390:head# 2024-09-16T03:56:50.674 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6ba5c5f8:::obj-fill-304:head# 2024-09-16T03:56:50.674 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6bce929d:::obj-fill-518:head# 2024-09-16T03:56:50.675 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6c8ffc04:::obj-fill-61:head# 2024-09-16T03:56:50.675 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6ca7e551:::obj-fill-40:head# 2024-09-16T03:56:50.676 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6caff2cd:::obj-fill-332:head# 2024-09-16T03:56:50.676 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6ce4adc7:::obj-fill-574:head# 2024-09-16T03:56:50.676 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6d09d770:::obj-fill-74:head# 2024-09-16T03:56:50.677 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6e039822:::obj-fill-278:head# 2024-09-16T03:56:50.677 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6f2cd109:::obj-fill-297:head# 2024-09-16T03:56:50.678 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6f3754c4:::obj-fill-88:head# 2024-09-16T03:56:50.678 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6f86cfd2:::obj-fill-511:head# 2024-09-16T03:56:50.678 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:6fe3f3f7:::obj-fill-193:head# 2024-09-16T03:56:50.679 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7002c57d:::obj-fill-50:head# 2024-09-16T03:56:50.679 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7030b2a3:::obj-fill-217:head# 2024-09-16T03:56:50.679 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:70665087:::obj-fill-51:head# 2024-09-16T03:56:50.680 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:70a0f5e0:::obj-fill-11:head# 2024-09-16T03:56:50.680 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:71f4643d:::obj-fill-236:head# 2024-09-16T03:56:50.680 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:722fbd0f:::obj-fill-302:head# 2024-09-16T03:56:50.681 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:72584da9:::obj-fill-445:head# 2024-09-16T03:56:50.681 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:72d91d24:::obj-fill-218:head# 2024-09-16T03:56:50.681 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:72f7268b:::obj-fill-106:head# 2024-09-16T03:56:50.682 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:74077abf:::obj-fill-435:head# 2024-09-16T03:56:50.682 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:740ca050:::obj-fill-112:head# 2024-09-16T03:56:50.683 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7435e881:::obj-fill-78:head# 2024-09-16T03:56:50.683 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:74ba0bb7:::obj-fill-478:head# 2024-09-16T03:56:50.683 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:74d82091:::obj-fill-96:head# 2024-09-16T03:56:50.684 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7515f56c:::obj-fill-483:head# 2024-09-16T03:56:50.684 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7550d6fe:::obj-fill-286:head# 2024-09-16T03:56:50.684 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:75807edc:::obj-fill-223:head# 2024-09-16T03:56:50.685 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:762ba324:::obj-fill-172:head# 2024-09-16T03:56:50.685 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:76369bda:::obj-fill-570:head# 2024-09-16T03:56:50.685 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7667a5b0:::obj-fill-196:head# 2024-09-16T03:56:50.686 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:77736c0c:::obj-fill-566:head# 2024-09-16T03:56:50.686 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:77fb47a4:::obj-fill-314:head# 2024-09-16T03:56:50.687 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:785ad894:::obj-fill-80:head# 2024-09-16T03:56:50.687 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:785e3d14:::obj-fill-530:head# 2024-09-16T03:56:50.688 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:788efef4:::obj-fill-595:head# 2024-09-16T03:56:50.688 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:789ec5ab:::obj-fill-44:head# 2024-09-16T03:56:50.689 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:798a3fa8:::obj-fill-517:head# 2024-09-16T03:56:50.689 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:79a105ef:::obj-fill-315:head# 2024-09-16T03:56:50.689 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:79d02f04:::obj-fill-243:head# 2024-09-16T03:56:50.690 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7a00dfcb:::obj-fill-402:head# 2024-09-16T03:56:50.690 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7b982684:::obj-fill-168:head# 2024-09-16T03:56:50.690 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7bb36851:::obj-fill-440:head# 2024-09-16T03:56:50.691 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7bb49d8c:::obj-fill-55:head# 2024-09-16T03:56:50.692 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7c77b783:::obj-fill-580:head# 2024-09-16T03:56:50.692 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7c89d75b:::obj-fill-555:head# 2024-09-16T03:56:50.695 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7d12fb67:::obj-fill-399:head# 2024-09-16T03:56:50.695 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7d139961:::obj-fill-92:head# 2024-09-16T03:56:50.695 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7d39ffd0:::obj-fill-135:head# 2024-09-16T03:56:50.695 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7e534cc4:::obj-fill-282:head# 2024-09-16T03:56:50.695 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7e7a08e0:::obj-fill-108:head# 2024-09-16T03:56:50.695 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7e8e2b67:::obj-fill-244:head# 2024-09-16T03:56:50.695 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7eea215e:::obj-fill-139:head# 2024-09-16T03:56:50.696 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7efa3c6e:::obj-fill-408:head# 2024-09-16T03:56:50.696 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7f03a24b:::obj-fill-45:head# 2024-09-16T03:56:50.697 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7f6a2e2b:::obj-fill-427:head# 2024-09-16T03:56:50.697 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7fb0abd6:::obj-fill-479:head# 2024-09-16T03:56:50.697 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:7fb77de1:::obj-fill-167:head# 2024-09-16T03:56:50.697 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:80012a03:::obj-fill-105:head# 2024-09-16T03:56:50.697 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:80075ae5:::obj-fill-376:head# 2024-09-16T03:56:50.698 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8089baa5:::obj-fill-97:head# 2024-09-16T03:56:50.698 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:80d0b4c5:::obj-fill-123:head# 2024-09-16T03:56:50.699 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:810f319f:::obj-fill-552:head# 2024-09-16T03:56:50.699 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:81427ef2:::obj-fill-474:head# 2024-09-16T03:56:50.699 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:818d780c:::obj-fill-33:head# 2024-09-16T03:56:50.699 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:819f31b9:::obj-fill-366:head# 2024-09-16T03:56:50.700 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8205549d:::obj-fill-125:head# 2024-09-16T03:56:50.700 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:821f56e5:::obj-fill-339:head# 2024-09-16T03:56:50.701 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:822807c6:::obj-fill-69:head# 2024-09-16T03:56:50.701 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:822fcf61:::obj-fill-560:head# 2024-09-16T03:56:50.702 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:82ad696b:::obj-fill-149:head# 2024-09-16T03:56:50.703 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:835cc771:::obj-fill-446:head# 2024-09-16T03:56:50.703 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8386bee1:::obj-fill-137:head# 2024-09-16T03:56:50.703 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:83c1303a:::obj-fill-311:head# 2024-09-16T03:56:50.704 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:83cf1c2a:::obj-fill-360:head# 2024-09-16T03:56:50.704 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:83d70321:::obj-fill-351:head# 2024-09-16T03:56:50.705 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:83ef162d:::obj-fill-331:head# 2024-09-16T03:56:50.705 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:840f8f20:::obj-fill-398:head# 2024-09-16T03:56:50.706 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:84d2e456:::obj-fill-207:head# 2024-09-16T03:56:50.706 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:856697ff:::obj-fill-333:head# 2024-09-16T03:56:50.707 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:858be937:::obj-fill-418:head# 2024-09-16T03:56:50.707 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:85a0b302:::obj-fill-438:head# 2024-09-16T03:56:50.708 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:85fa942e:::obj-fill-272:head# 2024-09-16T03:56:50.709 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:863eb6f8:::obj-fill-320:head# 2024-09-16T03:56:50.709 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:868d4588:::obj-fill-19:head# 2024-09-16T03:56:50.710 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8759d023:::obj-fill-466:head# 2024-09-16T03:56:50.710 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:88072111:::obj-fill-312:head# 2024-09-16T03:56:50.710 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:886edcef:::obj-fill-380:head# 2024-09-16T03:56:50.711 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:88ce753e:::obj-fill-43:head# 2024-09-16T03:56:50.711 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:890e1d83:::obj-fill-590:head# 2024-09-16T03:56:50.712 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:891566a3:::obj-fill-341:head# 2024-09-16T03:56:50.713 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:891ca235:::obj-fill-177:head# 2024-09-16T03:56:50.713 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:897fa9d0:::obj-fill-283:head# 2024-09-16T03:56:50.713 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:89cd304b:::obj-fill-592:head# 2024-09-16T03:56:50.714 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:89d04c4a:::obj-fill-388:head# 2024-09-16T03:56:50.714 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:89db45d9:::obj-fill-247:head# 2024-09-16T03:56:50.715 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8ad879c5:::obj-fill-492:head# 2024-09-16T03:56:50.715 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8af4b5de:::obj-fill-37:head# 2024-09-16T03:56:50.715 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8b132e86:::obj-fill-35:head# 2024-09-16T03:56:50.717 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8b80a60a:::obj-fill-100:head# 2024-09-16T03:56:50.717 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8bb64fa6:::obj-fill-599:head# 2024-09-16T03:56:50.717 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8bed03f5:::obj-fill-5:head# 2024-09-16T03:56:50.717 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8c60e135:::obj-fill-470:head# 2024-09-16T03:56:50.718 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8c774623:::obj-fill-38:head# 2024-09-16T03:56:50.718 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8cc528ae:::obj-fill-519:head# 2024-09-16T03:56:50.718 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8cf73826:::obj-fill-460:head# 2024-09-16T03:56:50.719 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8d3564b3:::obj-fill-452:head# 2024-09-16T03:56:50.719 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8dfe1ca2:::obj-fill-469:head# 2024-09-16T03:56:50.720 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8e527672:::obj-fill-246:head# 2024-09-16T03:56:50.720 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8e96103f:::obj-fill-444:head# 2024-09-16T03:56:50.720 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8ed6417f:::obj-fill-146:head# 2024-09-16T03:56:50.721 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8eda2ffc:::obj-fill-539:head# 2024-09-16T03:56:50.721 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8f08dd48:::obj-fill-26:head# 2024-09-16T03:56:50.722 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8f111b25:::obj-fill-18:head# 2024-09-16T03:56:50.722 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:8fde63f8:::obj-fill-338:head# 2024-09-16T03:56:50.723 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9030746d:::obj-fill-468:head# 2024-09-16T03:56:50.723 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9115d8a1:::obj-fill-260:head# 2024-09-16T03:56:50.724 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:91649909:::obj-fill-140:head# 2024-09-16T03:56:50.725 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:91c1081d:::obj-fill-404:head# 2024-09-16T03:56:50.725 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:91f42503:::obj-fill-216:head# 2024-09-16T03:56:50.725 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:927b34a0:::obj-fill-63:head# 2024-09-16T03:56:50.726 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:92a00a91:::obj-fill-467:head# 2024-09-16T03:56:50.726 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:930a7268:::obj-fill-450:head# 2024-09-16T03:56:50.726 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:93c3d0bf:::obj-fill-118:head# 2024-09-16T03:56:50.727 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:93ca7c9e:::obj-fill-132:head# 2024-09-16T03:56:50.727 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:942435d5:::obj-fill-378:head# 2024-09-16T03:56:50.727 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9445f8c5:::obj-fill-245:head# 2024-09-16T03:56:50.728 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9457c8d9:::obj-fill-535:head# 2024-09-16T03:56:50.728 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:950dc56e:::obj-fill-348:head# 2024-09-16T03:56:50.730 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9559ee1d:::obj-fill-545:head# 2024-09-16T03:56:50.730 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:957c5cc4:::obj-fill-212:head# 2024-09-16T03:56:50.730 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:95bdac02:::obj-fill-588:head# 2024-09-16T03:56:50.731 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:95f202af:::obj-fill-126:head# 2024-09-16T03:56:50.731 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:96789003:::obj-fill-83:head# 2024-09-16T03:56:50.731 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:96d494a8:::obj-fill-316:head# 2024-09-16T03:56:50.732 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:97adb85b:::obj-fill-233:head# 2024-09-16T03:56:50.733 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:980d998c:::obj-fill-197:head# 2024-09-16T03:56:50.733 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:98235c44:::obj-fill-396:head# 2024-09-16T03:56:50.733 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:987d3b87:::obj-fill-327:head# 2024-09-16T03:56:50.734 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:990a5e24:::obj-fill-515:head# 2024-09-16T03:56:50.735 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:995fec05:::obj-fill-191:head# 2024-09-16T03:56:50.735 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9a769b75:::obj-fill-587:head# 2024-09-16T03:56:50.735 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9b141990:::obj-fill-394:head# 2024-09-16T03:56:50.736 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9bb108fb:::obj-fill-579:head# 2024-09-16T03:56:50.736 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9ce19d92:::obj-fill-361:head# 2024-09-16T03:56:50.737 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9d8c3f95:::obj-fill-572:head# 2024-09-16T03:56:50.737 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9e283e00:::obj-fill-254:head# 2024-09-16T03:56:50.738 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9e3a1a61:::obj-fill-58:head# 2024-09-16T03:56:50.738 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9e8f6029:::obj-fill-41:head# 2024-09-16T03:56:50.739 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9ef117aa:::obj-fill-520:head# 2024-09-16T03:56:50.739 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9f3bdfc2:::obj-fill-184:head# 2024-09-16T03:56:50.739 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9fd89320:::obj-fill-364:head# 2024-09-16T03:56:50.740 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:9feb7062:::obj-fill-419:head# 2024-09-16T03:56:50.740 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a07504c4:::obj-fill-516:head# 2024-09-16T03:56:50.741 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a1897e34:::obj-fill-153:head# 2024-09-16T03:56:50.741 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a19a9d76:::obj-fill-30:head# 2024-09-16T03:56:50.742 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a1a49c98:::obj-fill-98:head# 2024-09-16T03:56:50.742 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a1ea911a:::obj-fill-36:head# 2024-09-16T03:56:50.742 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a24bad98:::obj-fill-335:head# 2024-09-16T03:56:50.743 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a263b16f:::obj-fill-326:head# 2024-09-16T03:56:50.744 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a27d661e:::obj-fill-152:head# 2024-09-16T03:56:50.745 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a282a129:::obj-fill-451:head# 2024-09-16T03:56:50.745 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a28f05ba:::obj-fill-241:head# 2024-09-16T03:56:50.745 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a2cdc5cc:::obj-fill-180:head# 2024-09-16T03:56:50.746 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a30777ea:::obj-fill-486:head# 2024-09-16T03:56:50.748 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a3a65661:::obj-fill-151:head# 2024-09-16T03:56:50.748 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a3cb2967:::obj-fill-195:head# 2024-09-16T03:56:50.748 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a3ffc098:::obj-fill-293:head# 2024-09-16T03:56:50.748 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a4a31ccc:::obj-fill-413:head# 2024-09-16T03:56:50.749 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a51c3677:::obj-fill-384:head# 2024-09-16T03:56:50.749 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a5e941a7:::obj-fill-141:head# 2024-09-16T03:56:50.749 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a6cdd8b2:::obj-fill-342:head# 2024-09-16T03:56:50.750 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a6e20b86:::obj-fill-593:head# 2024-09-16T03:56:50.750 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a7a9ccf9:::obj-fill-129:head# 2024-09-16T03:56:50.751 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a7b702d3:::obj-fill-49:head# 2024-09-16T03:56:50.751 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a8daf8bd:::obj-fill-391:head# 2024-09-16T03:56:50.751 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:a99c3cef:::obj-fill-171:head# 2024-09-16T03:56:50.752 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:aabb5718:::obj-fill-521:head# 2024-09-16T03:56:50.752 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ab0cb851:::obj-fill-183:head# 2024-09-16T03:56:50.753 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ab7a05e4:::obj-fill-203:head# 2024-09-16T03:56:50.753 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ab7dda83:::obj-fill-113:head# 2024-09-16T03:56:50.754 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:abb3502c:::obj-fill-461:head# 2024-09-16T03:56:50.754 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ac1c41be:::obj-fill-162:head# 2024-09-16T03:56:50.754 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ac2114ba:::obj-fill-239:head# 2024-09-16T03:56:50.755 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ad355fca:::obj-fill-271:head# 2024-09-16T03:56:50.755 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ad4634a0:::obj-fill-487:head# 2024-09-16T03:56:50.755 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:add2bb13:::obj-fill-31:head# 2024-09-16T03:56:50.756 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:aeb6258d:::obj-fill-124:head# 2024-09-16T03:56:50.756 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:af17f7d7:::obj-fill-464:head# 2024-09-16T03:56:50.756 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:af1e1cf0:::obj-fill-237:head# 2024-09-16T03:56:50.757 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:afc439ce:::obj-fill-248:head# 2024-09-16T03:56:50.757 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:afceab4d:::obj-fill-527:head# 2024-09-16T03:56:50.757 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b03af40c:::obj-fill-143:head# 2024-09-16T03:56:50.758 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b04cf0db:::obj-fill-507:head# 2024-09-16T03:56:50.758 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b07896f0:::obj-fill-269:head# 2024-09-16T03:56:50.759 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b0b954d5:::obj-fill-524:head# 2024-09-16T03:56:50.759 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b1cbfcb7:::obj-fill-134:head# 2024-09-16T03:56:50.760 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b2978fd3:::obj-fill-27:head# 2024-09-16T03:56:50.760 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b394798f:::obj-fill-156:head# 2024-09-16T03:56:50.761 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b3c6f36d:::obj-fill-401:head# 2024-09-16T03:56:50.761 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b3f8e5ac:::obj-fill-290:head# 2024-09-16T03:56:50.761 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b41ed5f8:::obj-fill-76:head# 2024-09-16T03:56:50.762 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b4878e76:::obj-fill-253:head# 2024-09-16T03:56:50.763 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b4e19741:::obj-fill-503:head# 2024-09-16T03:56:50.763 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b53a3690:::obj-fill-264:head# 2024-09-16T03:56:50.764 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b545ab4f:::obj-fill-24:head# 2024-09-16T03:56:50.764 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b55af5e6:::obj-fill-491:head# 2024-09-16T03:56:50.764 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b57edf82:::obj-fill-526:head# 2024-09-16T03:56:50.765 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b589d2be:::obj-fill-323:head# 2024-09-16T03:56:50.765 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b6207f32:::obj-fill-344:head# 2024-09-16T03:56:50.765 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b757ee2e:::obj-fill-433:head# 2024-09-16T03:56:50.766 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b75cc479:::obj-fill-34:head# 2024-09-16T03:56:50.767 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b7b03117:::obj-fill-42:head# 2024-09-16T03:56:50.767 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b7e6205d:::obj-fill-501:head# 2024-09-16T03:56:50.767 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b8d18b7a:::obj-fill-353:head# 2024-09-16T03:56:50.768 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b9189c29:::obj-fill-328:head# 2024-09-16T03:56:50.769 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b98e07aa:::obj-fill-54:head# 2024-09-16T03:56:50.770 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:b9cd1e9a:::obj-fill-371:head# 2024-09-16T03:56:50.770 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:bc3322bb:::obj-fill-340:head# 2024-09-16T03:56:50.770 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:bcf43161:::obj-fill-294:head# 2024-09-16T03:56:50.771 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:bd07fc4f:::obj-fill-549:head# 2024-09-16T03:56:50.772 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:bdf48e47:::obj-fill-430:head# 2024-09-16T03:56:50.772 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:be01c111:::obj-fill-1:head# 2024-09-16T03:56:50.772 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:be3a4bc7:::obj-fill-102:head# 2024-09-16T03:56:50.773 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:be8e1fcd:::obj-fill-321:head# 2024-09-16T03:56:50.773 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:bf5fcbac:::obj-fill-287:head# 2024-09-16T03:56:50.774 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:bf806d14:::obj-fill-115:head# 2024-09-16T03:56:50.775 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:bfb28823:::obj-fill-72:head# 2024-09-16T03:56:50.775 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:bfef805e:::obj-fill-119:head# 2024-09-16T03:56:50.776 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c02f8e10:::obj-fill-497:head# 2024-09-16T03:56:50.776 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c050cd6e:::obj-fill-8:head# 2024-09-16T03:56:50.776 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c218e297:::obj-fill-173:head# 2024-09-16T03:56:50.776 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c2bc66fe:::obj-fill-252:head# 2024-09-16T03:56:50.777 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c3b55903:::obj-fill-428:head# 2024-09-16T03:56:50.777 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c51907b0:::obj-fill-457:head# 2024-09-16T03:56:50.778 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c561dc83:::obj-fill-75:head# 2024-09-16T03:56:50.778 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c5d1e1a9:::obj-fill-268:head# 2024-09-16T03:56:50.779 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c60ab0d0:::obj-fill-303:head# 2024-09-16T03:56:50.779 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c644ce52:::obj-fill-514:head# 2024-09-16T03:56:50.780 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c6ab3a11:::obj-fill-407:head# 2024-09-16T03:56:50.781 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c74377bf:::obj-fill-432:head# 2024-09-16T03:56:50.781 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c767fff6:::obj-fill-531:head# 2024-09-16T03:56:50.781 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c7a9adad:::obj-fill-475:head# 2024-09-16T03:56:50.781 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c7e3a9c2:::obj-fill-465:head# 2024-09-16T03:56:50.782 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c850aed7:::obj-fill-424:head# 2024-09-16T03:56:50.782 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c8a0088a:::obj-fill-329:head# 2024-09-16T03:56:50.782 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:c9d419f9:::obj-fill-176:head# 2024-09-16T03:56:50.783 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:caf25ec2:::obj-fill-274:head# 2024-09-16T03:56:50.783 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cb625830:::obj-fill-70:head# 2024-09-16T03:56:50.783 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cbb65125:::obj-fill-529:head# 2024-09-16T03:56:50.785 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cbe2544c:::obj-fill-3:head# 2024-09-16T03:56:50.785 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cbfce4ee:::obj-fill-455:head# 2024-09-16T03:56:50.785 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cc62419c:::obj-fill-498:head# 2024-09-16T03:56:50.785 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cce831fa:::obj-fill-160:head# 2024-09-16T03:56:50.786 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cda71af4:::obj-fill-122:head# 2024-09-16T03:56:50.786 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cea7a728:::obj-fill-265:head# 2024-09-16T03:56:50.787 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cee19f0a:::obj-fill-142:head# 2024-09-16T03:56:50.787 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cf22117e:::obj-fill-499:head# 2024-09-16T03:56:50.788 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cfbfa66d:::obj-fill-66:head# 2024-09-16T03:56:50.788 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cfc2552c:::obj-fill-211:head# 2024-09-16T03:56:50.789 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:cfc563e8:::obj-fill-392:head# 2024-09-16T03:56:50.789 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d02d8880:::obj-fill-362:head# 2024-09-16T03:56:50.790 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d054947e:::obj-fill-67:head# 2024-09-16T03:56:50.790 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d061c977:::obj-fill-164:head# 2024-09-16T03:56:50.791 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d06a5f57:::obj-fill-296:head# 2024-09-16T03:56:50.791 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d110062a:::obj-fill-343:head# 2024-09-16T03:56:50.792 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d1b8ad47:::obj-fill-383:head# 2024-09-16T03:56:50.792 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d1e80db6:::obj-fill-117:head# 2024-09-16T03:56:50.793 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d210027e:::obj-fill-231:head# 2024-09-16T03:56:50.793 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d24428ed:::obj-fill-199:head# 2024-09-16T03:56:50.794 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d27c3c4b:::obj-fill-154:head# 2024-09-16T03:56:50.794 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d28957e3:::obj-fill-263:head# 2024-09-16T03:56:50.795 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d2d44da7:::obj-fill-544:head# 2024-09-16T03:56:50.795 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d31004a4:::obj-fill-434:head# 2024-09-16T03:56:50.796 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d32487c3:::obj-fill-385:head# 2024-09-16T03:56:50.797 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d340891c:::obj-fill-12:head# 2024-09-16T03:56:50.797 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d4135728:::obj-fill-310:head# 2024-09-16T03:56:50.798 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d5a43972:::obj-fill-9:head# 2024-09-16T03:56:50.798 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d5efeb15:::obj-fill-347:head# 2024-09-16T03:56:50.798 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d6463f70:::obj-fill-536:head# 2024-09-16T03:56:50.798 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d666d9b7:::obj-fill-420:head# 2024-09-16T03:56:50.800 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d6e86688:::obj-fill-166:head# 2024-09-16T03:56:50.800 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d730370d:::obj-fill-206:head# 2024-09-16T03:56:50.800 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d783551c:::obj-fill-109:head# 2024-09-16T03:56:50.802 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d7f77e5f:::obj-fill-551:head# 2024-09-16T03:56:50.802 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d843056c:::obj-fill-291:head# 2024-09-16T03:56:50.802 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d84eb173:::obj-fill-221:head# 2024-09-16T03:56:50.802 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d8dd069c:::obj-fill-60:head# 2024-09-16T03:56:50.802 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d8f2f750:::obj-fill-562:head# 2024-09-16T03:56:50.803 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d8f80ac2:::obj-fill-179:head# 2024-09-16T03:56:50.803 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:d9f904cf:::obj-fill-308:head# 2024-09-16T03:56:50.804 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:db0a534b:::obj-fill-410:head# 2024-09-16T03:56:50.804 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:dc4403f4:::obj-fill-416:head# 2024-09-16T03:56:50.804 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:dc66c3ca:::obj-fill-220:head# 2024-09-16T03:56:50.805 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:dc8198dc:::obj-fill-596:head# 2024-09-16T03:56:50.805 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:dcbade2b:::obj-fill-10:head# 2024-09-16T03:56:50.806 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ddb787ea:::obj-fill-556:head# 2024-09-16T03:56:50.806 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:de58065b:::obj-fill-306:head# 2024-09-16T03:56:50.807 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:deaa6fab:::obj-fill-194:head# 2024-09-16T03:56:50.808 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:dfee7714:::obj-fill-202:head# 2024-09-16T03:56:50.808 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:dff5df4a:::obj-fill-565:head# 2024-09-16T03:56:50.808 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e2053442:::obj-fill-107:head# 2024-09-16T03:56:50.811 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e32055b8:::obj-fill-57:head# 2024-09-16T03:56:50.811 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e37fac1e:::obj-fill-161:head# 2024-09-16T03:56:50.811 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e388f5aa:::obj-fill-273:head# 2024-09-16T03:56:50.811 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e38b1f4d:::obj-fill-393:head# 2024-09-16T03:56:50.811 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e4792474:::obj-fill-158:head# 2024-09-16T03:56:50.812 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e4899cb0:::obj-fill-270:head# 2024-09-16T03:56:50.812 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e62ae9f1:::obj-fill-288:head# 2024-09-16T03:56:50.812 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e64fd95a:::obj-fill-449:head# 2024-09-16T03:56:50.812 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e6682cfc:::obj-fill-373:head# 2024-09-16T03:56:50.813 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e716717b:::obj-fill-178:head# 2024-09-16T03:56:50.813 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e80226af:::obj-fill-354:head# 2024-09-16T03:56:50.814 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e83a5940:::obj-fill-564:head# 2024-09-16T03:56:50.814 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e854bfbe:::obj-fill-589:head# 2024-09-16T03:56:50.815 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e8b197bc:::obj-fill-89:head# 2024-09-16T03:56:50.842 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e92fca88:::obj-fill-397:head# 2024-09-16T03:56:50.849 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e94d8f7b:::obj-fill-261:head# 2024-09-16T03:56:50.851 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:e98cc0a4:::obj-fill-525:head# 2024-09-16T03:56:50.866 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ea5a9459:::obj-fill-431:head# 2024-09-16T03:56:50.874 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ebc54d47:::obj-fill-258:head# 2024-09-16T03:56:50.875 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ec0002dd:::obj-fill-205:head# 2024-09-16T03:56:50.876 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ec740b5c:::obj-fill-46:head# 2024-09-16T03:56:50.877 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ed35dda4:::obj-fill-170:head# 2024-09-16T03:56:50.878 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ed51b8f7:::obj-fill-91:head# 2024-09-16T03:56:50.878 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:edd96161:::obj-fill-48:head# 2024-09-16T03:56:50.878 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ee3f0d4b:::obj-fill-47:head# 2024-09-16T03:56:50.878 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ee4784dd:::obj-fill-480:head# 2024-09-16T03:56:50.879 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ee5a8271:::obj-fill-198:head# 2024-09-16T03:56:50.879 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ef745b66:::obj-fill-145:head# 2024-09-16T03:56:50.879 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:efa5309d:::obj-fill-215:head# 2024-09-16T03:56:50.880 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:efbdd3a1:::obj-fill-276:head# 2024-09-16T03:56:50.880 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f059d4c0:::obj-fill-482:head# 2024-09-16T03:56:50.880 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f0f9fb7a:::obj-fill-379:head# 2024-09-16T03:56:50.881 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f16a3656:::obj-fill-462:head# 2024-09-16T03:56:50.881 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f1b395ae:::obj-fill-25:head# 2024-09-16T03:56:50.881 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f5876dad:::obj-fill-359:head# 2024-09-16T03:56:50.881 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f5a283cd:::obj-fill-534:head# 2024-09-16T03:56:50.883 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f5cd905a:::obj-fill-358:head# 2024-09-16T03:56:50.883 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f5e48302:::obj-fill-406:head# 2024-09-16T03:56:50.883 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f5ea65fc:::obj-fill-52:head# 2024-09-16T03:56:50.883 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f642de6b:::obj-fill-204:head# 2024-09-16T03:56:50.883 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f716eafd:::obj-fill-502:head# 2024-09-16T03:56:50.884 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f752e9cb:::obj-fill-23:head# 2024-09-16T03:56:50.884 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f85fe42c:::obj-fill-346:head# 2024-09-16T03:56:50.884 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:f882fd3b:::obj-fill-355:head# 2024-09-16T03:56:50.884 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:fa133332:::obj-fill-309:head# 2024-09-16T03:56:50.885 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:fa875e52:::obj-fill-64:head# 2024-09-16T03:56:50.885 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:fad91a22:::obj-fill-481:head# 2024-09-16T03:56:50.886 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:fbbc3122:::obj-fill-111:head# 2024-09-16T03:56:50.886 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:fc539ddb:::obj-fill-181:head# 2024-09-16T03:56:50.886 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:fc54128d:::obj-fill-104:head# 2024-09-16T03:56:50.887 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:fe00aded:::obj-fill-365:head# 2024-09-16T03:56:50.888 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:fe1e9971:::obj-fill-189:head# 2024-09-16T03:56:50.888 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ff0e0563:::obj-fill-508:head# 2024-09-16T03:56:50.888 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ff4e156c:::obj-fill-441:head# 2024-09-16T03:56:50.888 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:ffa355f7:::obj-fill-500:head# 2024-09-16T03:56:50.889 INFO:tasks.workunit.client.0.smithi026.stderr:Read #1:fff6c93b:::obj-fill-277:head# 2024-09-16T03:56:50.889 INFO:tasks.workunit.client.0.smithi026.stderr:Export successful 2024-09-16T03:56:50.890 INFO:tasks.workunit.client.0.smithi026.stdout: marking collection for removal 2024-09-16T03:56:50.890 INFO:tasks.workunit.client.0.smithi026.stdout:setting '_remove' omap key 2024-09-16T03:56:50.890 INFO:tasks.workunit.client.0.smithi026.stdout:finish_remove_pgs 1.0_head removing 1.0 2024-09-16T03:56:51.686 INFO:tasks.workunit.client.0.smithi026.stderr:Remove successful 2024-09-16T03:56:52.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:478: TEST_backfill_multi_partial: activate_osd td/osd-backfill-space 1 2024-09-16T03:56:52.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-backfill-space 2024-09-16T03:56:52.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T03:56:52.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2024-09-16T03:56:52.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T03:56:52.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-backfill-space/1 2024-09-16T03:56:52.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:56:52.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:56:52.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:56:52.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:56:52.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-09-16T03:56:52.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-09-16T03:56:52.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T03:56:52.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:56:52.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:56:52.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:56:52.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:56:52.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T03:56:52.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T03:56:52.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-backfill-space/1 2024-09-16T03:56:52.160 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T03:56:52.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2024-09-16T03:56:52.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:56:52.161 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-backfill-space/1/whoami 2024-09-16T03:56:52.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2024-09-16T03:56:52.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T03:56:52.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T03:56:52.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T03:56:52.197 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:56:52.195+0000 7fe825215640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:56:52.199 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:56:52.197+0000 7fe825215640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:56:52.200 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:56:52.198+0000 7fe825215640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:56:52.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2024-09-16T03:56:52.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:56:52.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T03:56:52.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:56:52.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:56:52.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:52.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:56:52.602 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T03:56:52.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:52.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:56:53.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:53.564 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:56:53.562+0000 7fe825215640 -1 Falling back to public interface 2024-09-16T03:56:54.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:54.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:54.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:56:54.017 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T03:56:54.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:54.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:56:54.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:55.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:55.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:55.472 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T03:56:55.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:56:55.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:55.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:56:55.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:56:56.433 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:56:56.431+0000 7fe825215640 -1 osd.1 36 log_to_monitors true 2024-09-16T03:56:56.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:56:56.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:56:56.922 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T03:56:56.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:56:56.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:56:56.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T03:56:57.364 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up out weight 0 up_from 42 up_thru 33 down_at 37 last_clean_interval [10,36) [v2:127.0.0.1:6810/1051002238,v1:127.0.0.1:6811/1051002238] [v2:127.0.0.1:6812/1051002238,v1:127.0.0.1:6813/1051002238] exists,up c7947f11-e894-41de-b15f-a5c3658a4a1f 2024-09-16T03:56:57.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:56:57.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:56:57.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:56:57.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:480: TEST_backfill_multi_partial: ceph pg dump pgs 2024-09-16T03:56:57.756 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T03:56:57.756 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:56:49.661290+0000 0'0 40:25 [2,0] 2 [2,0] 2 0'0 2024-09-16T03:55:47.162674+0000 0'0 2024-09-16T03:55:47.162674+0000 0 0 periodic scrub scheduled @ 2024-09-17T05:13:09.729710+0000 0 0 2024-09-16T03:56:57.756 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:56:49.661566+0000 0'0 40:49 [2,0] 2 [2,0] 2 0'0 2024-09-16T03:55:44.259994+0000 0'0 2024-09-16T03:55:44.259994+0000 0 0 periodic scrub scheduled @ 2024-09-17T15:35:32.164195+0000 0 0 2024-09-16T03:56:57.756 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 564 0 0 0 0 1472604 0 0 64 500 64 stale+active+clean 2024-09-16T03:55:44.048735+0000 36'564 36:606 [1] 1 [1] 1 0'0 2024-09-16T03:55:41.373963+0000 0'0 2024-09-16T03:55:41.373963+0000 0 0 periodic scrub scheduled @ 2024-09-17T04:23:26.138883+0000 0 0 2024-09-16T03:56:57.756 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T03:56:57.756 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T03:56:57.756 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:56:57.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:482: TEST_backfill_multi_partial: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=1 2024-09-16T03:56:57.768 INFO:tasks.workunit.client.0.smithi026.stderr:1+0 records in 2024-09-16T03:56:57.768 INFO:tasks.workunit.client.0.smithi026.stderr:1+0 records out 2024-09-16T03:56:57.768 INFO:tasks.workunit.client.0.smithi026.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 7.4844e-05 s, 13.7 MB/s 2024-09-16T03:56:57.768 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: seq 1 600 2024-09-16T03:56:57.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:57.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-1 td/osd-backfill-space/datafile 2024-09-16T03:56:57.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:57.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-2 td/osd-backfill-space/datafile 2024-09-16T03:56:58.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:58.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-3 td/osd-backfill-space/datafile 2024-09-16T03:56:58.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:58.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-4 td/osd-backfill-space/datafile 2024-09-16T03:56:58.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:58.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-5 td/osd-backfill-space/datafile 2024-09-16T03:56:58.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:58.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-6 td/osd-backfill-space/datafile 2024-09-16T03:56:58.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:58.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-7 td/osd-backfill-space/datafile 2024-09-16T03:56:58.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:58.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-8 td/osd-backfill-space/datafile 2024-09-16T03:56:58.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:58.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-9 td/osd-backfill-space/datafile 2024-09-16T03:56:59.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:59.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-10 td/osd-backfill-space/datafile 2024-09-16T03:56:59.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:59.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-11 td/osd-backfill-space/datafile 2024-09-16T03:56:59.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:59.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-12 td/osd-backfill-space/datafile 2024-09-16T03:56:59.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:59.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-13 td/osd-backfill-space/datafile 2024-09-16T03:56:59.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:59.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-14 td/osd-backfill-space/datafile 2024-09-16T03:56:59.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:59.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-15 td/osd-backfill-space/datafile 2024-09-16T03:56:59.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:59.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-16 td/osd-backfill-space/datafile 2024-09-16T03:56:59.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:56:59.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-17 td/osd-backfill-space/datafile 2024-09-16T03:57:00.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:00.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-18 td/osd-backfill-space/datafile 2024-09-16T03:57:00.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:00.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-19 td/osd-backfill-space/datafile 2024-09-16T03:57:00.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:00.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-20 td/osd-backfill-space/datafile 2024-09-16T03:57:00.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:00.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-21 td/osd-backfill-space/datafile 2024-09-16T03:57:00.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:00.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-22 td/osd-backfill-space/datafile 2024-09-16T03:57:00.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:00.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-23 td/osd-backfill-space/datafile 2024-09-16T03:57:00.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:00.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-24 td/osd-backfill-space/datafile 2024-09-16T03:57:01.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:01.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-25 td/osd-backfill-space/datafile 2024-09-16T03:57:01.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:01.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-26 td/osd-backfill-space/datafile 2024-09-16T03:57:01.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:01.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-27 td/osd-backfill-space/datafile 2024-09-16T03:57:01.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:01.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-28 td/osd-backfill-space/datafile 2024-09-16T03:57:01.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:01.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-29 td/osd-backfill-space/datafile 2024-09-16T03:57:01.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:01.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-30 td/osd-backfill-space/datafile 2024-09-16T03:57:01.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:01.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-31 td/osd-backfill-space/datafile 2024-09-16T03:57:01.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:01.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-32 td/osd-backfill-space/datafile 2024-09-16T03:57:02.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:02.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-33 td/osd-backfill-space/datafile 2024-09-16T03:57:02.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:02.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-34 td/osd-backfill-space/datafile 2024-09-16T03:57:02.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:02.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-35 td/osd-backfill-space/datafile 2024-09-16T03:57:02.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:02.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-36 td/osd-backfill-space/datafile 2024-09-16T03:57:02.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:02.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-37 td/osd-backfill-space/datafile 2024-09-16T03:57:02.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:02.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-38 td/osd-backfill-space/datafile 2024-09-16T03:57:02.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:02.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-39 td/osd-backfill-space/datafile 2024-09-16T03:57:03.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:03.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-40 td/osd-backfill-space/datafile 2024-09-16T03:57:03.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:03.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-41 td/osd-backfill-space/datafile 2024-09-16T03:57:03.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:03.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-42 td/osd-backfill-space/datafile 2024-09-16T03:57:03.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:03.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-43 td/osd-backfill-space/datafile 2024-09-16T03:57:03.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:03.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-44 td/osd-backfill-space/datafile 2024-09-16T03:57:03.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:03.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-45 td/osd-backfill-space/datafile 2024-09-16T03:57:03.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:03.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-46 td/osd-backfill-space/datafile 2024-09-16T03:57:03.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:03.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-47 td/osd-backfill-space/datafile 2024-09-16T03:57:04.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:04.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-48 td/osd-backfill-space/datafile 2024-09-16T03:57:04.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:04.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-49 td/osd-backfill-space/datafile 2024-09-16T03:57:04.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:04.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-50 td/osd-backfill-space/datafile 2024-09-16T03:57:04.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:04.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-51 td/osd-backfill-space/datafile 2024-09-16T03:57:04.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:04.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-52 td/osd-backfill-space/datafile 2024-09-16T03:57:04.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:04.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-53 td/osd-backfill-space/datafile 2024-09-16T03:57:04.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:04.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-54 td/osd-backfill-space/datafile 2024-09-16T03:57:05.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:05.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-55 td/osd-backfill-space/datafile 2024-09-16T03:57:05.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:05.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-56 td/osd-backfill-space/datafile 2024-09-16T03:57:05.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:05.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-57 td/osd-backfill-space/datafile 2024-09-16T03:57:05.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:05.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-58 td/osd-backfill-space/datafile 2024-09-16T03:57:05.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:05.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-59 td/osd-backfill-space/datafile 2024-09-16T03:57:05.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:05.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-60 td/osd-backfill-space/datafile 2024-09-16T03:57:05.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:05.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-61 td/osd-backfill-space/datafile 2024-09-16T03:57:05.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:05.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-62 td/osd-backfill-space/datafile 2024-09-16T03:57:06.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:06.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile 2024-09-16T03:57:06.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:06.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-64 td/osd-backfill-space/datafile 2024-09-16T03:57:06.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:06.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-65 td/osd-backfill-space/datafile 2024-09-16T03:57:06.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:06.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-66 td/osd-backfill-space/datafile 2024-09-16T03:57:06.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:06.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-67 td/osd-backfill-space/datafile 2024-09-16T03:57:06.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:06.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-68 td/osd-backfill-space/datafile 2024-09-16T03:57:06.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:06.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-69 td/osd-backfill-space/datafile 2024-09-16T03:57:07.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:07.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-70 td/osd-backfill-space/datafile 2024-09-16T03:57:07.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:07.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-71 td/osd-backfill-space/datafile 2024-09-16T03:57:07.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:07.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-72 td/osd-backfill-space/datafile 2024-09-16T03:57:07.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:07.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-73 td/osd-backfill-space/datafile 2024-09-16T03:57:07.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:07.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-74 td/osd-backfill-space/datafile 2024-09-16T03:57:07.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:07.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-75 td/osd-backfill-space/datafile 2024-09-16T03:57:07.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:07.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-76 td/osd-backfill-space/datafile 2024-09-16T03:57:07.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:07.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-77 td/osd-backfill-space/datafile 2024-09-16T03:57:08.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:08.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-78 td/osd-backfill-space/datafile 2024-09-16T03:57:08.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:08.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-79 td/osd-backfill-space/datafile 2024-09-16T03:57:08.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:08.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile 2024-09-16T03:57:08.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:08.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-81 td/osd-backfill-space/datafile 2024-09-16T03:57:08.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:08.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-82 td/osd-backfill-space/datafile 2024-09-16T03:57:08.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:08.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-83 td/osd-backfill-space/datafile 2024-09-16T03:57:08.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:08.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-84 td/osd-backfill-space/datafile 2024-09-16T03:57:09.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:09.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-85 td/osd-backfill-space/datafile 2024-09-16T03:57:09.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:09.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-86 td/osd-backfill-space/datafile 2024-09-16T03:57:09.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:09.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-87 td/osd-backfill-space/datafile 2024-09-16T03:57:09.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:09.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-88 td/osd-backfill-space/datafile 2024-09-16T03:57:09.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:09.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-89 td/osd-backfill-space/datafile 2024-09-16T03:57:09.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:09.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-90 td/osd-backfill-space/datafile 2024-09-16T03:57:09.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:09.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-91 td/osd-backfill-space/datafile 2024-09-16T03:57:09.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:09.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-92 td/osd-backfill-space/datafile 2024-09-16T03:57:10.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:10.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-93 td/osd-backfill-space/datafile 2024-09-16T03:57:10.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:10.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-94 td/osd-backfill-space/datafile 2024-09-16T03:57:10.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:10.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-95 td/osd-backfill-space/datafile 2024-09-16T03:57:10.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:10.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-96 td/osd-backfill-space/datafile 2024-09-16T03:57:10.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:10.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2024-09-16T03:57:10.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:10.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-98 td/osd-backfill-space/datafile 2024-09-16T03:57:10.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:10.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-99 td/osd-backfill-space/datafile 2024-09-16T03:57:11.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:11.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-100 td/osd-backfill-space/datafile 2024-09-16T03:57:11.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:11.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-101 td/osd-backfill-space/datafile 2024-09-16T03:57:11.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:11.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-102 td/osd-backfill-space/datafile 2024-09-16T03:57:11.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:11.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-103 td/osd-backfill-space/datafile 2024-09-16T03:57:11.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:11.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-104 td/osd-backfill-space/datafile 2024-09-16T03:57:11.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:11.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-105 td/osd-backfill-space/datafile 2024-09-16T03:57:11.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:11.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-106 td/osd-backfill-space/datafile 2024-09-16T03:57:11.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:11.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-107 td/osd-backfill-space/datafile 2024-09-16T03:57:12.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:12.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-108 td/osd-backfill-space/datafile 2024-09-16T03:57:12.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:12.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-109 td/osd-backfill-space/datafile 2024-09-16T03:57:12.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:12.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-110 td/osd-backfill-space/datafile 2024-09-16T03:57:12.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:12.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-111 td/osd-backfill-space/datafile 2024-09-16T03:57:12.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:12.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-112 td/osd-backfill-space/datafile 2024-09-16T03:57:12.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:12.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-113 td/osd-backfill-space/datafile 2024-09-16T03:57:12.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:12.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-114 td/osd-backfill-space/datafile 2024-09-16T03:57:13.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:13.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-115 td/osd-backfill-space/datafile 2024-09-16T03:57:13.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:13.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-116 td/osd-backfill-space/datafile 2024-09-16T03:57:13.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:13.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-117 td/osd-backfill-space/datafile 2024-09-16T03:57:13.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:13.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-118 td/osd-backfill-space/datafile 2024-09-16T03:57:13.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:13.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-119 td/osd-backfill-space/datafile 2024-09-16T03:57:13.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:13.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-120 td/osd-backfill-space/datafile 2024-09-16T03:57:13.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:13.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-121 td/osd-backfill-space/datafile 2024-09-16T03:57:13.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:13.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-122 td/osd-backfill-space/datafile 2024-09-16T03:57:14.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:14.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-123 td/osd-backfill-space/datafile 2024-09-16T03:57:14.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:14.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-124 td/osd-backfill-space/datafile 2024-09-16T03:57:14.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:14.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-125 td/osd-backfill-space/datafile 2024-09-16T03:57:14.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:14.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-126 td/osd-backfill-space/datafile 2024-09-16T03:57:14.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:14.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-127 td/osd-backfill-space/datafile 2024-09-16T03:57:14.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:14.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-128 td/osd-backfill-space/datafile 2024-09-16T03:57:14.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:14.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-129 td/osd-backfill-space/datafile 2024-09-16T03:57:14.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:14.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-130 td/osd-backfill-space/datafile 2024-09-16T03:57:15.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:15.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-131 td/osd-backfill-space/datafile 2024-09-16T03:57:15.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:15.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-132 td/osd-backfill-space/datafile 2024-09-16T03:57:15.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:15.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-133 td/osd-backfill-space/datafile 2024-09-16T03:57:15.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:15.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-134 td/osd-backfill-space/datafile 2024-09-16T03:57:15.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:15.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-135 td/osd-backfill-space/datafile 2024-09-16T03:57:15.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:15.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-136 td/osd-backfill-space/datafile 2024-09-16T03:57:15.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:15.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-137 td/osd-backfill-space/datafile 2024-09-16T03:57:15.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:15.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-138 td/osd-backfill-space/datafile 2024-09-16T03:57:16.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:16.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-139 td/osd-backfill-space/datafile 2024-09-16T03:57:16.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:16.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-140 td/osd-backfill-space/datafile 2024-09-16T03:57:16.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:16.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-141 td/osd-backfill-space/datafile 2024-09-16T03:57:16.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:16.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-142 td/osd-backfill-space/datafile 2024-09-16T03:57:16.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:16.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-143 td/osd-backfill-space/datafile 2024-09-16T03:57:16.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:16.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-144 td/osd-backfill-space/datafile 2024-09-16T03:57:16.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:16.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-145 td/osd-backfill-space/datafile 2024-09-16T03:57:17.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:17.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-146 td/osd-backfill-space/datafile 2024-09-16T03:57:17.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:17.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-147 td/osd-backfill-space/datafile 2024-09-16T03:57:17.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:17.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-148 td/osd-backfill-space/datafile 2024-09-16T03:57:17.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:17.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-149 td/osd-backfill-space/datafile 2024-09-16T03:57:17.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:17.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-150 td/osd-backfill-space/datafile 2024-09-16T03:57:17.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:17.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-151 td/osd-backfill-space/datafile 2024-09-16T03:57:17.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:17.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-152 td/osd-backfill-space/datafile 2024-09-16T03:57:17.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:17.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-153 td/osd-backfill-space/datafile 2024-09-16T03:57:18.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:18.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-154 td/osd-backfill-space/datafile 2024-09-16T03:57:18.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:18.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-155 td/osd-backfill-space/datafile 2024-09-16T03:57:18.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:18.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-156 td/osd-backfill-space/datafile 2024-09-16T03:57:18.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:18.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-157 td/osd-backfill-space/datafile 2024-09-16T03:57:18.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:18.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-158 td/osd-backfill-space/datafile 2024-09-16T03:57:18.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:18.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-159 td/osd-backfill-space/datafile 2024-09-16T03:57:18.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:18.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-160 td/osd-backfill-space/datafile 2024-09-16T03:57:18.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:18.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-161 td/osd-backfill-space/datafile 2024-09-16T03:57:19.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:19.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-162 td/osd-backfill-space/datafile 2024-09-16T03:57:19.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:19.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-163 td/osd-backfill-space/datafile 2024-09-16T03:57:19.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:19.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile 2024-09-16T03:57:19.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:19.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-165 td/osd-backfill-space/datafile 2024-09-16T03:57:19.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:19.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-166 td/osd-backfill-space/datafile 2024-09-16T03:57:19.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:19.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-167 td/osd-backfill-space/datafile 2024-09-16T03:57:19.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:19.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-168 td/osd-backfill-space/datafile 2024-09-16T03:57:20.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:20.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-169 td/osd-backfill-space/datafile 2024-09-16T03:57:20.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:20.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-170 td/osd-backfill-space/datafile 2024-09-16T03:57:20.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:20.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-171 td/osd-backfill-space/datafile 2024-09-16T03:57:20.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:20.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-172 td/osd-backfill-space/datafile 2024-09-16T03:57:20.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:20.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-173 td/osd-backfill-space/datafile 2024-09-16T03:57:21.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:21.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-174 td/osd-backfill-space/datafile 2024-09-16T03:57:21.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:21.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-175 td/osd-backfill-space/datafile 2024-09-16T03:57:21.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:21.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-176 td/osd-backfill-space/datafile 2024-09-16T03:57:21.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:21.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-177 td/osd-backfill-space/datafile 2024-09-16T03:57:21.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:21.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-178 td/osd-backfill-space/datafile 2024-09-16T03:57:21.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:21.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-179 td/osd-backfill-space/datafile 2024-09-16T03:57:21.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:21.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-180 td/osd-backfill-space/datafile 2024-09-16T03:57:21.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:21.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile 2024-09-16T03:57:22.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:22.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-182 td/osd-backfill-space/datafile 2024-09-16T03:57:22.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:22.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-183 td/osd-backfill-space/datafile 2024-09-16T03:57:22.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:22.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-184 td/osd-backfill-space/datafile 2024-09-16T03:57:22.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:22.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-185 td/osd-backfill-space/datafile 2024-09-16T03:57:22.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:22.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-186 td/osd-backfill-space/datafile 2024-09-16T03:57:22.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:22.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-187 td/osd-backfill-space/datafile 2024-09-16T03:57:22.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:22.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-188 td/osd-backfill-space/datafile 2024-09-16T03:57:23.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:23.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-189 td/osd-backfill-space/datafile 2024-09-16T03:57:23.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:23.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-190 td/osd-backfill-space/datafile 2024-09-16T03:57:23.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:23.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-191 td/osd-backfill-space/datafile 2024-09-16T03:57:23.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:23.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-192 td/osd-backfill-space/datafile 2024-09-16T03:57:23.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:23.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-193 td/osd-backfill-space/datafile 2024-09-16T03:57:23.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:23.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-194 td/osd-backfill-space/datafile 2024-09-16T03:57:23.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:23.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-195 td/osd-backfill-space/datafile 2024-09-16T03:57:23.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:23.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-196 td/osd-backfill-space/datafile 2024-09-16T03:57:24.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:24.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-197 td/osd-backfill-space/datafile 2024-09-16T03:57:24.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:24.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2024-09-16T03:57:24.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:24.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-199 td/osd-backfill-space/datafile 2024-09-16T03:57:24.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:24.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-200 td/osd-backfill-space/datafile 2024-09-16T03:57:24.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:24.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-201 td/osd-backfill-space/datafile 2024-09-16T03:57:24.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:24.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-202 td/osd-backfill-space/datafile 2024-09-16T03:57:24.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:24.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-203 td/osd-backfill-space/datafile 2024-09-16T03:57:24.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:24.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-204 td/osd-backfill-space/datafile 2024-09-16T03:57:25.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:25.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-205 td/osd-backfill-space/datafile 2024-09-16T03:57:25.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:25.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-206 td/osd-backfill-space/datafile 2024-09-16T03:57:25.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:25.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-207 td/osd-backfill-space/datafile 2024-09-16T03:57:25.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:25.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-208 td/osd-backfill-space/datafile 2024-09-16T03:57:25.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:25.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-209 td/osd-backfill-space/datafile 2024-09-16T03:57:25.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:25.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-210 td/osd-backfill-space/datafile 2024-09-16T03:57:25.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:25.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-211 td/osd-backfill-space/datafile 2024-09-16T03:57:26.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:26.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-212 td/osd-backfill-space/datafile 2024-09-16T03:57:26.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:26.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-213 td/osd-backfill-space/datafile 2024-09-16T03:57:26.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:26.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-214 td/osd-backfill-space/datafile 2024-09-16T03:57:26.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:26.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-215 td/osd-backfill-space/datafile 2024-09-16T03:57:26.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:26.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-216 td/osd-backfill-space/datafile 2024-09-16T03:57:26.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:26.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-217 td/osd-backfill-space/datafile 2024-09-16T03:57:26.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:26.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-218 td/osd-backfill-space/datafile 2024-09-16T03:57:27.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:27.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-219 td/osd-backfill-space/datafile 2024-09-16T03:57:27.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:27.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-220 td/osd-backfill-space/datafile 2024-09-16T03:57:27.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:27.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-221 td/osd-backfill-space/datafile 2024-09-16T03:57:27.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:27.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-222 td/osd-backfill-space/datafile 2024-09-16T03:57:27.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:27.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-223 td/osd-backfill-space/datafile 2024-09-16T03:57:27.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:27.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-224 td/osd-backfill-space/datafile 2024-09-16T03:57:27.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:27.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-225 td/osd-backfill-space/datafile 2024-09-16T03:57:27.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:27.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-226 td/osd-backfill-space/datafile 2024-09-16T03:57:28.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:28.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-227 td/osd-backfill-space/datafile 2024-09-16T03:57:28.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:28.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-228 td/osd-backfill-space/datafile 2024-09-16T03:57:28.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:28.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-229 td/osd-backfill-space/datafile 2024-09-16T03:57:28.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:28.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-230 td/osd-backfill-space/datafile 2024-09-16T03:57:28.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:28.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-231 td/osd-backfill-space/datafile 2024-09-16T03:57:28.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:28.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-232 td/osd-backfill-space/datafile 2024-09-16T03:57:28.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:28.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-233 td/osd-backfill-space/datafile 2024-09-16T03:57:28.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:28.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-234 td/osd-backfill-space/datafile 2024-09-16T03:57:29.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:29.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-235 td/osd-backfill-space/datafile 2024-09-16T03:57:29.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:29.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-236 td/osd-backfill-space/datafile 2024-09-16T03:57:29.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:29.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-237 td/osd-backfill-space/datafile 2024-09-16T03:57:29.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:29.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-238 td/osd-backfill-space/datafile 2024-09-16T03:57:29.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:29.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-239 td/osd-backfill-space/datafile 2024-09-16T03:57:29.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:29.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-240 td/osd-backfill-space/datafile 2024-09-16T03:57:29.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:29.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-241 td/osd-backfill-space/datafile 2024-09-16T03:57:30.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:30.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-242 td/osd-backfill-space/datafile 2024-09-16T03:57:30.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:30.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-243 td/osd-backfill-space/datafile 2024-09-16T03:57:30.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:30.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-244 td/osd-backfill-space/datafile 2024-09-16T03:57:30.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:30.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-245 td/osd-backfill-space/datafile 2024-09-16T03:57:30.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:30.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-246 td/osd-backfill-space/datafile 2024-09-16T03:57:30.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:30.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-247 td/osd-backfill-space/datafile 2024-09-16T03:57:30.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:30.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-248 td/osd-backfill-space/datafile 2024-09-16T03:57:30.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:30.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-249 td/osd-backfill-space/datafile 2024-09-16T03:57:31.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:31.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-250 td/osd-backfill-space/datafile 2024-09-16T03:57:31.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:31.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-251 td/osd-backfill-space/datafile 2024-09-16T03:57:31.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:31.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-252 td/osd-backfill-space/datafile 2024-09-16T03:57:31.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:31.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-253 td/osd-backfill-space/datafile 2024-09-16T03:57:31.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:31.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-254 td/osd-backfill-space/datafile 2024-09-16T03:57:31.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:31.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-255 td/osd-backfill-space/datafile 2024-09-16T03:57:31.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:31.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-256 td/osd-backfill-space/datafile 2024-09-16T03:57:32.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:32.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-257 td/osd-backfill-space/datafile 2024-09-16T03:57:32.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:32.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-258 td/osd-backfill-space/datafile 2024-09-16T03:57:32.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:32.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-259 td/osd-backfill-space/datafile 2024-09-16T03:57:32.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:32.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-260 td/osd-backfill-space/datafile 2024-09-16T03:57:32.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:32.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-261 td/osd-backfill-space/datafile 2024-09-16T03:57:32.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:32.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-262 td/osd-backfill-space/datafile 2024-09-16T03:57:32.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:32.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-263 td/osd-backfill-space/datafile 2024-09-16T03:57:32.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:32.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-264 td/osd-backfill-space/datafile 2024-09-16T03:57:33.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:33.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile 2024-09-16T03:57:33.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:33.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-266 td/osd-backfill-space/datafile 2024-09-16T03:57:33.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:33.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-267 td/osd-backfill-space/datafile 2024-09-16T03:57:33.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:33.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-268 td/osd-backfill-space/datafile 2024-09-16T03:57:33.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:33.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-269 td/osd-backfill-space/datafile 2024-09-16T03:57:33.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:33.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-270 td/osd-backfill-space/datafile 2024-09-16T03:57:33.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:33.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-271 td/osd-backfill-space/datafile 2024-09-16T03:57:33.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:33.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-272 td/osd-backfill-space/datafile 2024-09-16T03:57:34.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:34.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-273 td/osd-backfill-space/datafile 2024-09-16T03:57:34.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:34.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-274 td/osd-backfill-space/datafile 2024-09-16T03:57:34.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:34.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-275 td/osd-backfill-space/datafile 2024-09-16T03:57:34.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:34.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-276 td/osd-backfill-space/datafile 2024-09-16T03:57:34.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:34.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-277 td/osd-backfill-space/datafile 2024-09-16T03:57:34.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:34.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-278 td/osd-backfill-space/datafile 2024-09-16T03:57:34.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:34.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-279 td/osd-backfill-space/datafile 2024-09-16T03:57:34.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:34.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-280 td/osd-backfill-space/datafile 2024-09-16T03:57:35.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:35.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-281 td/osd-backfill-space/datafile 2024-09-16T03:57:35.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:35.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile 2024-09-16T03:57:35.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:35.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-283 td/osd-backfill-space/datafile 2024-09-16T03:57:35.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:35.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-284 td/osd-backfill-space/datafile 2024-09-16T03:57:35.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:35.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-285 td/osd-backfill-space/datafile 2024-09-16T03:57:35.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:35.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-286 td/osd-backfill-space/datafile 2024-09-16T03:57:35.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:35.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-287 td/osd-backfill-space/datafile 2024-09-16T03:57:36.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:36.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-288 td/osd-backfill-space/datafile 2024-09-16T03:57:36.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:36.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-289 td/osd-backfill-space/datafile 2024-09-16T03:57:36.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:36.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-290 td/osd-backfill-space/datafile 2024-09-16T03:57:36.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:36.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-291 td/osd-backfill-space/datafile 2024-09-16T03:57:36.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:36.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-292 td/osd-backfill-space/datafile 2024-09-16T03:57:36.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:36.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-293 td/osd-backfill-space/datafile 2024-09-16T03:57:36.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:36.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-294 td/osd-backfill-space/datafile 2024-09-16T03:57:37.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:37.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-295 td/osd-backfill-space/datafile 2024-09-16T03:57:37.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:37.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-296 td/osd-backfill-space/datafile 2024-09-16T03:57:37.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:37.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-297 td/osd-backfill-space/datafile 2024-09-16T03:57:37.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:37.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-298 td/osd-backfill-space/datafile 2024-09-16T03:57:37.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:37.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2024-09-16T03:57:37.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:37.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-300 td/osd-backfill-space/datafile 2024-09-16T03:57:37.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:37.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-301 td/osd-backfill-space/datafile 2024-09-16T03:57:37.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:37.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-302 td/osd-backfill-space/datafile 2024-09-16T03:57:38.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:38.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-303 td/osd-backfill-space/datafile 2024-09-16T03:57:38.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:38.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-304 td/osd-backfill-space/datafile 2024-09-16T03:57:38.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:38.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-305 td/osd-backfill-space/datafile 2024-09-16T03:57:38.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:38.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-306 td/osd-backfill-space/datafile 2024-09-16T03:57:38.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:38.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-307 td/osd-backfill-space/datafile 2024-09-16T03:57:38.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:38.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-308 td/osd-backfill-space/datafile 2024-09-16T03:57:38.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:38.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-309 td/osd-backfill-space/datafile 2024-09-16T03:57:38.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:39.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-310 td/osd-backfill-space/datafile 2024-09-16T03:57:39.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:39.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-311 td/osd-backfill-space/datafile 2024-09-16T03:57:39.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:39.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-312 td/osd-backfill-space/datafile 2024-09-16T03:57:39.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:39.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-313 td/osd-backfill-space/datafile 2024-09-16T03:57:39.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:39.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-314 td/osd-backfill-space/datafile 2024-09-16T03:57:39.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:39.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-315 td/osd-backfill-space/datafile 2024-09-16T03:57:39.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:39.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-316 td/osd-backfill-space/datafile 2024-09-16T03:57:39.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:39.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-317 td/osd-backfill-space/datafile 2024-09-16T03:57:40.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-318 td/osd-backfill-space/datafile 2024-09-16T03:57:40.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:40.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-319 td/osd-backfill-space/datafile 2024-09-16T03:57:40.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:40.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-320 td/osd-backfill-space/datafile 2024-09-16T03:57:40.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:40.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-321 td/osd-backfill-space/datafile 2024-09-16T03:57:40.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:40.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-322 td/osd-backfill-space/datafile 2024-09-16T03:57:40.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:40.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-323 td/osd-backfill-space/datafile 2024-09-16T03:57:40.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:40.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-324 td/osd-backfill-space/datafile 2024-09-16T03:57:40.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:40.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-325 td/osd-backfill-space/datafile 2024-09-16T03:57:41.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:41.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-326 td/osd-backfill-space/datafile 2024-09-16T03:57:41.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:41.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-327 td/osd-backfill-space/datafile 2024-09-16T03:57:41.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:41.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-328 td/osd-backfill-space/datafile 2024-09-16T03:57:41.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:41.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-329 td/osd-backfill-space/datafile 2024-09-16T03:57:41.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:41.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-330 td/osd-backfill-space/datafile 2024-09-16T03:57:41.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:41.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-331 td/osd-backfill-space/datafile 2024-09-16T03:57:41.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:41.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-332 td/osd-backfill-space/datafile 2024-09-16T03:57:42.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:42.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-333 td/osd-backfill-space/datafile 2024-09-16T03:57:42.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:42.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-334 td/osd-backfill-space/datafile 2024-09-16T03:57:42.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:42.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-335 td/osd-backfill-space/datafile 2024-09-16T03:57:42.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:42.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-336 td/osd-backfill-space/datafile 2024-09-16T03:57:42.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:42.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-337 td/osd-backfill-space/datafile 2024-09-16T03:57:42.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:42.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-338 td/osd-backfill-space/datafile 2024-09-16T03:57:42.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:42.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-339 td/osd-backfill-space/datafile 2024-09-16T03:57:43.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:43.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-340 td/osd-backfill-space/datafile 2024-09-16T03:57:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-341 td/osd-backfill-space/datafile 2024-09-16T03:57:43.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:43.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-342 td/osd-backfill-space/datafile 2024-09-16T03:57:43.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:43.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-343 td/osd-backfill-space/datafile 2024-09-16T03:57:43.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:43.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-344 td/osd-backfill-space/datafile 2024-09-16T03:57:43.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:43.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-345 td/osd-backfill-space/datafile 2024-09-16T03:57:43.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:43.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-346 td/osd-backfill-space/datafile 2024-09-16T03:57:43.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:43.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-347 td/osd-backfill-space/datafile 2024-09-16T03:57:44.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:44.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-348 td/osd-backfill-space/datafile 2024-09-16T03:57:44.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:44.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-349 td/osd-backfill-space/datafile 2024-09-16T03:57:44.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:44.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-350 td/osd-backfill-space/datafile 2024-09-16T03:57:44.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:44.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-351 td/osd-backfill-space/datafile 2024-09-16T03:57:44.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:44.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-352 td/osd-backfill-space/datafile 2024-09-16T03:57:44.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:44.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-353 td/osd-backfill-space/datafile 2024-09-16T03:57:44.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:44.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-354 td/osd-backfill-space/datafile 2024-09-16T03:57:45.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:45.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-355 td/osd-backfill-space/datafile 2024-09-16T03:57:45.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:45.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-356 td/osd-backfill-space/datafile 2024-09-16T03:57:45.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:45.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-357 td/osd-backfill-space/datafile 2024-09-16T03:57:45.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:45.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-358 td/osd-backfill-space/datafile 2024-09-16T03:57:45.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:45.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-359 td/osd-backfill-space/datafile 2024-09-16T03:57:45.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:45.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-360 td/osd-backfill-space/datafile 2024-09-16T03:57:45.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:45.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-361 td/osd-backfill-space/datafile 2024-09-16T03:57:45.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:45.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-362 td/osd-backfill-space/datafile 2024-09-16T03:57:46.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:46.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-363 td/osd-backfill-space/datafile 2024-09-16T03:57:46.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:46.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-364 td/osd-backfill-space/datafile 2024-09-16T03:57:46.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:46.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-365 td/osd-backfill-space/datafile 2024-09-16T03:57:46.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:46.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile 2024-09-16T03:57:46.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:46.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-367 td/osd-backfill-space/datafile 2024-09-16T03:57:46.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:46.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-368 td/osd-backfill-space/datafile 2024-09-16T03:57:46.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:46.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-369 td/osd-backfill-space/datafile 2024-09-16T03:57:47.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:47.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-370 td/osd-backfill-space/datafile 2024-09-16T03:57:47.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:47.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-371 td/osd-backfill-space/datafile 2024-09-16T03:57:47.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:47.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-372 td/osd-backfill-space/datafile 2024-09-16T03:57:47.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:47.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-373 td/osd-backfill-space/datafile 2024-09-16T03:57:47.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:47.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-374 td/osd-backfill-space/datafile 2024-09-16T03:57:47.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:47.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-375 td/osd-backfill-space/datafile 2024-09-16T03:57:47.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:47.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-376 td/osd-backfill-space/datafile 2024-09-16T03:57:47.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:47.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-377 td/osd-backfill-space/datafile 2024-09-16T03:57:48.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:48.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-378 td/osd-backfill-space/datafile 2024-09-16T03:57:48.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:48.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-379 td/osd-backfill-space/datafile 2024-09-16T03:57:48.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:48.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-380 td/osd-backfill-space/datafile 2024-09-16T03:57:48.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:48.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-381 td/osd-backfill-space/datafile 2024-09-16T03:57:48.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:48.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-382 td/osd-backfill-space/datafile 2024-09-16T03:57:48.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:48.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile 2024-09-16T03:57:48.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:48.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-384 td/osd-backfill-space/datafile 2024-09-16T03:57:49.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:49.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-385 td/osd-backfill-space/datafile 2024-09-16T03:57:49.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:49.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-386 td/osd-backfill-space/datafile 2024-09-16T03:57:49.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:49.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-387 td/osd-backfill-space/datafile 2024-09-16T03:57:49.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:49.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-388 td/osd-backfill-space/datafile 2024-09-16T03:57:49.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:49.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-389 td/osd-backfill-space/datafile 2024-09-16T03:57:49.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:49.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-390 td/osd-backfill-space/datafile 2024-09-16T03:57:49.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:49.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-391 td/osd-backfill-space/datafile 2024-09-16T03:57:49.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:49.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-392 td/osd-backfill-space/datafile 2024-09-16T03:57:50.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:50.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-393 td/osd-backfill-space/datafile 2024-09-16T03:57:50.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:50.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-394 td/osd-backfill-space/datafile 2024-09-16T03:57:50.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:50.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-395 td/osd-backfill-space/datafile 2024-09-16T03:57:50.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:50.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-396 td/osd-backfill-space/datafile 2024-09-16T03:57:50.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:50.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-397 td/osd-backfill-space/datafile 2024-09-16T03:57:50.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:50.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-398 td/osd-backfill-space/datafile 2024-09-16T03:57:50.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:50.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-399 td/osd-backfill-space/datafile 2024-09-16T03:57:51.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:51.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2024-09-16T03:57:51.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:51.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-401 td/osd-backfill-space/datafile 2024-09-16T03:57:51.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:51.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-402 td/osd-backfill-space/datafile 2024-09-16T03:57:51.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:51.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-403 td/osd-backfill-space/datafile 2024-09-16T03:57:51.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:51.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-404 td/osd-backfill-space/datafile 2024-09-16T03:57:51.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:51.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-405 td/osd-backfill-space/datafile 2024-09-16T03:57:51.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:51.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-406 td/osd-backfill-space/datafile 2024-09-16T03:57:52.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:52.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-407 td/osd-backfill-space/datafile 2024-09-16T03:57:52.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:52.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-408 td/osd-backfill-space/datafile 2024-09-16T03:57:52.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:52.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-409 td/osd-backfill-space/datafile 2024-09-16T03:57:52.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:52.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-410 td/osd-backfill-space/datafile 2024-09-16T03:57:52.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:52.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-411 td/osd-backfill-space/datafile 2024-09-16T03:57:53.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:53.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-412 td/osd-backfill-space/datafile 2024-09-16T03:57:53.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:53.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-413 td/osd-backfill-space/datafile 2024-09-16T03:57:53.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:53.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-414 td/osd-backfill-space/datafile 2024-09-16T03:57:53.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:53.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-415 td/osd-backfill-space/datafile 2024-09-16T03:57:53.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:53.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-416 td/osd-backfill-space/datafile 2024-09-16T03:57:53.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:53.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-417 td/osd-backfill-space/datafile 2024-09-16T03:57:53.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:53.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-418 td/osd-backfill-space/datafile 2024-09-16T03:57:53.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:53.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-419 td/osd-backfill-space/datafile 2024-09-16T03:57:54.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:54.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-420 td/osd-backfill-space/datafile 2024-09-16T03:57:54.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:54.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-421 td/osd-backfill-space/datafile 2024-09-16T03:57:54.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:54.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-422 td/osd-backfill-space/datafile 2024-09-16T03:57:54.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:54.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-423 td/osd-backfill-space/datafile 2024-09-16T03:57:54.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:54.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-424 td/osd-backfill-space/datafile 2024-09-16T03:57:54.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:54.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-425 td/osd-backfill-space/datafile 2024-09-16T03:57:54.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:54.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-426 td/osd-backfill-space/datafile 2024-09-16T03:57:55.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:55.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-427 td/osd-backfill-space/datafile 2024-09-16T03:57:55.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:55.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-428 td/osd-backfill-space/datafile 2024-09-16T03:57:55.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:55.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-429 td/osd-backfill-space/datafile 2024-09-16T03:57:55.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:55.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-430 td/osd-backfill-space/datafile 2024-09-16T03:57:55.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:55.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-431 td/osd-backfill-space/datafile 2024-09-16T03:57:55.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:55.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-432 td/osd-backfill-space/datafile 2024-09-16T03:57:55.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:55.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-433 td/osd-backfill-space/datafile 2024-09-16T03:57:55.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:55.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-434 td/osd-backfill-space/datafile 2024-09-16T03:57:56.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:56.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-435 td/osd-backfill-space/datafile 2024-09-16T03:57:56.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:56.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-436 td/osd-backfill-space/datafile 2024-09-16T03:57:56.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:56.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-437 td/osd-backfill-space/datafile 2024-09-16T03:57:56.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:56.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-438 td/osd-backfill-space/datafile 2024-09-16T03:57:56.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:56.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-439 td/osd-backfill-space/datafile 2024-09-16T03:57:56.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:56.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-440 td/osd-backfill-space/datafile 2024-09-16T03:57:56.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:56.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-441 td/osd-backfill-space/datafile 2024-09-16T03:57:57.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:57.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-442 td/osd-backfill-space/datafile 2024-09-16T03:57:57.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:57.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-443 td/osd-backfill-space/datafile 2024-09-16T03:57:57.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:57.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-444 td/osd-backfill-space/datafile 2024-09-16T03:57:57.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:57.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-445 td/osd-backfill-space/datafile 2024-09-16T03:57:57.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:57.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-446 td/osd-backfill-space/datafile 2024-09-16T03:57:57.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:57.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-447 td/osd-backfill-space/datafile 2024-09-16T03:57:57.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:57.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-448 td/osd-backfill-space/datafile 2024-09-16T03:57:57.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:57.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-449 td/osd-backfill-space/datafile 2024-09-16T03:57:58.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:58.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-450 td/osd-backfill-space/datafile 2024-09-16T03:57:58.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:58.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-451 td/osd-backfill-space/datafile 2024-09-16T03:57:58.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:58.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-452 td/osd-backfill-space/datafile 2024-09-16T03:57:58.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:58.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-453 td/osd-backfill-space/datafile 2024-09-16T03:57:58.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:58.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-454 td/osd-backfill-space/datafile 2024-09-16T03:57:58.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:58.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-455 td/osd-backfill-space/datafile 2024-09-16T03:57:58.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:58.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-456 td/osd-backfill-space/datafile 2024-09-16T03:57:59.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:59.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-457 td/osd-backfill-space/datafile 2024-09-16T03:57:59.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:59.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-458 td/osd-backfill-space/datafile 2024-09-16T03:57:59.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:59.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-459 td/osd-backfill-space/datafile 2024-09-16T03:57:59.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:59.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-460 td/osd-backfill-space/datafile 2024-09-16T03:57:59.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:59.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-461 td/osd-backfill-space/datafile 2024-09-16T03:57:59.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:59.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-462 td/osd-backfill-space/datafile 2024-09-16T03:57:59.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:59.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-463 td/osd-backfill-space/datafile 2024-09-16T03:57:59.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:57:59.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-464 td/osd-backfill-space/datafile 2024-09-16T03:58:00.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:00.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-465 td/osd-backfill-space/datafile 2024-09-16T03:58:00.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:00.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-466 td/osd-backfill-space/datafile 2024-09-16T03:58:00.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:00.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile 2024-09-16T03:58:00.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:00.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-468 td/osd-backfill-space/datafile 2024-09-16T03:58:00.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:00.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-469 td/osd-backfill-space/datafile 2024-09-16T03:58:00.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:00.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-470 td/osd-backfill-space/datafile 2024-09-16T03:58:00.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:00.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-471 td/osd-backfill-space/datafile 2024-09-16T03:58:00.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:00.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-472 td/osd-backfill-space/datafile 2024-09-16T03:58:01.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:01.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-473 td/osd-backfill-space/datafile 2024-09-16T03:58:01.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:01.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-474 td/osd-backfill-space/datafile 2024-09-16T03:58:01.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:01.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-475 td/osd-backfill-space/datafile 2024-09-16T03:58:01.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:01.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-476 td/osd-backfill-space/datafile 2024-09-16T03:58:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-477 td/osd-backfill-space/datafile 2024-09-16T03:58:01.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:01.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-478 td/osd-backfill-space/datafile 2024-09-16T03:58:01.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:01.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-479 td/osd-backfill-space/datafile 2024-09-16T03:58:02.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:02.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-480 td/osd-backfill-space/datafile 2024-09-16T03:58:02.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:02.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-481 td/osd-backfill-space/datafile 2024-09-16T03:58:02.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:02.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-482 td/osd-backfill-space/datafile 2024-09-16T03:58:02.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:02.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-483 td/osd-backfill-space/datafile 2024-09-16T03:58:02.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:02.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile 2024-09-16T03:58:02.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:02.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-485 td/osd-backfill-space/datafile 2024-09-16T03:58:02.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:02.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-486 td/osd-backfill-space/datafile 2024-09-16T03:58:03.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:03.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-487 td/osd-backfill-space/datafile 2024-09-16T03:58:03.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:03.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-488 td/osd-backfill-space/datafile 2024-09-16T03:58:03.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:03.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-489 td/osd-backfill-space/datafile 2024-09-16T03:58:03.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:03.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-490 td/osd-backfill-space/datafile 2024-09-16T03:58:03.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:03.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-491 td/osd-backfill-space/datafile 2024-09-16T03:58:03.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:03.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-492 td/osd-backfill-space/datafile 2024-09-16T03:58:03.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:03.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-493 td/osd-backfill-space/datafile 2024-09-16T03:58:03.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:03.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-494 td/osd-backfill-space/datafile 2024-09-16T03:58:04.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:04.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-495 td/osd-backfill-space/datafile 2024-09-16T03:58:04.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:04.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-496 td/osd-backfill-space/datafile 2024-09-16T03:58:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-497 td/osd-backfill-space/datafile 2024-09-16T03:58:04.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:04.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-498 td/osd-backfill-space/datafile 2024-09-16T03:58:04.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:04.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-499 td/osd-backfill-space/datafile 2024-09-16T03:58:04.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:04.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-500 td/osd-backfill-space/datafile 2024-09-16T03:58:04.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:04.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2024-09-16T03:58:04.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:04.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-502 td/osd-backfill-space/datafile 2024-09-16T03:58:05.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:05.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-503 td/osd-backfill-space/datafile 2024-09-16T03:58:05.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:05.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-504 td/osd-backfill-space/datafile 2024-09-16T03:58:05.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:05.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-505 td/osd-backfill-space/datafile 2024-09-16T03:58:05.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:05.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-506 td/osd-backfill-space/datafile 2024-09-16T03:58:05.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:05.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-507 td/osd-backfill-space/datafile 2024-09-16T03:58:05.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:05.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-508 td/osd-backfill-space/datafile 2024-09-16T03:58:05.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:05.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-509 td/osd-backfill-space/datafile 2024-09-16T03:58:05.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:05.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-510 td/osd-backfill-space/datafile 2024-09-16T03:58:06.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:06.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-511 td/osd-backfill-space/datafile 2024-09-16T03:58:06.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:06.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-512 td/osd-backfill-space/datafile 2024-09-16T03:58:06.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:06.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-513 td/osd-backfill-space/datafile 2024-09-16T03:58:06.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:06.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-514 td/osd-backfill-space/datafile 2024-09-16T03:58:06.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:06.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-515 td/osd-backfill-space/datafile 2024-09-16T03:58:06.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:06.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-516 td/osd-backfill-space/datafile 2024-09-16T03:58:06.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:06.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-517 td/osd-backfill-space/datafile 2024-09-16T03:58:06.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:06.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-518 td/osd-backfill-space/datafile 2024-09-16T03:58:06.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:06.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-519 td/osd-backfill-space/datafile 2024-09-16T03:58:06.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:06.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-520 td/osd-backfill-space/datafile 2024-09-16T03:58:07.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:07.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-521 td/osd-backfill-space/datafile 2024-09-16T03:58:07.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:07.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-522 td/osd-backfill-space/datafile 2024-09-16T03:58:07.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:07.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-523 td/osd-backfill-space/datafile 2024-09-16T03:58:07.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:07.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-524 td/osd-backfill-space/datafile 2024-09-16T03:58:07.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:07.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-525 td/osd-backfill-space/datafile 2024-09-16T03:58:07.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:07.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-526 td/osd-backfill-space/datafile 2024-09-16T03:58:07.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:07.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-527 td/osd-backfill-space/datafile 2024-09-16T03:58:07.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:07.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-528 td/osd-backfill-space/datafile 2024-09-16T03:58:07.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:07.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-529 td/osd-backfill-space/datafile 2024-09-16T03:58:07.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:07.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-530 td/osd-backfill-space/datafile 2024-09-16T03:58:08.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:08.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-531 td/osd-backfill-space/datafile 2024-09-16T03:58:08.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:08.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-532 td/osd-backfill-space/datafile 2024-09-16T03:58:08.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:08.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-533 td/osd-backfill-space/datafile 2024-09-16T03:58:08.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:08.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-534 td/osd-backfill-space/datafile 2024-09-16T03:58:08.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:08.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-535 td/osd-backfill-space/datafile 2024-09-16T03:58:08.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:08.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-536 td/osd-backfill-space/datafile 2024-09-16T03:58:08.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:08.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-537 td/osd-backfill-space/datafile 2024-09-16T03:58:08.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:08.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-538 td/osd-backfill-space/datafile 2024-09-16T03:58:08.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:08.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-539 td/osd-backfill-space/datafile 2024-09-16T03:58:08.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:08.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-540 td/osd-backfill-space/datafile 2024-09-16T03:58:09.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:09.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-541 td/osd-backfill-space/datafile 2024-09-16T03:58:09.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:09.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-542 td/osd-backfill-space/datafile 2024-09-16T03:58:09.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:09.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-543 td/osd-backfill-space/datafile 2024-09-16T03:58:09.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:09.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-544 td/osd-backfill-space/datafile 2024-09-16T03:58:09.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:09.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-545 td/osd-backfill-space/datafile 2024-09-16T03:58:09.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:09.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-546 td/osd-backfill-space/datafile 2024-09-16T03:58:09.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:09.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-547 td/osd-backfill-space/datafile 2024-09-16T03:58:09.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:09.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-548 td/osd-backfill-space/datafile 2024-09-16T03:58:09.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:09.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-549 td/osd-backfill-space/datafile 2024-09-16T03:58:09.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:09.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-550 td/osd-backfill-space/datafile 2024-09-16T03:58:09.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:09.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-551 td/osd-backfill-space/datafile 2024-09-16T03:58:10.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:10.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-552 td/osd-backfill-space/datafile 2024-09-16T03:58:10.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:10.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-553 td/osd-backfill-space/datafile 2024-09-16T03:58:10.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:10.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-554 td/osd-backfill-space/datafile 2024-09-16T03:58:10.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:10.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-555 td/osd-backfill-space/datafile 2024-09-16T03:58:10.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:10.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-556 td/osd-backfill-space/datafile 2024-09-16T03:58:10.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:10.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-557 td/osd-backfill-space/datafile 2024-09-16T03:58:10.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:10.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-558 td/osd-backfill-space/datafile 2024-09-16T03:58:10.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:10.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-559 td/osd-backfill-space/datafile 2024-09-16T03:58:10.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:10.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-560 td/osd-backfill-space/datafile 2024-09-16T03:58:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-561 td/osd-backfill-space/datafile 2024-09-16T03:58:11.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:11.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-562 td/osd-backfill-space/datafile 2024-09-16T03:58:11.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:11.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-563 td/osd-backfill-space/datafile 2024-09-16T03:58:11.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:11.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-564 td/osd-backfill-space/datafile 2024-09-16T03:58:11.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:11.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-565 td/osd-backfill-space/datafile 2024-09-16T03:58:11.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:11.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-566 td/osd-backfill-space/datafile 2024-09-16T03:58:11.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:11.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-567 td/osd-backfill-space/datafile 2024-09-16T03:58:11.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:11.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile 2024-09-16T03:58:11.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:11.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-569 td/osd-backfill-space/datafile 2024-09-16T03:58:11.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:11.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-570 td/osd-backfill-space/datafile 2024-09-16T03:58:11.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:11.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-571 td/osd-backfill-space/datafile 2024-09-16T03:58:12.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:12.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-572 td/osd-backfill-space/datafile 2024-09-16T03:58:12.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:12.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-573 td/osd-backfill-space/datafile 2024-09-16T03:58:12.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:12.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-574 td/osd-backfill-space/datafile 2024-09-16T03:58:12.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:12.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-575 td/osd-backfill-space/datafile 2024-09-16T03:58:12.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:12.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-576 td/osd-backfill-space/datafile 2024-09-16T03:58:12.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:12.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-577 td/osd-backfill-space/datafile 2024-09-16T03:58:12.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:12.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-578 td/osd-backfill-space/datafile 2024-09-16T03:58:12.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:12.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-579 td/osd-backfill-space/datafile 2024-09-16T03:58:12.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:12.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-580 td/osd-backfill-space/datafile 2024-09-16T03:58:12.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:12.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-581 td/osd-backfill-space/datafile 2024-09-16T03:58:13.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:13.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-582 td/osd-backfill-space/datafile 2024-09-16T03:58:13.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:13.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-583 td/osd-backfill-space/datafile 2024-09-16T03:58:13.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:13.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-584 td/osd-backfill-space/datafile 2024-09-16T03:58:13.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:13.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile 2024-09-16T03:58:13.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:13.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-586 td/osd-backfill-space/datafile 2024-09-16T03:58:13.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:13.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-587 td/osd-backfill-space/datafile 2024-09-16T03:58:13.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:13.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-588 td/osd-backfill-space/datafile 2024-09-16T03:58:13.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:13.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-589 td/osd-backfill-space/datafile 2024-09-16T03:58:13.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:13.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-590 td/osd-backfill-space/datafile 2024-09-16T03:58:13.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:13.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-591 td/osd-backfill-space/datafile 2024-09-16T03:58:13.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:13.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-592 td/osd-backfill-space/datafile 2024-09-16T03:58:14.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:14.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-593 td/osd-backfill-space/datafile 2024-09-16T03:58:14.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:14.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-594 td/osd-backfill-space/datafile 2024-09-16T03:58:14.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:14.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-595 td/osd-backfill-space/datafile 2024-09-16T03:58:14.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:14.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-596 td/osd-backfill-space/datafile 2024-09-16T03:58:14.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:14.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-597 td/osd-backfill-space/datafile 2024-09-16T03:58:14.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:14.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-598 td/osd-backfill-space/datafile 2024-09-16T03:58:14.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:14.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-599 td/osd-backfill-space/datafile 2024-09-16T03:58:14.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:483: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:58:14.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:485: TEST_backfill_multi_partial: rados -p test1 put obj-1-600 td/osd-backfill-space/datafile 2024-09-16T03:58:14.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:488: TEST_backfill_multi_partial: ceph pg dump pgs 2024-09-16T03:58:15.282 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T03:58:15.282 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:56:49.661290+0000 0'0 42:29 [2,0] 2 [2,0] 2 0'0 2024-09-16T03:55:47.162674+0000 0'0 2024-09-16T03:55:47.162674+0000 0 0 periodic scrub scheduled @ 2024-09-17T05:13:09.729710+0000 0 0 2024-09-16T03:58:15.282 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 593 0 0 0 0 607232 0 0 93 500 93 active+clean 2024-09-16T03:56:49.661566+0000 42'593 42:647 [2,0] 2 [2,0] 2 0'0 2024-09-16T03:55:44.259994+0000 0'0 2024-09-16T03:55:44.259994+0000 0 0 periodic scrub scheduled @ 2024-09-17T15:35:32.164195+0000 0 0 2024-09-16T03:58:15.282 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 564 0 0 0 0 1472604 0 0 64 500 64 stale+active+clean 2024-09-16T03:55:44.048735+0000 36'564 36:606 [1] 1 [1] 1 0'0 2024-09-16T03:55:41.373963+0000 0'0 2024-09-16T03:55:41.373963+0000 0 0 periodic scrub scheduled @ 2024-09-17T04:23:26.138883+0000 0 0 2024-09-16T03:58:15.282 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T03:58:15.282 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T03:58:15.283 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:58:15.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:490: TEST_backfill_multi_partial: _objectstore_tool_nowait td/osd-backfill-space 2 --op export --pgid 2.0 --file td/osd-backfill-space/export.out 2024-09-16T03:58:15.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-backfill-space 2024-09-16T03:58:15.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2024-09-16T03:58:15.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2024-09-16T03:58:15.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2024-09-16T03:58:15.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-backfill-space TERM osd.2 2024-09-16T03:58:15.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T03:58:15.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T03:58:15.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T03:58:15.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T03:58:15.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T03:58:15.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T03:58:15.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-backfill-space 2 --op export --pgid 2.0 --file td/osd-backfill-space/export.out 2024-09-16T03:58:15.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2024-09-16T03:58:15.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2024-09-16T03:58:15.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2024-09-16T03:58:15.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2024-09-16T03:58:15.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/2 2024-09-16T03:58:15.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/2 --op export --pgid 2.0 --file td/osd-backfill-space/export.out 2024-09-16T03:58:16.115 INFO:tasks.workunit.client.0.smithi026.stderr:Exporting 2.0 info 2.0( v 42'600 (42'500,42'600] local-lis/les=39/40 n=600 ec=26/26 lis/c=39/39 les/c/f=40/40/0 sis=39) 2024-09-16T03:58:16.132 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:00f101c6:::obj-1-121:head# 2024-09-16T03:58:16.159 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0168051e:::obj-1-571:head# 2024-09-16T03:58:16.159 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:01b67738:::obj-1-182:head# 2024-09-16T03:58:16.160 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:040dbc59:::obj-1-23:head# 2024-09-16T03:58:16.161 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0415ce6e:::obj-1-20:head# 2024-09-16T03:58:16.161 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:058b28d7:::obj-1-572:head# 2024-09-16T03:58:16.161 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:059d2e5c:::obj-1-87:head# 2024-09-16T03:58:16.167 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:05a823ca:::obj-1-52:head# 2024-09-16T03:58:16.168 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:05b8b7fe:::obj-1-119:head# 2024-09-16T03:58:16.177 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:05c9492b:::obj-1-78:head# 2024-09-16T03:58:16.177 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:05e91e96:::obj-1-393:head# 2024-09-16T03:58:16.181 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:07bdb780:::obj-1-204:head# 2024-09-16T03:58:16.182 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:07cfbd49:::obj-1-318:head# 2024-09-16T03:58:16.183 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:084a829f:::obj-1-112:head# 2024-09-16T03:58:16.183 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:08cedd34:::obj-1-438:head# 2024-09-16T03:58:16.191 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0941af69:::obj-1-117:head# 2024-09-16T03:58:16.191 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:09607265:::obj-1-429:head# 2024-09-16T03:58:16.192 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0be86f7e:::obj-1-568:head# 2024-09-16T03:58:16.193 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0ca5819d:::obj-1-327:head# 2024-09-16T03:58:16.194 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0cd02051:::obj-1-208:head# 2024-09-16T03:58:16.194 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0d0264b5:::obj-1-171:head# 2024-09-16T03:58:16.194 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0d195060:::obj-1-420:head# 2024-09-16T03:58:16.194 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0d362b19:::obj-1-219:head# 2024-09-16T03:58:16.195 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0dea6f4d:::obj-1-61:head# 2024-09-16T03:58:16.195 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0ecd8390:::obj-1-132:head# 2024-09-16T03:58:16.195 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0f49e2fa:::obj-1-200:head# 2024-09-16T03:58:16.195 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0f7bb95f:::obj-1-268:head# 2024-09-16T03:58:16.196 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0fabf252:::obj-1-441:head# 2024-09-16T03:58:16.196 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:0fb1697a:::obj-1-443:head# 2024-09-16T03:58:16.196 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:105d3efe:::obj-1-490:head# 2024-09-16T03:58:16.200 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:10f52c01:::obj-1-449:head# 2024-09-16T03:58:16.201 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:11965425:::obj-1-335:head# 2024-09-16T03:58:16.202 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:11c9f5f8:::obj-1-565:head# 2024-09-16T03:58:16.202 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:11cfcfb6:::obj-1-588:head# 2024-09-16T03:58:16.203 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:11d46f0a:::obj-1-387:head# 2024-09-16T03:58:16.203 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:11ebb0d6:::obj-1-214:head# 2024-09-16T03:58:16.203 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1295e402:::obj-1-178:head# 2024-09-16T03:58:16.203 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:12c996c1:::obj-1-517:head# 2024-09-16T03:58:16.209 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:133dec15:::obj-1-475:head# 2024-09-16T03:58:16.210 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1475c981:::obj-1-505:head# 2024-09-16T03:58:16.211 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:148e92a4:::obj-1-509:head# 2024-09-16T03:58:16.211 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1490b121:::obj-1-172:head# 2024-09-16T03:58:16.211 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:14ce082c:::obj-1-99:head# 2024-09-16T03:58:16.212 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1552ad99:::obj-1-41:head# 2024-09-16T03:58:16.212 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:15544270:::obj-1-271:head# 2024-09-16T03:58:16.212 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1589d957:::obj-1-86:head# 2024-09-16T03:58:16.213 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:16db3947:::obj-1-477:head# 2024-09-16T03:58:16.213 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:16dc98bd:::obj-1-375:head# 2024-09-16T03:58:16.214 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:17e54db3:::obj-1-196:head# 2024-09-16T03:58:16.214 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:17f2ad3f:::obj-1-10:head# 2024-09-16T03:58:16.214 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:18075e41:::obj-1-55:head# 2024-09-16T03:58:16.214 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:18086253:::obj-1-71:head# 2024-09-16T03:58:16.214 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:191cf8d8:::obj-1-372:head# 2024-09-16T03:58:16.215 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:19311f70:::obj-1-454:head# 2024-09-16T03:58:16.216 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:198318e4:::obj-1-464:head# 2024-09-16T03:58:16.216 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1999d806:::obj-1-163:head# 2024-09-16T03:58:16.216 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1a92cab7:::obj-1-412:head# 2024-09-16T03:58:16.216 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1b16c0f6:::obj-1-210:head# 2024-09-16T03:58:16.216 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1b53ed46:::obj-1-577:head# 2024-09-16T03:58:16.216 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1b5c5a8d:::obj-1-556:head# 2024-09-16T03:58:16.218 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1c12c05e:::obj-1-79:head# 2024-09-16T03:58:16.219 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1c571ba5:::obj-1-262:head# 2024-09-16T03:58:16.219 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1c5f42b7:::obj-1-92:head# 2024-09-16T03:58:16.219 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1c6ad881:::obj-1-312:head# 2024-09-16T03:58:16.220 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1c89877b:::obj-1-142:head# 2024-09-16T03:58:16.220 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1e4168ca:::obj-1-282:head# 2024-09-16T03:58:16.220 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1e424445:::obj-1-484:head# 2024-09-16T03:58:16.221 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1e467959:::obj-1-22:head# 2024-09-16T03:58:16.221 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1eaf7e7c:::obj-1-392:head# 2024-09-16T03:58:16.222 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1f06c86d:::obj-1-307:head# 2024-09-16T03:58:16.222 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1f2ee1f8:::obj-1-306:head# 2024-09-16T03:58:16.223 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:1f4ef040:::obj-1-349:head# 2024-09-16T03:58:16.223 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2039481f:::obj-1-545:head# 2024-09-16T03:58:16.225 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:22233df0:::obj-1-543:head# 2024-09-16T03:58:16.225 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2225184e:::obj-1-266:head# 2024-09-16T03:58:16.225 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:234766bb:::obj-1-281:head# 2024-09-16T03:58:16.225 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2372e022:::obj-1-205:head# 2024-09-16T03:58:16.226 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2379547b:::obj-1-113:head# 2024-09-16T03:58:16.226 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:23ae14bf:::obj-1-531:head# 2024-09-16T03:58:16.227 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:23bc5f90:::obj-1-452:head# 2024-09-16T03:58:16.227 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:23fbef3d:::obj-1-82:head# 2024-09-16T03:58:16.227 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:24106c2b:::obj-1-232:head# 2024-09-16T03:58:16.227 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2529b4e4:::obj-1-75:head# 2024-09-16T03:58:16.228 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:25a24ae7:::obj-1-459:head# 2024-09-16T03:58:16.228 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:26627aa9:::obj-1-7:head# 2024-09-16T03:58:16.228 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:26b77221:::obj-1-227:head# 2024-09-16T03:58:16.228 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:27450826:::obj-1-344:head# 2024-09-16T03:58:16.229 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:278905af:::obj-1-592:head# 2024-09-16T03:58:16.229 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:27ad0d2d:::obj-1-136:head# 2024-09-16T03:58:16.229 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:28a8c213:::obj-1-118:head# 2024-09-16T03:58:16.230 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:28c0c009:::obj-1-74:head# 2024-09-16T03:58:16.230 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2a214708:::obj-1-260:head# 2024-09-16T03:58:16.230 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2a67e195:::obj-1-474:head# 2024-09-16T03:58:16.230 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2aa852ff:::obj-1-5:head# 2024-09-16T03:58:16.230 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2ba1fb52:::obj-1-563:head# 2024-09-16T03:58:16.231 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2bae8cb9:::obj-1-320:head# 2024-09-16T03:58:16.231 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2c569d02:::obj-1-139:head# 2024-09-16T03:58:16.232 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2c71d691:::obj-1-201:head# 2024-09-16T03:58:16.232 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2c88e92c:::obj-1-389:head# 2024-09-16T03:58:16.232 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2d659109:::obj-1-580:head# 2024-09-16T03:58:16.233 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2d74ea60:::obj-1-230:head# 2024-09-16T03:58:16.233 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2de96edf:::obj-1-233:head# 2024-09-16T03:58:16.233 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2e43da40:::obj-1-382:head# 2024-09-16T03:58:16.234 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2e530c9f:::obj-1-358:head# 2024-09-16T03:58:16.234 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:2ed02239:::obj-1-81:head# 2024-09-16T03:58:16.234 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:30264a0c:::obj-1-373:head# 2024-09-16T03:58:16.235 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:302ca5e7:::obj-1-206:head# 2024-09-16T03:58:16.236 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:309878e8:::obj-1-508:head# 2024-09-16T03:58:16.236 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:309a0ac3:::obj-1-188:head# 2024-09-16T03:58:16.236 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:30f030e9:::obj-1-53:head# 2024-09-16T03:58:16.236 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:31242a73:::obj-1-528:head# 2024-09-16T03:58:16.237 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:31463825:::obj-1-34:head# 2024-09-16T03:58:16.237 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3166dc86:::obj-1-355:head# 2024-09-16T03:58:16.237 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:31baa2fa:::obj-1-252:head# 2024-09-16T03:58:16.237 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:31d8935e:::obj-1-193:head# 2024-09-16T03:58:16.237 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:32670b14:::obj-1-305:head# 2024-09-16T03:58:16.238 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:33da02fa:::obj-1-114:head# 2024-09-16T03:58:16.238 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:34373133:::obj-1-446:head# 2024-09-16T03:58:16.238 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:347b7083:::obj-1-89:head# 2024-09-16T03:58:16.240 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:349125c1:::obj-1-148:head# 2024-09-16T03:58:16.240 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:34b80eee:::obj-1-138:head# 2024-09-16T03:58:16.240 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:34db48f8:::obj-1-49:head# 2024-09-16T03:58:16.240 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3669ff0c:::obj-1-313:head# 2024-09-16T03:58:16.240 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:36c1b610:::obj-1-249:head# 2024-09-16T03:58:16.241 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:374c250b:::obj-1-324:head# 2024-09-16T03:58:16.241 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3761a149:::obj-1-342:head# 2024-09-16T03:58:16.241 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:379ff95a:::obj-1-341:head# 2024-09-16T03:58:16.242 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:37dc15a6:::obj-1-26:head# 2024-09-16T03:58:16.242 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:38130e33:::obj-1-552:head# 2024-09-16T03:58:16.243 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:39c44880:::obj-1-538:head# 2024-09-16T03:58:16.243 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3a08dec9:::obj-1-368:head# 2024-09-16T03:58:16.243 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3a2b46a6:::obj-1-407:head# 2024-09-16T03:58:16.243 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3a7dfe0a:::obj-1-285:head# 2024-09-16T03:58:16.243 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3aebb144:::obj-1-248:head# 2024-09-16T03:58:16.244 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3b08b36f:::obj-1-310:head# 2024-09-16T03:58:16.244 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3b28ffa3:::obj-1-295:head# 2024-09-16T03:58:16.244 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3ba79bd1:::obj-1-444:head# 2024-09-16T03:58:16.245 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3c05df8d:::obj-1-319:head# 2024-09-16T03:58:16.245 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3c57e6a9:::obj-1-436:head# 2024-09-16T03:58:16.245 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3c73d8ee:::obj-1-298:head# 2024-09-16T03:58:16.245 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3cb6ae2a:::obj-1-400:head# 2024-09-16T03:58:16.246 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3cb71491:::obj-1-328:head# 2024-09-16T03:58:16.246 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3cb842fe:::obj-1-541:head# 2024-09-16T03:58:16.246 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3cf6835e:::obj-1-496:head# 2024-09-16T03:58:16.246 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3cf78507:::obj-1-573:head# 2024-09-16T03:58:16.246 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3d0dab84:::obj-1-554:head# 2024-09-16T03:58:16.247 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3d1a5f9d:::obj-1-323:head# 2024-09-16T03:58:16.247 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3da5f3a2:::obj-1-414:head# 2024-09-16T03:58:16.247 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3dbb65f0:::obj-1-440:head# 2024-09-16T03:58:16.248 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3dc94618:::obj-1-223:head# 2024-09-16T03:58:16.248 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3df3d5ab:::obj-1-25:head# 2024-09-16T03:58:16.248 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3e167988:::obj-1-336:head# 2024-09-16T03:58:16.248 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3e4ef3bd:::obj-1-104:head# 2024-09-16T03:58:16.249 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3e9e1efd:::obj-1-357:head# 2024-09-16T03:58:16.249 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3ebbe3a7:::obj-1-42:head# 2024-09-16T03:58:16.250 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3ec80373:::obj-1-403:head# 2024-09-16T03:58:16.250 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3ed086e4:::obj-1-13:head# 2024-09-16T03:58:16.250 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:3fe8e157:::obj-1-164:head# 2024-09-16T03:58:16.250 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:401ddfd4:::obj-1-379:head# 2024-09-16T03:58:16.251 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4092f6cd:::obj-1-430:head# 2024-09-16T03:58:16.251 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:414bd7cc:::obj-1-562:head# 2024-09-16T03:58:16.251 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:422bd9d0:::obj-1-287:head# 2024-09-16T03:58:16.251 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4255002d:::obj-1-578:head# 2024-09-16T03:58:16.251 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4270725c:::obj-1-109:head# 2024-09-16T03:58:16.252 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:42836669:::obj-1-31:head# 2024-09-16T03:58:16.252 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:428d93ef:::obj-1-32:head# 2024-09-16T03:58:16.252 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4327ef5b:::obj-1-453:head# 2024-09-16T03:58:16.253 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:440eb07b:::obj-1-236:head# 2024-09-16T03:58:16.253 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:442a028a:::obj-1-365:head# 2024-09-16T03:58:16.254 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:449ca54a:::obj-1-161:head# 2024-09-16T03:58:16.254 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:45128c3b:::obj-1-343:head# 2024-09-16T03:58:16.254 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:45801bf6:::obj-1-264:head# 2024-09-16T03:58:16.255 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:45896f61:::obj-1-48:head# 2024-09-16T03:58:16.255 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:459b7f1c:::obj-1-190:head# 2024-09-16T03:58:16.255 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:466af96a:::obj-1-486:head# 2024-09-16T03:58:16.256 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:47387ce4:::obj-1-575:head# 2024-09-16T03:58:16.256 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:47c94cc8:::obj-1-564:head# 2024-09-16T03:58:16.256 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:47d7f8ed:::obj-1-544:head# 2024-09-16T03:58:16.256 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:47fc0ec3:::obj-1-558:head# 2024-09-16T03:58:16.257 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:48ba42d8:::obj-1-156:head# 2024-09-16T03:58:16.257 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:494e269e:::obj-1-600:head# 2024-09-16T03:58:16.258 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:49646095:::obj-1-73:head# 2024-09-16T03:58:16.258 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:49eb65ab:::obj-1-374:head# 2024-09-16T03:58:16.258 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4a0075a4:::obj-1-432:head# 2024-09-16T03:58:16.258 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4af1ffc2:::obj-1-72:head# 2024-09-16T03:58:16.258 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4bc1c46f:::obj-1-346:head# 2024-09-16T03:58:16.259 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4bd55e68:::obj-1-93:head# 2024-09-16T03:58:16.259 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4c6d2760:::obj-1-198:head# 2024-09-16T03:58:16.260 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4cb9be3b:::obj-1-451:head# 2024-09-16T03:58:16.260 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4d260a64:::obj-1-514:head# 2024-09-16T03:58:16.260 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4d7d6284:::obj-1-583:head# 2024-09-16T03:58:16.261 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4e79ac02:::obj-1-437:head# 2024-09-16T03:58:16.262 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4e980099:::obj-1-507:head# 2024-09-16T03:58:16.262 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4ea8f99c:::obj-1-211:head# 2024-09-16T03:58:16.262 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4eabdc2a:::obj-1-590:head# 2024-09-16T03:58:16.263 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4f97fd73:::obj-1-243:head# 2024-09-16T03:58:16.263 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4fe00224:::obj-1-229:head# 2024-09-16T03:58:16.263 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4fead9ab:::obj-1-476:head# 2024-09-16T03:58:16.263 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:4ffddfd7:::obj-1-462:head# 2024-09-16T03:58:16.264 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5085c04d:::obj-1-100:head# 2024-09-16T03:58:16.264 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:50a8b465:::obj-1-574:head# 2024-09-16T03:58:16.264 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:518a151f:::obj-1-189:head# 2024-09-16T03:58:16.265 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:519afc95:::obj-1-314:head# 2024-09-16T03:58:16.265 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:52199781:::obj-1-202:head# 2024-09-16T03:58:16.265 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:52313062:::obj-1-337:head# 2024-09-16T03:58:16.266 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:526a5196:::obj-1-225:head# 2024-09-16T03:58:16.266 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:53128d32:::obj-1-483:head# 2024-09-16T03:58:16.266 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:53c2bb21:::obj-1-532:head# 2024-09-16T03:58:16.266 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:53fa4f3c:::obj-1-423:head# 2024-09-16T03:58:16.267 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:541c1d30:::obj-1-143:head# 2024-09-16T03:58:16.267 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:548d20c3:::obj-1-352:head# 2024-09-16T03:58:16.267 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:54e4c6f9:::obj-1-101:head# 2024-09-16T03:58:16.268 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:55016e06:::obj-1-276:head# 2024-09-16T03:58:16.269 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5510c784:::obj-1-491:head# 2024-09-16T03:58:16.269 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:551275ef:::obj-1-239:head# 2024-09-16T03:58:16.270 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:556df001:::obj-1-46:head# 2024-09-16T03:58:16.270 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:558fb5b1:::obj-1-536:head# 2024-09-16T03:58:16.270 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:56390d98:::obj-1-64:head# 2024-09-16T03:58:16.270 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:564f962a:::obj-1-125:head# 2024-09-16T03:58:16.270 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:56936e94:::obj-1-251:head# 2024-09-16T03:58:16.270 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:57585d3d:::obj-1-294:head# 2024-09-16T03:58:16.271 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5764cf7b:::obj-1-479:head# 2024-09-16T03:58:16.271 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5782341a:::obj-1-218:head# 2024-09-16T03:58:16.271 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:57d07a1a:::obj-1-317:head# 2024-09-16T03:58:16.274 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:58700205:::obj-1-176:head# 2024-09-16T03:58:16.274 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:58aee718:::obj-1-434:head# 2024-09-16T03:58:16.274 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:594c9d52:::obj-1-458:head# 2024-09-16T03:58:16.274 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5a70b555:::obj-1-279:head# 2024-09-16T03:58:16.274 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5b02568b:::obj-1-586:head# 2024-09-16T03:58:16.274 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5b69cdcf:::obj-1-391:head# 2024-09-16T03:58:16.274 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5cf151b5:::obj-1-510:head# 2024-09-16T03:58:16.274 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5d7fd07f:::obj-1-152:head# 2024-09-16T03:58:16.275 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5de288d7:::obj-1-235:head# 2024-09-16T03:58:16.276 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5ec497cd:::obj-1-44:head# 2024-09-16T03:58:16.276 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5fb3a09f:::obj-1-518:head# 2024-09-16T03:58:16.276 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:5ff3c2ef:::obj-1-470:head# 2024-09-16T03:58:16.276 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:601efcb1:::obj-1-549:head# 2024-09-16T03:58:16.276 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:60831338:::obj-1-263:head# 2024-09-16T03:58:16.276 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6092777b:::obj-1-145:head# 2024-09-16T03:58:16.276 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:60b17206:::obj-1-411:head# 2024-09-16T03:58:16.277 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:610c957c:::obj-1-278:head# 2024-09-16T03:58:16.278 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:613b5ef4:::obj-1-504:head# 2024-09-16T03:58:16.278 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:61ed7d60:::obj-1-274:head# 2024-09-16T03:58:16.278 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:621b6751:::obj-1-212:head# 2024-09-16T03:58:16.278 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:62b0aba9:::obj-1-253:head# 2024-09-16T03:58:16.279 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:64017240:::obj-1-102:head# 2024-09-16T03:58:16.279 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:645f4f49:::obj-1-332:head# 2024-09-16T03:58:16.279 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:65db82b9:::obj-1-334:head# 2024-09-16T03:58:16.279 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:667422e5:::obj-1-465:head# 2024-09-16T03:58:16.279 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:66c50bc2:::obj-1-322:head# 2024-09-16T03:58:16.280 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:681a4577:::obj-1-511:head# 2024-09-16T03:58:16.280 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6874e007:::obj-1-398:head# 2024-09-16T03:58:16.280 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:693746c1:::obj-1-582:head# 2024-09-16T03:58:16.281 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:69638b0c:::obj-1-8:head# 2024-09-16T03:58:16.281 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6967de6e:::obj-1-331:head# 2024-09-16T03:58:16.282 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:69da97aa:::obj-1-340:head# 2024-09-16T03:58:16.282 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6b3a50a6:::obj-1-144:head# 2024-09-16T03:58:16.282 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6be4ef26:::obj-1-579:head# 2024-09-16T03:58:16.283 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6d735549:::obj-1-599:head# 2024-09-16T03:58:16.283 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6e22c25e:::obj-1-9:head# 2024-09-16T03:58:16.283 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6e2ced4e:::obj-1-370:head# 2024-09-16T03:58:16.283 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6e961169:::obj-1-428:head# 2024-09-16T03:58:16.284 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6efcbbee:::obj-1-168:head# 2024-09-16T03:58:16.284 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6f20741c:::obj-1-33:head# 2024-09-16T03:58:16.284 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6fe4c885:::obj-1-273:head# 2024-09-16T03:58:16.285 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:6fffdea2:::obj-1-425:head# 2024-09-16T03:58:16.285 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:70716852:::obj-1-593:head# 2024-09-16T03:58:16.285 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:70919606:::obj-1-515:head# 2024-09-16T03:58:16.286 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:70c39d76:::obj-1-467:head# 2024-09-16T03:58:16.286 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:70f57ad3:::obj-1-361:head# 2024-09-16T03:58:16.287 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7177c7b5:::obj-1-503:head# 2024-09-16T03:58:16.287 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:719b69bd:::obj-1-497:head# 2024-09-16T03:58:16.287 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:724f9347:::obj-1-6:head# 2024-09-16T03:58:16.287 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:726d9f6b:::obj-1-111:head# 2024-09-16T03:58:16.288 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:72a91baf:::obj-1-439:head# 2024-09-16T03:58:16.288 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:72aa43ee:::obj-1-534:head# 2024-09-16T03:58:16.288 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:72c40e11:::obj-1-288:head# 2024-09-16T03:58:16.289 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:74196d45:::obj-1-246:head# 2024-09-16T03:58:16.289 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:743f42b1:::obj-1-326:head# 2024-09-16T03:58:16.290 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7523b538:::obj-1-494:head# 2024-09-16T03:58:16.290 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:75310ed6:::obj-1-364:head# 2024-09-16T03:58:16.290 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7568e0bc:::obj-1-585:head# 2024-09-16T03:58:16.290 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:760219a3:::obj-1-353:head# 2024-09-16T03:58:16.290 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:763338c9:::obj-1-555:head# 2024-09-16T03:58:16.291 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:77bc2d65:::obj-1-386:head# 2024-09-16T03:58:16.291 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:77ed0c7a:::obj-1-492:head# 2024-09-16T03:58:16.291 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:785a4052:::obj-1-456:head# 2024-09-16T03:58:16.292 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:796799c3:::obj-1-195:head# 2024-09-16T03:58:16.292 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:79caf0c1:::obj-1-445:head# 2024-09-16T03:58:16.293 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7af5b3e4:::obj-1-217:head# 2024-09-16T03:58:16.293 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7b3a9063:::obj-1-169:head# 2024-09-16T03:58:16.293 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7b509a92:::obj-1-561:head# 2024-09-16T03:58:16.294 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7bc646b1:::obj-1-415:head# 2024-09-16T03:58:16.294 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7c2f9188:::obj-1-482:head# 2024-09-16T03:58:16.295 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7d0da936:::obj-1-11:head# 2024-09-16T03:58:16.295 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7d25ca2d:::obj-1-242:head# 2024-09-16T03:58:16.295 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7d64f81e:::obj-1-473:head# 2024-09-16T03:58:16.297 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7ef2ea1b:::obj-1-417:head# 2024-09-16T03:58:16.297 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7f52b238:::obj-1-308:head# 2024-09-16T03:58:16.297 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:7f7a313c:::obj-1-551:head# 2024-09-16T03:58:16.297 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:806827a7:::obj-1-472:head# 2024-09-16T03:58:16.298 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8112c3ab:::obj-1-45:head# 2024-09-16T03:58:16.298 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:81365b55:::obj-1-315:head# 2024-09-16T03:58:16.299 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:818ffdc3:::obj-1-345:head# 2024-09-16T03:58:16.299 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:81babab8:::obj-1-535:head# 2024-09-16T03:58:16.300 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8288f652:::obj-1-347:head# 2024-09-16T03:58:16.300 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8312eadd:::obj-1-14:head# 2024-09-16T03:58:16.300 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:83b89bc7:::obj-1-137:head# 2024-09-16T03:58:16.301 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:84a12321:::obj-1-134:head# 2024-09-16T03:58:16.301 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:84b26d62:::obj-1-408:head# 2024-09-16T03:58:16.302 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:84bbb26e:::obj-1-43:head# 2024-09-16T03:58:16.302 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:86fc0014:::obj-1-222:head# 2024-09-16T03:58:16.302 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:87488bf4:::obj-1-174:head# 2024-09-16T03:58:16.302 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8754389a:::obj-1-65:head# 2024-09-16T03:58:16.302 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:87a6ad67:::obj-1-366:head# 2024-09-16T03:58:16.303 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:87d32b83:::obj-1-513:head# 2024-09-16T03:58:16.303 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8813a346:::obj-1-540:head# 2024-09-16T03:58:16.304 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:88146951:::obj-1-216:head# 2024-09-16T03:58:16.305 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8820800d:::obj-1-83:head# 2024-09-16T03:58:16.305 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:88319745:::obj-1-98:head# 2024-09-16T03:58:16.305 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:88c969b8:::obj-1-54:head# 2024-09-16T03:58:16.305 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:895a2d53:::obj-1-150:head# 2024-09-16T03:58:16.305 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8ae006a0:::obj-1-241:head# 2024-09-16T03:58:16.306 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8bd44e64:::obj-1-300:head# 2024-09-16T03:58:16.307 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8beb257f:::obj-1-3:head# 2024-09-16T03:58:16.307 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8cd8c743:::obj-1-527:head# 2024-09-16T03:58:16.307 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8daa99c7:::obj-1-237:head# 2024-09-16T03:58:16.308 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8f5bccbf:::obj-1-59:head# 2024-09-16T03:58:16.308 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8f6d9945:::obj-1-151:head# 2024-09-16T03:58:16.308 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8f7c568c:::obj-1-261:head# 2024-09-16T03:58:16.308 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:8fbc59a9:::obj-1-589:head# 2024-09-16T03:58:16.309 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:90225d94:::obj-1-194:head# 2024-09-16T03:58:16.309 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:904c50d3:::obj-1-63:head# 2024-09-16T03:58:16.309 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:90e1bd79:::obj-1-450:head# 2024-09-16T03:58:16.309 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9274b06d:::obj-1-460:head# 2024-09-16T03:58:16.309 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:92af41f5:::obj-1-409:head# 2024-09-16T03:58:16.310 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:935a08d6:::obj-1-192:head# 2024-09-16T03:58:16.310 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:935f8a13:::obj-1-24:head# 2024-09-16T03:58:16.310 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:95230148:::obj-1-280:head# 2024-09-16T03:58:16.311 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:95342eb0:::obj-1-390:head# 2024-09-16T03:58:16.311 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9659d09c:::obj-1-292:head# 2024-09-16T03:58:16.312 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:970e8cb4:::obj-1-18:head# 2024-09-16T03:58:16.312 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:97d21cf1:::obj-1-80:head# 2024-09-16T03:58:16.313 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:982bdb12:::obj-1-302:head# 2024-09-16T03:58:16.313 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:985dfd75:::obj-1-91:head# 2024-09-16T03:58:16.313 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:986d245a:::obj-1-154:head# 2024-09-16T03:58:16.313 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:98a03e99:::obj-1-529:head# 2024-09-16T03:58:16.313 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:98b7103e:::obj-1-275:head# 2024-09-16T03:58:16.313 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:990f0ecf:::obj-1-427:head# 2024-09-16T03:58:16.315 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:996c1f26:::obj-1-96:head# 2024-09-16T03:58:16.315 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:99bd2018:::obj-1-17:head# 2024-09-16T03:58:16.315 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9a7434c9:::obj-1-469:head# 2024-09-16T03:58:16.315 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9a8e36cc:::obj-1-598:head# 2024-09-16T03:58:16.315 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9abcc369:::obj-1-442:head# 2024-09-16T03:58:16.316 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9b0ea06e:::obj-1-231:head# 2024-09-16T03:58:16.316 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9b34e80d:::obj-1-378:head# 2024-09-16T03:58:16.317 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9b55a2a9:::obj-1-60:head# 2024-09-16T03:58:16.317 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9be3f2da:::obj-1-597:head# 2024-09-16T03:58:16.317 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9bf62c88:::obj-1-447:head# 2024-09-16T03:58:16.317 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9c31857b:::obj-1-272:head# 2024-09-16T03:58:16.318 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9c533e91:::obj-1-19:head# 2024-09-16T03:58:16.318 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9ca70688:::obj-1-570:head# 2024-09-16T03:58:16.319 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9ccce337:::obj-1-147:head# 2024-09-16T03:58:16.319 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9d4b2dfc:::obj-1-267:head# 2024-09-16T03:58:16.320 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9d4df969:::obj-1-286:head# 2024-09-16T03:58:16.320 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9d714651:::obj-1-495:head# 2024-09-16T03:58:16.320 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9da65518:::obj-1-498:head# 2024-09-16T03:58:16.320 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9e94f27b:::obj-1-209:head# 2024-09-16T03:58:16.321 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9f39e910:::obj-1-354:head# 2024-09-16T03:58:16.321 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9f8f9ef4:::obj-1-226:head# 2024-09-16T03:58:16.321 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:9fcd3f36:::obj-1-47:head# 2024-09-16T03:58:16.322 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a0326d7d:::obj-1-338:head# 2024-09-16T03:58:16.322 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a05e7475:::obj-1-62:head# 2024-09-16T03:58:16.324 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a0955052:::obj-1-533:head# 2024-09-16T03:58:16.324 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a0aa6848:::obj-1-38:head# 2024-09-16T03:58:16.324 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a0fdc285:::obj-1-133:head# 2024-09-16T03:58:16.325 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a10290b8:::obj-1-245:head# 2024-09-16T03:58:16.330 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a118a8a8:::obj-1-500:head# 2024-09-16T03:58:16.330 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a11a4079:::obj-1-199:head# 2024-09-16T03:58:16.330 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a1b3ec36:::obj-1-15:head# 2024-09-16T03:58:16.330 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a1f5079b:::obj-1-468:head# 2024-09-16T03:58:16.330 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a1ff04b5:::obj-1-167:head# 2024-09-16T03:58:16.330 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a21cc437:::obj-1-128:head# 2024-09-16T03:58:16.331 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a2966c77:::obj-1-140:head# 2024-09-16T03:58:16.331 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a321e537:::obj-1-184:head# 2024-09-16T03:58:16.331 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a33418d8:::obj-1-488:head# 2024-09-16T03:58:16.331 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a38b1c1a:::obj-1-584:head# 2024-09-16T03:58:16.331 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a3f83221:::obj-1-158:head# 2024-09-16T03:58:16.331 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a46e33eb:::obj-1-106:head# 2024-09-16T03:58:16.331 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a491460d:::obj-1-421:head# 2024-09-16T03:58:16.332 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a4dd813b:::obj-1-530:head# 2024-09-16T03:58:16.332 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a4e0d96d:::obj-1-351:head# 2024-09-16T03:58:16.335 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a52657b4:::obj-1-557:head# 2024-09-16T03:58:16.335 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a5b3bca6:::obj-1-277:head# 2024-09-16T03:58:16.335 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a5f5a9fb:::obj-1-170:head# 2024-09-16T03:58:16.336 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a6aeed57:::obj-1-141:head# 2024-09-16T03:58:16.336 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a6dda70f:::obj-1-471:head# 2024-09-16T03:58:16.336 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a71186c0:::obj-1-406:head# 2024-09-16T03:58:16.336 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a764ad8c:::obj-1-221:head# 2024-09-16T03:58:16.336 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a7b63473:::obj-1-131:head# 2024-09-16T03:58:16.336 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a88042fa:::obj-1-296:head# 2024-09-16T03:58:16.337 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:a8805fe0:::obj-1-213:head# 2024-09-16T03:58:16.337 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:aa4f12b1:::obj-1-270:head# 2024-09-16T03:58:16.337 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ab27f701:::obj-1-399:head# 2024-09-16T03:58:16.337 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ab8027c1:::obj-1-360:head# 2024-09-16T03:58:16.340 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ac3ef8ab:::obj-1-371:head# 2024-09-16T03:58:16.340 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ac4db76d:::obj-1-405:head# 2024-09-16T03:58:16.341 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ad53cb29:::obj-1-256:head# 2024-09-16T03:58:16.341 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ad704c16:::obj-1-485:head# 2024-09-16T03:58:16.341 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:adec4920:::obj-1-107:head# 2024-09-16T03:58:16.341 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ae3a94b3:::obj-1-95:head# 2024-09-16T03:58:16.341 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ae92616e:::obj-1-448:head# 2024-09-16T03:58:16.341 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ae975168:::obj-1-426:head# 2024-09-16T03:58:16.341 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:aee8fd62:::obj-1-27:head# 2024-09-16T03:58:16.342 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:af38aa87:::obj-1-50:head# 2024-09-16T03:58:16.342 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b0327eb3:::obj-1-380:head# 2024-09-16T03:58:16.342 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b03cd166:::obj-1-203:head# 2024-09-16T03:58:16.342 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b06f06e0:::obj-1-126:head# 2024-09-16T03:58:16.349 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b0972538:::obj-1-506:head# 2024-09-16T03:58:16.350 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b0cfb86a:::obj-1-359:head# 2024-09-16T03:58:16.350 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b10adb1c:::obj-1-333:head# 2024-09-16T03:58:16.350 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b20b9004:::obj-1-401:head# 2024-09-16T03:58:16.350 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b2113757:::obj-1-4:head# 2024-09-16T03:58:16.350 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b22441e9:::obj-1-29:head# 2024-09-16T03:58:16.350 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b2472384:::obj-1-207:head# 2024-09-16T03:58:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b2604227:::obj-1-502:head# 2024-09-16T03:58:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b3277f89:::obj-1-175:head# 2024-09-16T03:58:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b3d09e0d:::obj-1-258:head# 2024-09-16T03:58:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b3e9969a:::obj-1-499:head# 2024-09-16T03:58:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b4892e7d:::obj-1-155:head# 2024-09-16T03:58:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b4b76084:::obj-1-581:head# 2024-09-16T03:58:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b6e47ae5:::obj-1-215:head# 2024-09-16T03:58:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b75af5ff:::obj-1-228:head# 2024-09-16T03:58:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b8e2e20f:::obj-1-220:head# 2024-09-16T03:58:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:b8e80c4e:::obj-1-576:head# 2024-09-16T03:58:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ba502aee:::obj-1-255:head# 2024-09-16T03:58:16.352 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ba9c3e6e:::obj-1-57:head# 2024-09-16T03:58:16.352 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bb068062:::obj-1-461:head# 2024-09-16T03:58:16.352 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bb16c115:::obj-1-157:head# 2024-09-16T03:58:16.352 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bb447914:::obj-1-481:head# 2024-09-16T03:58:16.352 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bb6c8e0f:::obj-1-348:head# 2024-09-16T03:58:16.352 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bb77d6d0:::obj-1-301:head# 2024-09-16T03:58:16.352 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bc51c5f6:::obj-1-422:head# 2024-09-16T03:58:16.354 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bc838d5c:::obj-1-35:head# 2024-09-16T03:58:16.354 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bceae5eb:::obj-1-56:head# 2024-09-16T03:58:16.354 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bea17ef6:::obj-1-84:head# 2024-09-16T03:58:16.355 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:beb88be5:::obj-1-396:head# 2024-09-16T03:58:16.355 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:beed7b18:::obj-1-569:head# 2024-09-16T03:58:16.355 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bf0bff49:::obj-1-385:head# 2024-09-16T03:58:16.355 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bf545d5a:::obj-1-69:head# 2024-09-16T03:58:16.355 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bf560a7f:::obj-1-40:head# 2024-09-16T03:58:16.355 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:bff6999c:::obj-1-240:head# 2024-09-16T03:58:16.355 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c0a33d38:::obj-1-321:head# 2024-09-16T03:58:16.355 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c1e4c9b4:::obj-1-299:head# 2024-09-16T03:58:16.355 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c1ec515a:::obj-1-16:head# 2024-09-16T03:58:16.355 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c22de3c8:::obj-1-110:head# 2024-09-16T03:58:16.357 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c231cd7c:::obj-1-58:head# 2024-09-16T03:58:16.357 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c2ee6ace:::obj-1-186:head# 2024-09-16T03:58:16.357 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c32bfef2:::obj-1-181:head# 2024-09-16T03:58:16.357 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c575a298:::obj-1-466:head# 2024-09-16T03:58:16.357 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c58c3f80:::obj-1-493:head# 2024-09-16T03:58:16.358 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c6442cf2:::obj-1-455:head# 2024-09-16T03:58:16.358 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c6619413:::obj-1-37:head# 2024-09-16T03:58:16.359 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c6c2f8e5:::obj-1-519:head# 2024-09-16T03:58:16.360 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c6f811a2:::obj-1-180:head# 2024-09-16T03:58:16.360 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c72af975:::obj-1-21:head# 2024-09-16T03:58:16.360 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c73eb350:::obj-1-356:head# 2024-09-16T03:58:16.360 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c7a683da:::obj-1-410:head# 2024-09-16T03:58:16.360 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c7eb9bcc:::obj-1-553:head# 2024-09-16T03:58:16.360 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c886df99:::obj-1-269:head# 2024-09-16T03:58:16.360 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c932e3ec:::obj-1-135:head# 2024-09-16T03:58:16.361 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c9b6507a:::obj-1-520:head# 2024-09-16T03:58:16.361 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:c9e3b064:::obj-1-244:head# 2024-09-16T03:58:16.361 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:cb705d66:::obj-1-377:head# 2024-09-16T03:58:16.362 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:cc80e25c:::obj-1-115:head# 2024-09-16T03:58:16.362 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:cd1ec88e:::obj-1-297:head# 2024-09-16T03:58:16.363 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:cd7e6936:::obj-1-234:head# 2024-09-16T03:58:16.363 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ce32b69c:::obj-1-30:head# 2024-09-16T03:58:16.363 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:cf2b123c:::obj-1-293:head# 2024-09-16T03:58:16.364 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:cf2e80a9:::obj-1-542:head# 2024-09-16T03:58:16.364 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:cf51da6a:::obj-1-284:head# 2024-09-16T03:58:16.364 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:cf590f42:::obj-1-381:head# 2024-09-16T03:58:16.365 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:cf68a2b1:::obj-1-68:head# 2024-09-16T03:58:16.365 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:cf6aefb6:::obj-1-28:head# 2024-09-16T03:58:16.365 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:cfd8e6af:::obj-1-105:head# 2024-09-16T03:58:16.365 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d0640bad:::obj-1-254:head# 2024-09-16T03:58:16.366 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d101cda5:::obj-1-259:head# 2024-09-16T03:58:16.366 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d1be9386:::obj-1-416:head# 2024-09-16T03:58:16.366 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d243f036:::obj-1-265:head# 2024-09-16T03:58:16.367 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d2808c34:::obj-1-159:head# 2024-09-16T03:58:16.367 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d3415824:::obj-1-39:head# 2024-09-16T03:58:16.367 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d424f07a:::obj-1-547:head# 2024-09-16T03:58:16.368 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d44139f2:::obj-1-289:head# 2024-09-16T03:58:16.368 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d46015ab:::obj-1-546:head# 2024-09-16T03:58:16.369 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d4e503db:::obj-1-525:head# 2024-09-16T03:58:16.369 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d4e97d18:::obj-1-85:head# 2024-09-16T03:58:16.369 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d511492e:::obj-1-388:head# 2024-09-16T03:58:16.369 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d526a7fa:::obj-1-12:head# 2024-09-16T03:58:16.370 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d5667b59:::obj-1-369:head# 2024-09-16T03:58:16.370 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d57f2261:::obj-1-419:head# 2024-09-16T03:58:16.371 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d57f281b:::obj-1-250:head# 2024-09-16T03:58:16.371 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d6e05894:::obj-1-166:head# 2024-09-16T03:58:16.371 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d7689481:::obj-1-424:head# 2024-09-16T03:58:16.372 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d7d27743:::obj-1-129:head# 2024-09-16T03:58:16.373 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d7e4d3e9:::obj-1-127:head# 2024-09-16T03:58:16.373 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d7f1422a:::obj-1-594:head# 2024-09-16T03:58:16.374 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d8469fd2:::obj-1-153:head# 2024-09-16T03:58:16.374 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d84efd9e:::obj-1-435:head# 2024-09-16T03:58:16.377 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d883004b:::obj-1-162:head# 2024-09-16T03:58:16.380 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d8b60854:::obj-1-257:head# 2024-09-16T03:58:16.381 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d91aaae6:::obj-1-1:head# 2024-09-16T03:58:16.381 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d98695ca:::obj-1-524:head# 2024-09-16T03:58:16.381 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:d9ae97c8:::obj-1-177:head# 2024-09-16T03:58:16.381 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:da1713bd:::obj-1-309:head# 2024-09-16T03:58:16.381 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:da37824c:::obj-1-2:head# 2024-09-16T03:58:16.381 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:dab221b0:::obj-1-526:head# 2024-09-16T03:58:16.381 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:db27d885:::obj-1-363:head# 2024-09-16T03:58:16.381 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:dc001d76:::obj-1-329:head# 2024-09-16T03:58:16.381 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:dc4f4119:::obj-1-122:head# 2024-09-16T03:58:16.381 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:dcc36eb7:::obj-1-283:head# 2024-09-16T03:58:16.388 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:df7da06c:::obj-1-124:head# 2024-09-16T03:58:16.388 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:df7fcacb:::obj-1-330:head# 2024-09-16T03:58:16.388 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e05cbe31:::obj-1-413:head# 2024-09-16T03:58:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e1060a54:::obj-1-384:head# 2024-09-16T03:58:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e15b839b:::obj-1-316:head# 2024-09-16T03:58:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e161b6e5:::obj-1-103:head# 2024-09-16T03:58:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e1d1d79c:::obj-1-512:head# 2024-09-16T03:58:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e224b482:::obj-1-501:head# 2024-09-16T03:58:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e22d6f76:::obj-1-70:head# 2024-09-16T03:58:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e2bd801c:::obj-1-523:head# 2024-09-16T03:58:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e3d9f395:::obj-1-397:head# 2024-09-16T03:58:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e474ea25:::obj-1-457:head# 2024-09-16T03:58:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e49e1ff3:::obj-1-130:head# 2024-09-16T03:58:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e56c67a0:::obj-1-191:head# 2024-09-16T03:58:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e576e921:::obj-1-376:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e619fd26:::obj-1-395:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e625bdc5:::obj-1-522:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e68a0fa6:::obj-1-394:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e6cf260f:::obj-1-77:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e6d6255a:::obj-1-108:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e7a35d2f:::obj-1-116:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e7b07de5:::obj-1-238:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e8037aba:::obj-1-404:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e8e8b34f:::obj-1-291:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:e987cd7a:::obj-1-123:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ea534db1:::obj-1-311:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:eabcc188:::obj-1-325:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:eb086660:::obj-1-595:head# 2024-09-16T03:58:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:eb2235d3:::obj-1-596:head# 2024-09-16T03:58:16.391 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:eb35ae40:::obj-1-516:head# 2024-09-16T03:58:16.391 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:eb360a13:::obj-1-224:head# 2024-09-16T03:58:16.391 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:eb3a3ea1:::obj-1-120:head# 2024-09-16T03:58:16.391 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ebca9f6e:::obj-1-290:head# 2024-09-16T03:58:16.393 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ec81db71:::obj-1-478:head# 2024-09-16T03:58:16.393 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:edeafa4c:::obj-1-362:head# 2024-09-16T03:58:16.393 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:eeb5261b:::obj-1-539:head# 2024-09-16T03:58:16.393 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:eec00eee:::obj-1-567:head# 2024-09-16T03:58:16.393 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ef075e10:::obj-1-463:head# 2024-09-16T03:58:16.393 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ef8e37d9:::obj-1-94:head# 2024-09-16T03:58:16.393 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:efad7f67:::obj-1-197:head# 2024-09-16T03:58:16.393 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:efe09ea7:::obj-1-537:head# 2024-09-16T03:58:16.394 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f0445019:::obj-1-480:head# 2024-09-16T03:58:16.394 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f08a432c:::obj-1-489:head# 2024-09-16T03:58:16.394 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f0bd9006:::obj-1-487:head# 2024-09-16T03:58:16.397 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f11a115d:::obj-1-591:head# 2024-09-16T03:58:16.397 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f232e0af:::obj-1-146:head# 2024-09-16T03:58:16.397 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f258db54:::obj-1-521:head# 2024-09-16T03:58:16.397 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f29cc204:::obj-1-566:head# 2024-09-16T03:58:16.398 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f2ae2451:::obj-1-66:head# 2024-09-16T03:58:16.398 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f318810a:::obj-1-160:head# 2024-09-16T03:58:16.398 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f3c35a0d:::obj-1-67:head# 2024-09-16T03:58:16.398 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f3ce9c90:::obj-1-88:head# 2024-09-16T03:58:16.398 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f3e3e81f:::obj-1-304:head# 2024-09-16T03:58:16.398 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f3f65b0a:::obj-1-367:head# 2024-09-16T03:58:16.398 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f4ea014b:::obj-1-149:head# 2024-09-16T03:58:16.399 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f52d115b:::obj-1-383:head# 2024-09-16T03:58:16.400 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f590311e:::obj-1-76:head# 2024-09-16T03:58:16.400 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f5a37734:::obj-1-51:head# 2024-09-16T03:58:16.401 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f5e2e77c:::obj-1-179:head# 2024-09-16T03:58:16.401 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f5e381bc:::obj-1-173:head# 2024-09-16T03:58:16.401 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f6c0ae0b:::obj-1-247:head# 2024-09-16T03:58:16.401 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f6db8a82:::obj-1-548:head# 2024-09-16T03:58:16.401 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f6e2dc46:::obj-1-36:head# 2024-09-16T03:58:16.401 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f76ee569:::obj-1-587:head# 2024-09-16T03:58:16.401 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f773b9ed:::obj-1-550:head# 2024-09-16T03:58:16.401 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f7e1adad:::obj-1-350:head# 2024-09-16T03:58:16.403 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f7eebf7a:::obj-1-559:head# 2024-09-16T03:58:16.403 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f877f025:::obj-1-187:head# 2024-09-16T03:58:16.403 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f992f9e9:::obj-1-402:head# 2024-09-16T03:58:16.403 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:f9fe960a:::obj-1-418:head# 2024-09-16T03:58:16.403 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:fa9b882f:::obj-1-165:head# 2024-09-16T03:58:16.403 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:fbd6461c:::obj-1-339:head# 2024-09-16T03:58:16.405 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:fbeab28d:::obj-1-431:head# 2024-09-16T03:58:16.405 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:fdea4138:::obj-1-185:head# 2024-09-16T03:58:16.405 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:fdfa7c9b:::obj-1-183:head# 2024-09-16T03:58:16.405 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:fe1ba57e:::obj-1-90:head# 2024-09-16T03:58:16.405 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:feb7adea:::obj-1-560:head# 2024-09-16T03:58:16.405 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ffab306e:::obj-1-97:head# 2024-09-16T03:58:16.405 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ffdfd397:::obj-1-433:head# 2024-09-16T03:58:16.406 INFO:tasks.workunit.client.0.smithi026.stderr:Read #2:ffe8cf04:::obj-1-303:head# 2024-09-16T03:58:16.406 INFO:tasks.workunit.client.0.smithi026.stderr:Export successful 2024-09-16T03:58:16.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-backfill-space 2 2024-09-16T03:58:16.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-backfill-space 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-backfill-space/2 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2024-09-16T03:58:16.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T03:58:16.925 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T03:58:16.925 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T03:58:16.925 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T03:58:16.925 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T03:58:16.925 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T03:58:16.925 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T03:58:16.925 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:58:16.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T03:58:16.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T03:58:16.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T03:58:16.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T03:58:16.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T03:58:16.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T03:58:16.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T03:58:16.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T03:58:16.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T03:58:16.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T03:58:16.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-backfill-space/2 2024-09-16T03:58:16.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2024-09-16T03:58:16.928 INFO:tasks.workunit.client.0.smithi026.stderr:start osd.2 2024-09-16T03:58:16.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T03:58:16.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-backfill-space/2/whoami 2024-09-16T03:58:16.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2024-09-16T03:58:16.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T03:58:16.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T03:58:16.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T03:58:16.962 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:58:16.959+0000 7f0e29302640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:58:16.964 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:58:16.961+0000 7f0e29302640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:58:16.965 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:58:16.962+0000 7f0e29302640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T03:58:17.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2024-09-16T03:58:17.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T03:58:17.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T03:58:17.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T03:58:17.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T03:58:17.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:17.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T03:58:17.375 INFO:tasks.workunit.client.0.smithi026.stderr:0 2024-09-16T03:58:17.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:17.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:58:17.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:18.068 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:58:18.066+0000 7f0e29302640 -1 Falling back to public interface 2024-09-16T03:58:18.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:18.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:18.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T03:58:18.818 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T03:58:18.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:18.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:58:19.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:20.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:20.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:20.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T03:58:20.278 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T03:58:20.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:20.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:58:20.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T03:58:20.972 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T03:58:20.969+0000 7f0e29302640 -1 osd.2 42 log_to_monitors true 2024-09-16T03:58:21.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T03:58:21.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T03:58:21.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T03:58:21.691 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T03:58:21.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T03:58:21.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T03:58:22.281 INFO:tasks.workunit.client.0.smithi026.stderr:osd.2 up in weight 1 up_from 46 up_thru 46 down_at 43 last_clean_interval [15,42) [v2:127.0.0.1:6818/4195832361,v1:127.0.0.1:6819/4195832361] [v2:127.0.0.1:6820/4195832361,v1:127.0.0.1:6821/4195832361] exists,up 8e9f8cf3-0b08-482a-b7a7-7f57e65f91e0 2024-09-16T03:58:22.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T03:58:22.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T03:58:22.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T03:58:22.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:491: TEST_backfill_multi_partial: kill_daemon td/osd-backfill-space/osd.1.pid TERM 2024-09-16T03:58:22.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: cat td/osd-backfill-space/osd.1.pid 2024-09-16T03:58:22.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: local pid=164969 2024-09-16T03:58:22.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:247: kill_daemon: local send_signal=TERM 2024-09-16T03:58:22.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:248: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2024-09-16T03:58:22.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:249: kill_daemon: local exit_code=1 2024-09-16T03:58:22.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T03:58:22.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -TERM 164969 2024-09-16T03:58:22.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2024-09-16T03:58:22.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2024-09-16T03:58:22.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.1 2024-09-16T03:58:22.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T03:58:22.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 164969 2024-09-16T03:58:22.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2024-09-16T03:58:22.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2024-09-16T03:58:22.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.2 2024-09-16T03:58:22.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T03:58:22.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 164969 2024-09-16T03:58:22.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: exit_code=0 2024-09-16T03:58:22.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: break 2024-09-16T03:58:22.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: return 0 2024-09-16T03:58:22.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:492: TEST_backfill_multi_partial: _objectstore_tool_nodown td/osd-backfill-space 1 --force --op remove --pgid 2.0 2024-09-16T03:58:22.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2024-09-16T03:58:22.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2024-09-16T03:58:22.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2024-09-16T03:58:22.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2024-09-16T03:58:22.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/1 2024-09-16T03:58:22.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/1 --force --op remove --pgid 2.0 2024-09-16T03:58:24.014 INFO:tasks.workunit.client.0.smithi026.stderr:PG '2.0' not found 2024-09-16T03:58:24.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2024-09-16T03:58:24.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:493: TEST_backfill_multi_partial: _objectstore_tool_nodown td/osd-backfill-space 1 --op import --pgid 2.0 --file td/osd-backfill-space/export.out 2024-09-16T03:58:24.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2024-09-16T03:58:24.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2024-09-16T03:58:24.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2024-09-16T03:58:24.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2024-09-16T03:58:24.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/1 2024-09-16T03:58:24.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/1 --op import --pgid 2.0 --file td/osd-backfill-space/export.out 2024-09-16T03:58:25.243 INFO:tasks.workunit.client.0.smithi026.stdout:get_pg_num_history pg_num_history pg_num_history(e47 pg_nums {1={21=1},2={26=1},3={31=1}} deleted_pools ) 2024-09-16T03:58:25.243 INFO:tasks.workunit.client.0.smithi026.stdout:Importing pgid 2.0 2024-09-16T03:58:25.243 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:00f101c6:::obj-1-121:head# 2024-09-16T03:58:25.243 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.308 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0168051e:::obj-1-571:head# 2024-09-16T03:58:25.308 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.341 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:01b67738:::obj-1-182:head# 2024-09-16T03:58:25.341 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.375 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:040dbc59:::obj-1-23:head# 2024-09-16T03:58:25.375 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.408 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0415ce6e:::obj-1-20:head# 2024-09-16T03:58:25.408 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.442 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:058b28d7:::obj-1-572:head# 2024-09-16T03:58:25.442 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.475 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:059d2e5c:::obj-1-87:head# 2024-09-16T03:58:25.475 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.509 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:05a823ca:::obj-1-52:head# 2024-09-16T03:58:25.509 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.542 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:05b8b7fe:::obj-1-119:head# 2024-09-16T03:58:25.542 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.576 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:05c9492b:::obj-1-78:head# 2024-09-16T03:58:25.576 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.609 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:05e91e96:::obj-1-393:head# 2024-09-16T03:58:25.609 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.642 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:07bdb780:::obj-1-204:head# 2024-09-16T03:58:25.642 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.676 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:07cfbd49:::obj-1-318:head# 2024-09-16T03:58:25.676 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.709 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:084a829f:::obj-1-112:head# 2024-09-16T03:58:25.709 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.751 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:08cedd34:::obj-1-438:head# 2024-09-16T03:58:25.751 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.810 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0941af69:::obj-1-117:head# 2024-09-16T03:58:25.810 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.860 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:09607265:::obj-1-429:head# 2024-09-16T03:58:25.860 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.910 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0be86f7e:::obj-1-568:head# 2024-09-16T03:58:25.910 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.944 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0ca5819d:::obj-1-327:head# 2024-09-16T03:58:25.944 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:25.977 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0cd02051:::obj-1-208:head# 2024-09-16T03:58:25.977 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.010 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0d0264b5:::obj-1-171:head# 2024-09-16T03:58:26.010 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.044 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0d195060:::obj-1-420:head# 2024-09-16T03:58:26.044 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.077 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0d362b19:::obj-1-219:head# 2024-09-16T03:58:26.078 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.111 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0dea6f4d:::obj-1-61:head# 2024-09-16T03:58:26.111 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.144 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0ecd8390:::obj-1-132:head# 2024-09-16T03:58:26.145 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.178 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0f49e2fa:::obj-1-200:head# 2024-09-16T03:58:26.178 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.211 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0f7bb95f:::obj-1-268:head# 2024-09-16T03:58:26.211 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.245 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0fabf252:::obj-1-441:head# 2024-09-16T03:58:26.245 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.278 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:0fb1697a:::obj-1-443:head# 2024-09-16T03:58:26.278 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.312 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:105d3efe:::obj-1-490:head# 2024-09-16T03:58:26.312 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.345 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:10f52c01:::obj-1-449:head# 2024-09-16T03:58:26.346 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.379 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:11965425:::obj-1-335:head# 2024-09-16T03:58:26.379 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.412 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:11c9f5f8:::obj-1-565:head# 2024-09-16T03:58:26.413 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.446 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:11cfcfb6:::obj-1-588:head# 2024-09-16T03:58:26.446 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.479 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:11d46f0a:::obj-1-387:head# 2024-09-16T03:58:26.479 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.512 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:11ebb0d6:::obj-1-214:head# 2024-09-16T03:58:26.513 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.546 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1295e402:::obj-1-178:head# 2024-09-16T03:58:26.546 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.597 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:12c996c1:::obj-1-517:head# 2024-09-16T03:58:26.597 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.638 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:133dec15:::obj-1-475:head# 2024-09-16T03:58:26.638 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.679 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1475c981:::obj-1-505:head# 2024-09-16T03:58:26.680 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.721 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:148e92a4:::obj-1-509:head# 2024-09-16T03:58:26.721 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.763 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1490b121:::obj-1-172:head# 2024-09-16T03:58:26.763 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.805 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:14ce082c:::obj-1-99:head# 2024-09-16T03:58:26.805 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.858 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1552ad99:::obj-1-41:head# 2024-09-16T03:58:26.858 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.922 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:15544270:::obj-1-271:head# 2024-09-16T03:58:26.922 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:26.983 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1589d957:::obj-1-86:head# 2024-09-16T03:58:26.983 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.031 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:16db3947:::obj-1-477:head# 2024-09-16T03:58:27.031 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.081 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:16dc98bd:::obj-1-375:head# 2024-09-16T03:58:27.081 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.132 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:17e54db3:::obj-1-196:head# 2024-09-16T03:58:27.132 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.190 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:17f2ad3f:::obj-1-10:head# 2024-09-16T03:58:27.190 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.223 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:18075e41:::obj-1-55:head# 2024-09-16T03:58:27.224 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.266 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:18086253:::obj-1-71:head# 2024-09-16T03:58:27.266 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.299 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:191cf8d8:::obj-1-372:head# 2024-09-16T03:58:27.299 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.332 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:19311f70:::obj-1-454:head# 2024-09-16T03:58:27.333 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.366 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:198318e4:::obj-1-464:head# 2024-09-16T03:58:27.366 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.400 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1999d806:::obj-1-163:head# 2024-09-16T03:58:27.400 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.433 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1a92cab7:::obj-1-412:head# 2024-09-16T03:58:27.433 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.467 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1b16c0f6:::obj-1-210:head# 2024-09-16T03:58:27.467 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.500 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1b53ed46:::obj-1-577:head# 2024-09-16T03:58:27.500 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.533 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1b5c5a8d:::obj-1-556:head# 2024-09-16T03:58:27.533 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.567 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1c12c05e:::obj-1-79:head# 2024-09-16T03:58:27.567 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.600 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1c571ba5:::obj-1-262:head# 2024-09-16T03:58:27.600 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.633 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1c5f42b7:::obj-1-92:head# 2024-09-16T03:58:27.634 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.667 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1c6ad881:::obj-1-312:head# 2024-09-16T03:58:27.667 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.700 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1c89877b:::obj-1-142:head# 2024-09-16T03:58:27.701 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.768 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1e4168ca:::obj-1-282:head# 2024-09-16T03:58:27.768 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.799 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1e424445:::obj-1-484:head# 2024-09-16T03:58:27.799 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.843 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1e467959:::obj-1-22:head# 2024-09-16T03:58:27.843 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.866 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1eaf7e7c:::obj-1-392:head# 2024-09-16T03:58:27.866 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.883 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1f06c86d:::obj-1-307:head# 2024-09-16T03:58:27.883 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.899 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1f2ee1f8:::obj-1-306:head# 2024-09-16T03:58:27.900 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.916 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:1f4ef040:::obj-1-349:head# 2024-09-16T03:58:27.916 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.933 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2039481f:::obj-1-545:head# 2024-09-16T03:58:27.933 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.950 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:22233df0:::obj-1-543:head# 2024-09-16T03:58:27.950 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.966 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2225184e:::obj-1-266:head# 2024-09-16T03:58:27.967 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:27.983 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:234766bb:::obj-1-281:head# 2024-09-16T03:58:27.983 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.000 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2372e022:::obj-1-205:head# 2024-09-16T03:58:28.000 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.016 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2379547b:::obj-1-113:head# 2024-09-16T03:58:28.016 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.033 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:23ae14bf:::obj-1-531:head# 2024-09-16T03:58:28.033 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.050 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:23bc5f90:::obj-1-452:head# 2024-09-16T03:58:28.050 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.066 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:23fbef3d:::obj-1-82:head# 2024-09-16T03:58:28.067 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.083 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:24106c2b:::obj-1-232:head# 2024-09-16T03:58:28.083 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.100 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2529b4e4:::obj-1-75:head# 2024-09-16T03:58:28.100 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.116 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:25a24ae7:::obj-1-459:head# 2024-09-16T03:58:28.116 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.133 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:26627aa9:::obj-1-7:head# 2024-09-16T03:58:28.133 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.150 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:26b77221:::obj-1-227:head# 2024-09-16T03:58:28.150 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.177 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:27450826:::obj-1-344:head# 2024-09-16T03:58:28.177 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.192 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:278905af:::obj-1-592:head# 2024-09-16T03:58:28.192 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.208 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:27ad0d2d:::obj-1-136:head# 2024-09-16T03:58:28.208 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.225 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:28a8c213:::obj-1-118:head# 2024-09-16T03:58:28.225 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.242 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:28c0c009:::obj-1-74:head# 2024-09-16T03:58:28.242 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.258 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2a214708:::obj-1-260:head# 2024-09-16T03:58:28.258 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.275 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2a67e195:::obj-1-474:head# 2024-09-16T03:58:28.275 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.292 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2aa852ff:::obj-1-5:head# 2024-09-16T03:58:28.292 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.308 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2ba1fb52:::obj-1-563:head# 2024-09-16T03:58:28.308 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.325 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2bae8cb9:::obj-1-320:head# 2024-09-16T03:58:28.325 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.342 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2c569d02:::obj-1-139:head# 2024-09-16T03:58:28.342 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.358 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2c71d691:::obj-1-201:head# 2024-09-16T03:58:28.358 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.375 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2c88e92c:::obj-1-389:head# 2024-09-16T03:58:28.375 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.392 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2d659109:::obj-1-580:head# 2024-09-16T03:58:28.392 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.409 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2d74ea60:::obj-1-230:head# 2024-09-16T03:58:28.409 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.425 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2de96edf:::obj-1-233:head# 2024-09-16T03:58:28.425 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.442 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2e43da40:::obj-1-382:head# 2024-09-16T03:58:28.442 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.458 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2e530c9f:::obj-1-358:head# 2024-09-16T03:58:28.459 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.475 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:2ed02239:::obj-1-81:head# 2024-09-16T03:58:28.475 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.492 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:30264a0c:::obj-1-373:head# 2024-09-16T03:58:28.492 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.509 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:302ca5e7:::obj-1-206:head# 2024-09-16T03:58:28.509 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.526 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:309878e8:::obj-1-508:head# 2024-09-16T03:58:28.526 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.542 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:309a0ac3:::obj-1-188:head# 2024-09-16T03:58:28.542 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.558 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:30f030e9:::obj-1-53:head# 2024-09-16T03:58:28.559 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.575 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:31242a73:::obj-1-528:head# 2024-09-16T03:58:28.575 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.592 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:31463825:::obj-1-34:head# 2024-09-16T03:58:28.592 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.609 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3166dc86:::obj-1-355:head# 2024-09-16T03:58:28.609 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.625 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:31baa2fa:::obj-1-252:head# 2024-09-16T03:58:28.625 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.642 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:31d8935e:::obj-1-193:head# 2024-09-16T03:58:28.642 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.659 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:32670b14:::obj-1-305:head# 2024-09-16T03:58:28.659 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.675 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:33da02fa:::obj-1-114:head# 2024-09-16T03:58:28.675 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.692 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:34373133:::obj-1-446:head# 2024-09-16T03:58:28.692 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.709 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:347b7083:::obj-1-89:head# 2024-09-16T03:58:28.709 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.725 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:349125c1:::obj-1-148:head# 2024-09-16T03:58:28.726 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.742 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:34b80eee:::obj-1-138:head# 2024-09-16T03:58:28.742 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.759 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:34db48f8:::obj-1-49:head# 2024-09-16T03:58:28.759 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.775 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3669ff0c:::obj-1-313:head# 2024-09-16T03:58:28.776 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.792 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:36c1b610:::obj-1-249:head# 2024-09-16T03:58:28.792 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.809 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:374c250b:::obj-1-324:head# 2024-09-16T03:58:28.809 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.826 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3761a149:::obj-1-342:head# 2024-09-16T03:58:28.826 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.860 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:379ff95a:::obj-1-341:head# 2024-09-16T03:58:28.860 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.901 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:37dc15a6:::obj-1-26:head# 2024-09-16T03:58:28.902 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.926 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:38130e33:::obj-1-552:head# 2024-09-16T03:58:28.926 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.942 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:39c44880:::obj-1-538:head# 2024-09-16T03:58:28.942 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.959 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3a08dec9:::obj-1-368:head# 2024-09-16T03:58:28.959 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.976 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3a2b46a6:::obj-1-407:head# 2024-09-16T03:58:28.976 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:28.992 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3a7dfe0a:::obj-1-285:head# 2024-09-16T03:58:28.992 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.009 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3aebb144:::obj-1-248:head# 2024-09-16T03:58:29.009 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.026 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3b08b36f:::obj-1-310:head# 2024-09-16T03:58:29.026 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.042 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3b28ffa3:::obj-1-295:head# 2024-09-16T03:58:29.042 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.059 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3ba79bd1:::obj-1-444:head# 2024-09-16T03:58:29.059 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.076 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3c05df8d:::obj-1-319:head# 2024-09-16T03:58:29.076 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.092 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3c57e6a9:::obj-1-436:head# 2024-09-16T03:58:29.093 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.109 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3c73d8ee:::obj-1-298:head# 2024-09-16T03:58:29.109 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.126 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3cb6ae2a:::obj-1-400:head# 2024-09-16T03:58:29.126 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.143 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3cb71491:::obj-1-328:head# 2024-09-16T03:58:29.143 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.159 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3cb842fe:::obj-1-541:head# 2024-09-16T03:58:29.159 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.176 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3cf6835e:::obj-1-496:head# 2024-09-16T03:58:29.176 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.193 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3cf78507:::obj-1-573:head# 2024-09-16T03:58:29.193 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.211 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3d0dab84:::obj-1-554:head# 2024-09-16T03:58:29.211 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.228 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3d1a5f9d:::obj-1-323:head# 2024-09-16T03:58:29.228 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.243 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3da5f3a2:::obj-1-414:head# 2024-09-16T03:58:29.243 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.260 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3dbb65f0:::obj-1-440:head# 2024-09-16T03:58:29.260 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.277 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3dc94618:::obj-1-223:head# 2024-09-16T03:58:29.277 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.293 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3df3d5ab:::obj-1-25:head# 2024-09-16T03:58:29.293 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.311 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3e167988:::obj-1-336:head# 2024-09-16T03:58:29.311 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.326 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3e4ef3bd:::obj-1-104:head# 2024-09-16T03:58:29.326 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.345 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3e9e1efd:::obj-1-357:head# 2024-09-16T03:58:29.345 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.360 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3ebbe3a7:::obj-1-42:head# 2024-09-16T03:58:29.360 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.377 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3ec80373:::obj-1-403:head# 2024-09-16T03:58:29.377 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.393 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3ed086e4:::obj-1-13:head# 2024-09-16T03:58:29.394 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.410 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:3fe8e157:::obj-1-164:head# 2024-09-16T03:58:29.410 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.418 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:401ddfd4:::obj-1-379:head# 2024-09-16T03:58:29.418 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.436 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4092f6cd:::obj-1-430:head# 2024-09-16T03:58:29.436 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.451 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:414bd7cc:::obj-1-562:head# 2024-09-16T03:58:29.451 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.468 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:422bd9d0:::obj-1-287:head# 2024-09-16T03:58:29.468 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.477 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4255002d:::obj-1-578:head# 2024-09-16T03:58:29.477 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.494 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4270725c:::obj-1-109:head# 2024-09-16T03:58:29.494 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.510 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:42836669:::obj-1-31:head# 2024-09-16T03:58:29.510 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.526 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:428d93ef:::obj-1-32:head# 2024-09-16T03:58:29.527 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.535 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4327ef5b:::obj-1-453:head# 2024-09-16T03:58:29.535 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.543 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:440eb07b:::obj-1-236:head# 2024-09-16T03:58:29.543 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.560 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:442a028a:::obj-1-365:head# 2024-09-16T03:58:29.560 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.576 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:449ca54a:::obj-1-161:head# 2024-09-16T03:58:29.577 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.593 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:45128c3b:::obj-1-343:head# 2024-09-16T03:58:29.593 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.610 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:45801bf6:::obj-1-264:head# 2024-09-16T03:58:29.610 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.627 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:45896f61:::obj-1-48:head# 2024-09-16T03:58:29.627 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.643 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:459b7f1c:::obj-1-190:head# 2024-09-16T03:58:29.643 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.661 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:466af96a:::obj-1-486:head# 2024-09-16T03:58:29.661 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.677 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:47387ce4:::obj-1-575:head# 2024-09-16T03:58:29.677 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.693 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:47c94cc8:::obj-1-564:head# 2024-09-16T03:58:29.694 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.701 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:47d7f8ed:::obj-1-544:head# 2024-09-16T03:58:29.702 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.718 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:47fc0ec3:::obj-1-558:head# 2024-09-16T03:58:29.718 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.751 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:48ba42d8:::obj-1-156:head# 2024-09-16T03:58:29.752 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.793 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:494e269e:::obj-1-600:head# 2024-09-16T03:58:29.793 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.829 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:49646095:::obj-1-73:head# 2024-09-16T03:58:29.830 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.869 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:49eb65ab:::obj-1-374:head# 2024-09-16T03:58:29.869 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.893 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4a0075a4:::obj-1-432:head# 2024-09-16T03:58:29.893 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.910 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4af1ffc2:::obj-1-72:head# 2024-09-16T03:58:29.910 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.927 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4bc1c46f:::obj-1-346:head# 2024-09-16T03:58:29.927 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.943 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4bd55e68:::obj-1-93:head# 2024-09-16T03:58:29.943 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.960 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4c6d2760:::obj-1-198:head# 2024-09-16T03:58:29.960 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.977 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4cb9be3b:::obj-1-451:head# 2024-09-16T03:58:29.977 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.985 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4d260a64:::obj-1-514:head# 2024-09-16T03:58:29.985 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:29.993 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4d7d6284:::obj-1-583:head# 2024-09-16T03:58:29.993 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.002 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4e79ac02:::obj-1-437:head# 2024-09-16T03:58:30.002 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.010 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4e980099:::obj-1-507:head# 2024-09-16T03:58:30.010 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.027 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4ea8f99c:::obj-1-211:head# 2024-09-16T03:58:30.027 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.035 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4eabdc2a:::obj-1-590:head# 2024-09-16T03:58:30.035 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.052 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4f97fd73:::obj-1-243:head# 2024-09-16T03:58:30.052 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.060 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4fe00224:::obj-1-229:head# 2024-09-16T03:58:30.060 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.077 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4fead9ab:::obj-1-476:head# 2024-09-16T03:58:30.077 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.085 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:4ffddfd7:::obj-1-462:head# 2024-09-16T03:58:30.085 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.102 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5085c04d:::obj-1-100:head# 2024-09-16T03:58:30.102 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.110 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:50a8b465:::obj-1-574:head# 2024-09-16T03:58:30.110 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.127 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:518a151f:::obj-1-189:head# 2024-09-16T03:58:30.127 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.135 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:519afc95:::obj-1-314:head# 2024-09-16T03:58:30.135 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.143 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:52199781:::obj-1-202:head# 2024-09-16T03:58:30.144 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.152 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:52313062:::obj-1-337:head# 2024-09-16T03:58:30.152 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.169 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:526a5196:::obj-1-225:head# 2024-09-16T03:58:30.169 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.177 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:53128d32:::obj-1-483:head# 2024-09-16T03:58:30.177 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.185 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:53c2bb21:::obj-1-532:head# 2024-09-16T03:58:30.185 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.194 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:53fa4f3c:::obj-1-423:head# 2024-09-16T03:58:30.194 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.202 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:541c1d30:::obj-1-143:head# 2024-09-16T03:58:30.202 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.210 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:548d20c3:::obj-1-352:head# 2024-09-16T03:58:30.210 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.219 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:54e4c6f9:::obj-1-101:head# 2024-09-16T03:58:30.219 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.227 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:55016e06:::obj-1-276:head# 2024-09-16T03:58:30.227 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.235 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5510c784:::obj-1-491:head# 2024-09-16T03:58:30.236 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.261 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:551275ef:::obj-1-239:head# 2024-09-16T03:58:30.261 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.269 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:556df001:::obj-1-46:head# 2024-09-16T03:58:30.269 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.277 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:558fb5b1:::obj-1-536:head# 2024-09-16T03:58:30.277 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.285 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:56390d98:::obj-1-64:head# 2024-09-16T03:58:30.285 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.294 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:564f962a:::obj-1-125:head# 2024-09-16T03:58:30.294 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.302 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:56936e94:::obj-1-251:head# 2024-09-16T03:58:30.303 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.311 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:57585d3d:::obj-1-294:head# 2024-09-16T03:58:30.311 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.319 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5764cf7b:::obj-1-479:head# 2024-09-16T03:58:30.319 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.327 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5782341a:::obj-1-218:head# 2024-09-16T03:58:30.327 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.336 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:57d07a1a:::obj-1-317:head# 2024-09-16T03:58:30.336 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.344 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:58700205:::obj-1-176:head# 2024-09-16T03:58:30.344 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.352 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:58aee718:::obj-1-434:head# 2024-09-16T03:58:30.352 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.361 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:594c9d52:::obj-1-458:head# 2024-09-16T03:58:30.361 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.369 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5a70b555:::obj-1-279:head# 2024-09-16T03:58:30.369 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.377 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5b02568b:::obj-1-586:head# 2024-09-16T03:58:30.377 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.386 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5b69cdcf:::obj-1-391:head# 2024-09-16T03:58:30.386 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.394 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5cf151b5:::obj-1-510:head# 2024-09-16T03:58:30.394 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.402 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5d7fd07f:::obj-1-152:head# 2024-09-16T03:58:30.402 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.411 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5de288d7:::obj-1-235:head# 2024-09-16T03:58:30.411 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.419 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5ec497cd:::obj-1-44:head# 2024-09-16T03:58:30.419 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.427 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5fb3a09f:::obj-1-518:head# 2024-09-16T03:58:30.428 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.436 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:5ff3c2ef:::obj-1-470:head# 2024-09-16T03:58:30.436 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.444 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:601efcb1:::obj-1-549:head# 2024-09-16T03:58:30.444 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.452 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:60831338:::obj-1-263:head# 2024-09-16T03:58:30.453 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.461 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6092777b:::obj-1-145:head# 2024-09-16T03:58:30.461 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.469 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:60b17206:::obj-1-411:head# 2024-09-16T03:58:30.469 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.478 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:610c957c:::obj-1-278:head# 2024-09-16T03:58:30.478 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.486 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:613b5ef4:::obj-1-504:head# 2024-09-16T03:58:30.486 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.494 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:61ed7d60:::obj-1-274:head# 2024-09-16T03:58:30.494 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.503 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:621b6751:::obj-1-212:head# 2024-09-16T03:58:30.503 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.511 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:62b0aba9:::obj-1-253:head# 2024-09-16T03:58:30.511 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.519 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:64017240:::obj-1-102:head# 2024-09-16T03:58:30.519 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.528 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:645f4f49:::obj-1-332:head# 2024-09-16T03:58:30.528 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.536 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:65db82b9:::obj-1-334:head# 2024-09-16T03:58:30.536 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.544 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:667422e5:::obj-1-465:head# 2024-09-16T03:58:30.545 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.553 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:66c50bc2:::obj-1-322:head# 2024-09-16T03:58:30.553 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.561 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:681a4577:::obj-1-511:head# 2024-09-16T03:58:30.561 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6874e007:::obj-1-398:head# 2024-09-16T03:58:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.578 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:693746c1:::obj-1-582:head# 2024-09-16T03:58:30.578 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.586 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:69638b0c:::obj-1-8:head# 2024-09-16T03:58:30.586 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.594 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6967de6e:::obj-1-331:head# 2024-09-16T03:58:30.595 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.603 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:69da97aa:::obj-1-340:head# 2024-09-16T03:58:30.603 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.611 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6b3a50a6:::obj-1-144:head# 2024-09-16T03:58:30.611 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.628 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6be4ef26:::obj-1-579:head# 2024-09-16T03:58:30.628 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.636 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6d735549:::obj-1-599:head# 2024-09-16T03:58:30.636 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.645 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6e22c25e:::obj-1-9:head# 2024-09-16T03:58:30.645 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.653 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6e2ced4e:::obj-1-370:head# 2024-09-16T03:58:30.653 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.661 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6e961169:::obj-1-428:head# 2024-09-16T03:58:30.661 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.670 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6efcbbee:::obj-1-168:head# 2024-09-16T03:58:30.670 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.678 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6f20741c:::obj-1-33:head# 2024-09-16T03:58:30.678 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.686 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6fe4c885:::obj-1-273:head# 2024-09-16T03:58:30.687 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.695 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:6fffdea2:::obj-1-425:head# 2024-09-16T03:58:30.695 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.703 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:70716852:::obj-1-593:head# 2024-09-16T03:58:30.703 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.711 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:70919606:::obj-1-515:head# 2024-09-16T03:58:30.711 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.720 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:70c39d76:::obj-1-467:head# 2024-09-16T03:58:30.720 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.728 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:70f57ad3:::obj-1-361:head# 2024-09-16T03:58:30.728 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.736 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7177c7b5:::obj-1-503:head# 2024-09-16T03:58:30.737 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.745 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:719b69bd:::obj-1-497:head# 2024-09-16T03:58:30.745 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.753 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:724f9347:::obj-1-6:head# 2024-09-16T03:58:30.753 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.761 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:726d9f6b:::obj-1-111:head# 2024-09-16T03:58:30.761 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.770 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:72a91baf:::obj-1-439:head# 2024-09-16T03:58:30.770 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.778 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:72aa43ee:::obj-1-534:head# 2024-09-16T03:58:30.778 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.786 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:72c40e11:::obj-1-288:head# 2024-09-16T03:58:30.787 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.795 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:74196d45:::obj-1-246:head# 2024-09-16T03:58:30.795 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.804 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:743f42b1:::obj-1-326:head# 2024-09-16T03:58:30.804 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.812 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7523b538:::obj-1-494:head# 2024-09-16T03:58:30.812 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.820 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:75310ed6:::obj-1-364:head# 2024-09-16T03:58:30.820 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.829 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7568e0bc:::obj-1-585:head# 2024-09-16T03:58:30.829 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.841 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:760219a3:::obj-1-353:head# 2024-09-16T03:58:30.841 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.875 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:763338c9:::obj-1-555:head# 2024-09-16T03:58:30.875 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.903 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:77bc2d65:::obj-1-386:head# 2024-09-16T03:58:30.904 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.912 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:77ed0c7a:::obj-1-492:head# 2024-09-16T03:58:30.912 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:785a4052:::obj-1-456:head# 2024-09-16T03:58:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.929 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:796799c3:::obj-1-195:head# 2024-09-16T03:58:30.929 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.937 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:79caf0c1:::obj-1-445:head# 2024-09-16T03:58:30.937 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.945 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7af5b3e4:::obj-1-217:head# 2024-09-16T03:58:30.945 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.953 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7b3a9063:::obj-1-169:head# 2024-09-16T03:58:30.953 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.962 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7b509a92:::obj-1-561:head# 2024-09-16T03:58:30.962 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.970 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7bc646b1:::obj-1-415:head# 2024-09-16T03:58:30.970 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.978 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7c2f9188:::obj-1-482:head# 2024-09-16T03:58:30.979 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.987 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7d0da936:::obj-1-11:head# 2024-09-16T03:58:30.987 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:30.995 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7d25ca2d:::obj-1-242:head# 2024-09-16T03:58:30.995 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.004 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7d64f81e:::obj-1-473:head# 2024-09-16T03:58:31.004 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.012 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7ef2ea1b:::obj-1-417:head# 2024-09-16T03:58:31.012 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.020 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7f52b238:::obj-1-308:head# 2024-09-16T03:58:31.020 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.029 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:7f7a313c:::obj-1-551:head# 2024-09-16T03:58:31.029 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.037 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:806827a7:::obj-1-472:head# 2024-09-16T03:58:31.037 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.045 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8112c3ab:::obj-1-45:head# 2024-09-16T03:58:31.045 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.054 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:81365b55:::obj-1-315:head# 2024-09-16T03:58:31.054 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.062 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:818ffdc3:::obj-1-345:head# 2024-09-16T03:58:31.062 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.070 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:81babab8:::obj-1-535:head# 2024-09-16T03:58:31.071 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.079 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8288f652:::obj-1-347:head# 2024-09-16T03:58:31.079 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.087 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8312eadd:::obj-1-14:head# 2024-09-16T03:58:31.087 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.096 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:83b89bc7:::obj-1-137:head# 2024-09-16T03:58:31.096 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.104 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:84a12321:::obj-1-134:head# 2024-09-16T03:58:31.104 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.112 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:84b26d62:::obj-1-408:head# 2024-09-16T03:58:31.112 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.121 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:84bbb26e:::obj-1-43:head# 2024-09-16T03:58:31.121 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.129 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:86fc0014:::obj-1-222:head# 2024-09-16T03:58:31.129 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.137 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:87488bf4:::obj-1-174:head# 2024-09-16T03:58:31.138 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.146 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8754389a:::obj-1-65:head# 2024-09-16T03:58:31.146 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.154 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:87a6ad67:::obj-1-366:head# 2024-09-16T03:58:31.154 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.162 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:87d32b83:::obj-1-513:head# 2024-09-16T03:58:31.163 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.171 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8813a346:::obj-1-540:head# 2024-09-16T03:58:31.171 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.179 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:88146951:::obj-1-216:head# 2024-09-16T03:58:31.179 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.188 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8820800d:::obj-1-83:head# 2024-09-16T03:58:31.188 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.196 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:88319745:::obj-1-98:head# 2024-09-16T03:58:31.196 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.204 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:88c969b8:::obj-1-54:head# 2024-09-16T03:58:31.204 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.246 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:895a2d53:::obj-1-150:head# 2024-09-16T03:58:31.246 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.254 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8ae006a0:::obj-1-241:head# 2024-09-16T03:58:31.254 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.263 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8bd44e64:::obj-1-300:head# 2024-09-16T03:58:31.263 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.271 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8beb257f:::obj-1-3:head# 2024-09-16T03:58:31.271 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.280 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8cd8c743:::obj-1-527:head# 2024-09-16T03:58:31.280 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.288 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8daa99c7:::obj-1-237:head# 2024-09-16T03:58:31.288 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.296 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8f5bccbf:::obj-1-59:head# 2024-09-16T03:58:31.296 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.304 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8f6d9945:::obj-1-151:head# 2024-09-16T03:58:31.304 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.313 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8f7c568c:::obj-1-261:head# 2024-09-16T03:58:31.313 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.321 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:8fbc59a9:::obj-1-589:head# 2024-09-16T03:58:31.321 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.329 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:90225d94:::obj-1-194:head# 2024-09-16T03:58:31.329 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.338 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:904c50d3:::obj-1-63:head# 2024-09-16T03:58:31.338 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.346 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:90e1bd79:::obj-1-450:head# 2024-09-16T03:58:31.346 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.354 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9274b06d:::obj-1-460:head# 2024-09-16T03:58:31.355 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.363 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:92af41f5:::obj-1-409:head# 2024-09-16T03:58:31.364 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.371 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:935a08d6:::obj-1-192:head# 2024-09-16T03:58:31.371 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.379 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:935f8a13:::obj-1-24:head# 2024-09-16T03:58:31.380 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.388 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:95230148:::obj-1-280:head# 2024-09-16T03:58:31.388 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.396 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:95342eb0:::obj-1-390:head# 2024-09-16T03:58:31.396 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.405 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9659d09c:::obj-1-292:head# 2024-09-16T03:58:31.405 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.413 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:970e8cb4:::obj-1-18:head# 2024-09-16T03:58:31.413 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.421 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:97d21cf1:::obj-1-80:head# 2024-09-16T03:58:31.421 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.429 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:982bdb12:::obj-1-302:head# 2024-09-16T03:58:31.430 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.438 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:985dfd75:::obj-1-91:head# 2024-09-16T03:58:31.438 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.446 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:986d245a:::obj-1-154:head# 2024-09-16T03:58:31.446 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.455 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:98a03e99:::obj-1-529:head# 2024-09-16T03:58:31.455 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.463 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:98b7103e:::obj-1-275:head# 2024-09-16T03:58:31.463 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.471 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:990f0ecf:::obj-1-427:head# 2024-09-16T03:58:31.471 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.480 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:996c1f26:::obj-1-96:head# 2024-09-16T03:58:31.480 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.488 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:99bd2018:::obj-1-17:head# 2024-09-16T03:58:31.488 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.496 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9a7434c9:::obj-1-469:head# 2024-09-16T03:58:31.496 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.505 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9a8e36cc:::obj-1-598:head# 2024-09-16T03:58:31.505 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.513 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9abcc369:::obj-1-442:head# 2024-09-16T03:58:31.513 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.521 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9b0ea06e:::obj-1-231:head# 2024-09-16T03:58:31.522 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.530 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9b34e80d:::obj-1-378:head# 2024-09-16T03:58:31.530 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.538 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9b55a2a9:::obj-1-60:head# 2024-09-16T03:58:31.538 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.546 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9be3f2da:::obj-1-597:head# 2024-09-16T03:58:31.547 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.555 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9bf62c88:::obj-1-447:head# 2024-09-16T03:58:31.555 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.564 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9c31857b:::obj-1-272:head# 2024-09-16T03:58:31.564 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.572 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9c533e91:::obj-1-19:head# 2024-09-16T03:58:31.572 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.580 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9ca70688:::obj-1-570:head# 2024-09-16T03:58:31.580 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.588 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9ccce337:::obj-1-147:head# 2024-09-16T03:58:31.588 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.597 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9d4b2dfc:::obj-1-267:head# 2024-09-16T03:58:31.597 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.605 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9d4df969:::obj-1-286:head# 2024-09-16T03:58:31.605 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.613 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9d714651:::obj-1-495:head# 2024-09-16T03:58:31.613 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.622 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9da65518:::obj-1-498:head# 2024-09-16T03:58:31.622 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.630 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9e94f27b:::obj-1-209:head# 2024-09-16T03:58:31.630 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.638 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9f39e910:::obj-1-354:head# 2024-09-16T03:58:31.638 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.647 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9f8f9ef4:::obj-1-226:head# 2024-09-16T03:58:31.647 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.655 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:9fcd3f36:::obj-1-47:head# 2024-09-16T03:58:31.655 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.663 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a0326d7d:::obj-1-338:head# 2024-09-16T03:58:31.664 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.672 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a05e7475:::obj-1-62:head# 2024-09-16T03:58:31.672 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.680 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a0955052:::obj-1-533:head# 2024-09-16T03:58:31.680 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.688 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a0aa6848:::obj-1-38:head# 2024-09-16T03:58:31.688 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.697 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a0fdc285:::obj-1-133:head# 2024-09-16T03:58:31.697 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.705 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a10290b8:::obj-1-245:head# 2024-09-16T03:58:31.705 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.713 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a118a8a8:::obj-1-500:head# 2024-09-16T03:58:31.714 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.722 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a11a4079:::obj-1-199:head# 2024-09-16T03:58:31.722 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.785 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a1b3ec36:::obj-1-15:head# 2024-09-16T03:58:31.785 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.830 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a1f5079b:::obj-1-468:head# 2024-09-16T03:58:31.831 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.880 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a1ff04b5:::obj-1-167:head# 2024-09-16T03:58:31.881 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.905 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a21cc437:::obj-1-128:head# 2024-09-16T03:58:31.905 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.914 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a2966c77:::obj-1-140:head# 2024-09-16T03:58:31.914 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.922 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a321e537:::obj-1-184:head# 2024-09-16T03:58:31.922 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.964 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a33418d8:::obj-1-488:head# 2024-09-16T03:58:31.964 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.972 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a38b1c1a:::obj-1-584:head# 2024-09-16T03:58:31.972 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.980 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a3f83221:::obj-1-158:head# 2024-09-16T03:58:31.981 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.989 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a46e33eb:::obj-1-106:head# 2024-09-16T03:58:31.989 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:31.997 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a491460d:::obj-1-421:head# 2024-09-16T03:58:31.997 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.005 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a4dd813b:::obj-1-530:head# 2024-09-16T03:58:32.005 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.014 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a4e0d96d:::obj-1-351:head# 2024-09-16T03:58:32.014 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.022 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a52657b4:::obj-1-557:head# 2024-09-16T03:58:32.022 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.031 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a5b3bca6:::obj-1-277:head# 2024-09-16T03:58:32.031 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.039 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a5f5a9fb:::obj-1-170:head# 2024-09-16T03:58:32.039 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.047 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a6aeed57:::obj-1-141:head# 2024-09-16T03:58:32.047 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.056 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a6dda70f:::obj-1-471:head# 2024-09-16T03:58:32.056 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.064 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a71186c0:::obj-1-406:head# 2024-09-16T03:58:32.064 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.072 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a764ad8c:::obj-1-221:head# 2024-09-16T03:58:32.072 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.081 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a7b63473:::obj-1-131:head# 2024-09-16T03:58:32.081 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.089 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a88042fa:::obj-1-296:head# 2024-09-16T03:58:32.089 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.097 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:a8805fe0:::obj-1-213:head# 2024-09-16T03:58:32.097 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.106 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:aa4f12b1:::obj-1-270:head# 2024-09-16T03:58:32.106 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.114 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ab27f701:::obj-1-399:head# 2024-09-16T03:58:32.114 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.122 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ab8027c1:::obj-1-360:head# 2024-09-16T03:58:32.122 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.131 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ac3ef8ab:::obj-1-371:head# 2024-09-16T03:58:32.131 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.139 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ac4db76d:::obj-1-405:head# 2024-09-16T03:58:32.139 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.147 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ad53cb29:::obj-1-256:head# 2024-09-16T03:58:32.147 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.156 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ad704c16:::obj-1-485:head# 2024-09-16T03:58:32.156 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.164 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:adec4920:::obj-1-107:head# 2024-09-16T03:58:32.164 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.172 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ae3a94b3:::obj-1-95:head# 2024-09-16T03:58:32.172 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.181 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ae92616e:::obj-1-448:head# 2024-09-16T03:58:32.181 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.189 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ae975168:::obj-1-426:head# 2024-09-16T03:58:32.189 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.197 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:aee8fd62:::obj-1-27:head# 2024-09-16T03:58:32.198 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.206 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:af38aa87:::obj-1-50:head# 2024-09-16T03:58:32.206 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b0327eb3:::obj-1-380:head# 2024-09-16T03:58:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b03cd166:::obj-1-203:head# 2024-09-16T03:58:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.231 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b06f06e0:::obj-1-126:head# 2024-09-16T03:58:32.231 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.239 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b0972538:::obj-1-506:head# 2024-09-16T03:58:32.239 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.248 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b0cfb86a:::obj-1-359:head# 2024-09-16T03:58:32.248 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.256 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b10adb1c:::obj-1-333:head# 2024-09-16T03:58:32.256 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.264 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b20b9004:::obj-1-401:head# 2024-09-16T03:58:32.264 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.273 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b2113757:::obj-1-4:head# 2024-09-16T03:58:32.273 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.281 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b22441e9:::obj-1-29:head# 2024-09-16T03:58:32.281 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.289 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b2472384:::obj-1-207:head# 2024-09-16T03:58:32.290 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.298 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b2604227:::obj-1-502:head# 2024-09-16T03:58:32.298 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.306 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b3277f89:::obj-1-175:head# 2024-09-16T03:58:32.306 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.314 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b3d09e0d:::obj-1-258:head# 2024-09-16T03:58:32.314 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.323 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b3e9969a:::obj-1-499:head# 2024-09-16T03:58:32.323 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.331 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b4892e7d:::obj-1-155:head# 2024-09-16T03:58:32.331 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.340 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b4b76084:::obj-1-581:head# 2024-09-16T03:58:32.340 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.348 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b6e47ae5:::obj-1-215:head# 2024-09-16T03:58:32.348 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.356 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b75af5ff:::obj-1-228:head# 2024-09-16T03:58:32.356 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.365 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b8e2e20f:::obj-1-220:head# 2024-09-16T03:58:32.365 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.373 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:b8e80c4e:::obj-1-576:head# 2024-09-16T03:58:32.373 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.381 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ba502aee:::obj-1-255:head# 2024-09-16T03:58:32.381 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.390 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ba9c3e6e:::obj-1-57:head# 2024-09-16T03:58:32.390 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.398 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bb068062:::obj-1-461:head# 2024-09-16T03:58:32.398 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.406 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bb16c115:::obj-1-157:head# 2024-09-16T03:58:32.406 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.423 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bb447914:::obj-1-481:head# 2024-09-16T03:58:32.423 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.432 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bb6c8e0f:::obj-1-348:head# 2024-09-16T03:58:32.432 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.440 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bb77d6d0:::obj-1-301:head# 2024-09-16T03:58:32.440 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.448 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bc51c5f6:::obj-1-422:head# 2024-09-16T03:58:32.448 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.457 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bc838d5c:::obj-1-35:head# 2024-09-16T03:58:32.457 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.465 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bceae5eb:::obj-1-56:head# 2024-09-16T03:58:32.465 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.473 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bea17ef6:::obj-1-84:head# 2024-09-16T03:58:32.474 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.482 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:beb88be5:::obj-1-396:head# 2024-09-16T03:58:32.482 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.490 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:beed7b18:::obj-1-569:head# 2024-09-16T03:58:32.490 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.498 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bf0bff49:::obj-1-385:head# 2024-09-16T03:58:32.499 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.541 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bf545d5a:::obj-1-69:head# 2024-09-16T03:58:32.541 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.549 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bf560a7f:::obj-1-40:head# 2024-09-16T03:58:32.549 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.557 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:bff6999c:::obj-1-240:head# 2024-09-16T03:58:32.557 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.565 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c0a33d38:::obj-1-321:head# 2024-09-16T03:58:32.565 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.573 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c1e4c9b4:::obj-1-299:head# 2024-09-16T03:58:32.574 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.582 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c1ec515a:::obj-1-16:head# 2024-09-16T03:58:32.582 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.590 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c22de3c8:::obj-1-110:head# 2024-09-16T03:58:32.590 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.599 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c231cd7c:::obj-1-58:head# 2024-09-16T03:58:32.599 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.607 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c2ee6ace:::obj-1-186:head# 2024-09-16T03:58:32.607 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.615 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c32bfef2:::obj-1-181:head# 2024-09-16T03:58:32.615 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.624 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c575a298:::obj-1-466:head# 2024-09-16T03:58:32.624 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.632 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c58c3f80:::obj-1-493:head# 2024-09-16T03:58:32.632 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.640 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c6442cf2:::obj-1-455:head# 2024-09-16T03:58:32.641 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.649 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c6619413:::obj-1-37:head# 2024-09-16T03:58:32.649 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.657 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c6c2f8e5:::obj-1-519:head# 2024-09-16T03:58:32.657 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.665 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c6f811a2:::obj-1-180:head# 2024-09-16T03:58:32.665 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.674 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c72af975:::obj-1-21:head# 2024-09-16T03:58:32.674 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.682 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c73eb350:::obj-1-356:head# 2024-09-16T03:58:32.682 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.690 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c7a683da:::obj-1-410:head# 2024-09-16T03:58:32.691 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.699 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c7eb9bcc:::obj-1-553:head# 2024-09-16T03:58:32.699 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.707 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c886df99:::obj-1-269:head# 2024-09-16T03:58:32.707 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.716 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c932e3ec:::obj-1-135:head# 2024-09-16T03:58:32.716 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.724 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c9b6507a:::obj-1-520:head# 2024-09-16T03:58:32.724 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.732 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:c9e3b064:::obj-1-244:head# 2024-09-16T03:58:32.732 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.741 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:cb705d66:::obj-1-377:head# 2024-09-16T03:58:32.741 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.749 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:cc80e25c:::obj-1-115:head# 2024-09-16T03:58:32.749 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.757 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:cd1ec88e:::obj-1-297:head# 2024-09-16T03:58:32.757 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.766 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:cd7e6936:::obj-1-234:head# 2024-09-16T03:58:32.766 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.774 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ce32b69c:::obj-1-30:head# 2024-09-16T03:58:32.774 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.782 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:cf2b123c:::obj-1-293:head# 2024-09-16T03:58:32.782 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.791 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:cf2e80a9:::obj-1-542:head# 2024-09-16T03:58:32.791 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.799 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:cf51da6a:::obj-1-284:head# 2024-09-16T03:58:32.799 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.807 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:cf590f42:::obj-1-381:head# 2024-09-16T03:58:32.808 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.816 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:cf68a2b1:::obj-1-68:head# 2024-09-16T03:58:32.816 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.824 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:cf6aefb6:::obj-1-28:head# 2024-09-16T03:58:32.824 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.832 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:cfd8e6af:::obj-1-105:head# 2024-09-16T03:58:32.833 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.883 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d0640bad:::obj-1-254:head# 2024-09-16T03:58:32.883 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.924 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d101cda5:::obj-1-259:head# 2024-09-16T03:58:32.924 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.933 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d1be9386:::obj-1-416:head# 2024-09-16T03:58:32.933 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.941 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d243f036:::obj-1-265:head# 2024-09-16T03:58:32.941 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.949 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d2808c34:::obj-1-159:head# 2024-09-16T03:58:32.949 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.957 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d3415824:::obj-1-39:head# 2024-09-16T03:58:32.958 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.966 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d424f07a:::obj-1-547:head# 2024-09-16T03:58:32.966 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.974 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d44139f2:::obj-1-289:head# 2024-09-16T03:58:32.974 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.983 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d46015ab:::obj-1-546:head# 2024-09-16T03:58:32.983 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.991 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d4e503db:::obj-1-525:head# 2024-09-16T03:58:32.991 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:32.999 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d4e97d18:::obj-1-85:head# 2024-09-16T03:58:32.999 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.008 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d511492e:::obj-1-388:head# 2024-09-16T03:58:33.008 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.016 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d526a7fa:::obj-1-12:head# 2024-09-16T03:58:33.016 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.024 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d5667b59:::obj-1-369:head# 2024-09-16T03:58:33.024 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.033 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d57f2261:::obj-1-419:head# 2024-09-16T03:58:33.033 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.041 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d57f281b:::obj-1-250:head# 2024-09-16T03:58:33.041 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.049 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d6e05894:::obj-1-166:head# 2024-09-16T03:58:33.050 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.058 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d7689481:::obj-1-424:head# 2024-09-16T03:58:33.058 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.066 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d7d27743:::obj-1-129:head# 2024-09-16T03:58:33.066 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.074 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d7e4d3e9:::obj-1-127:head# 2024-09-16T03:58:33.075 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.083 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d7f1422a:::obj-1-594:head# 2024-09-16T03:58:33.083 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.091 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d8469fd2:::obj-1-153:head# 2024-09-16T03:58:33.091 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.100 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d84efd9e:::obj-1-435:head# 2024-09-16T03:58:33.100 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.108 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d883004b:::obj-1-162:head# 2024-09-16T03:58:33.108 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.116 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d8b60854:::obj-1-257:head# 2024-09-16T03:58:33.116 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.125 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d91aaae6:::obj-1-1:head# 2024-09-16T03:58:33.125 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.133 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d98695ca:::obj-1-524:head# 2024-09-16T03:58:33.133 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.141 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:d9ae97c8:::obj-1-177:head# 2024-09-16T03:58:33.141 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.183 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:da1713bd:::obj-1-309:head# 2024-09-16T03:58:33.183 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.191 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:da37824c:::obj-1-2:head# 2024-09-16T03:58:33.191 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.200 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:dab221b0:::obj-1-526:head# 2024-09-16T03:58:33.200 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.208 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:db27d885:::obj-1-363:head# 2024-09-16T03:58:33.208 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.216 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:dc001d76:::obj-1-329:head# 2024-09-16T03:58:33.216 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.225 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:dc4f4119:::obj-1-122:head# 2024-09-16T03:58:33.225 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.233 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:dcc36eb7:::obj-1-283:head# 2024-09-16T03:58:33.233 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.241 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:df7da06c:::obj-1-124:head# 2024-09-16T03:58:33.242 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.250 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:df7fcacb:::obj-1-330:head# 2024-09-16T03:58:33.250 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.258 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e05cbe31:::obj-1-413:head# 2024-09-16T03:58:33.259 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.266 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e1060a54:::obj-1-384:head# 2024-09-16T03:58:33.267 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.275 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e15b839b:::obj-1-316:head# 2024-09-16T03:58:33.275 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.283 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e161b6e5:::obj-1-103:head# 2024-09-16T03:58:33.283 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.292 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e1d1d79c:::obj-1-512:head# 2024-09-16T03:58:33.292 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.300 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e224b482:::obj-1-501:head# 2024-09-16T03:58:33.300 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.308 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e22d6f76:::obj-1-70:head# 2024-09-16T03:58:33.308 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.317 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e2bd801c:::obj-1-523:head# 2024-09-16T03:58:33.317 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.325 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e3d9f395:::obj-1-397:head# 2024-09-16T03:58:33.325 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.333 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e474ea25:::obj-1-457:head# 2024-09-16T03:58:33.334 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.342 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e49e1ff3:::obj-1-130:head# 2024-09-16T03:58:33.342 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.350 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e56c67a0:::obj-1-191:head# 2024-09-16T03:58:33.350 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.359 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e576e921:::obj-1-376:head# 2024-09-16T03:58:33.359 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.367 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e619fd26:::obj-1-395:head# 2024-09-16T03:58:33.367 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.375 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e625bdc5:::obj-1-522:head# 2024-09-16T03:58:33.375 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.384 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e68a0fa6:::obj-1-394:head# 2024-09-16T03:58:33.384 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.392 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e6cf260f:::obj-1-77:head# 2024-09-16T03:58:33.392 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.400 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e6d6255a:::obj-1-108:head# 2024-09-16T03:58:33.400 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.409 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e7a35d2f:::obj-1-116:head# 2024-09-16T03:58:33.409 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.417 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e7b07de5:::obj-1-238:head# 2024-09-16T03:58:33.417 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.425 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e8037aba:::obj-1-404:head# 2024-09-16T03:58:33.426 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.434 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e8e8b34f:::obj-1-291:head# 2024-09-16T03:58:33.434 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.442 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:e987cd7a:::obj-1-123:head# 2024-09-16T03:58:33.442 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.450 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ea534db1:::obj-1-311:head# 2024-09-16T03:58:33.451 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.459 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:eabcc188:::obj-1-325:head# 2024-09-16T03:58:33.459 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.467 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:eb086660:::obj-1-595:head# 2024-09-16T03:58:33.467 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.476 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:eb2235d3:::obj-1-596:head# 2024-09-16T03:58:33.476 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.484 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:eb35ae40:::obj-1-516:head# 2024-09-16T03:58:33.484 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.492 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:eb360a13:::obj-1-224:head# 2024-09-16T03:58:33.492 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.501 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:eb3a3ea1:::obj-1-120:head# 2024-09-16T03:58:33.501 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.509 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ebca9f6e:::obj-1-290:head# 2024-09-16T03:58:33.509 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.517 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ec81db71:::obj-1-478:head# 2024-09-16T03:58:33.517 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.525 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:edeafa4c:::obj-1-362:head# 2024-09-16T03:58:33.526 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.534 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:eeb5261b:::obj-1-539:head# 2024-09-16T03:58:33.534 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.543 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:eec00eee:::obj-1-567:head# 2024-09-16T03:58:33.544 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.551 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ef075e10:::obj-1-463:head# 2024-09-16T03:58:33.551 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.559 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ef8e37d9:::obj-1-94:head# 2024-09-16T03:58:33.559 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.567 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:efad7f67:::obj-1-197:head# 2024-09-16T03:58:33.568 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.584 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:efe09ea7:::obj-1-537:head# 2024-09-16T03:58:33.584 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.601 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f0445019:::obj-1-480:head# 2024-09-16T03:58:33.601 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.609 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f08a432c:::obj-1-489:head# 2024-09-16T03:58:33.609 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.617 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f0bd9006:::obj-1-487:head# 2024-09-16T03:58:33.618 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.626 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f11a115d:::obj-1-591:head# 2024-09-16T03:58:33.626 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.634 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f232e0af:::obj-1-146:head# 2024-09-16T03:58:33.634 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.642 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f258db54:::obj-1-521:head# 2024-09-16T03:58:33.643 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.651 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f29cc204:::obj-1-566:head# 2024-09-16T03:58:33.651 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.659 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f2ae2451:::obj-1-66:head# 2024-09-16T03:58:33.659 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.667 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f318810a:::obj-1-160:head# 2024-09-16T03:58:33.667 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.676 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f3c35a0d:::obj-1-67:head# 2024-09-16T03:58:33.676 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.684 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f3ce9c90:::obj-1-88:head# 2024-09-16T03:58:33.684 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.692 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f3e3e81f:::obj-1-304:head# 2024-09-16T03:58:33.693 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.701 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f3f65b0a:::obj-1-367:head# 2024-09-16T03:58:33.701 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.709 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f4ea014b:::obj-1-149:head# 2024-09-16T03:58:33.709 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.718 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f52d115b:::obj-1-383:head# 2024-09-16T03:58:33.718 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.726 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f590311e:::obj-1-76:head# 2024-09-16T03:58:33.726 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.820 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f5a37734:::obj-1-51:head# 2024-09-16T03:58:33.820 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.862 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f5e2e77c:::obj-1-179:head# 2024-09-16T03:58:33.862 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.893 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f5e381bc:::obj-1-173:head# 2024-09-16T03:58:33.893 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.901 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f6c0ae0b:::obj-1-247:head# 2024-09-16T03:58:33.901 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.909 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f6db8a82:::obj-1-548:head# 2024-09-16T03:58:33.909 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.918 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f6e2dc46:::obj-1-36:head# 2024-09-16T03:58:33.918 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.926 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f76ee569:::obj-1-587:head# 2024-09-16T03:58:33.926 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.934 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f773b9ed:::obj-1-550:head# 2024-09-16T03:58:33.935 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.943 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f7e1adad:::obj-1-350:head# 2024-09-16T03:58:33.943 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.951 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f7eebf7a:::obj-1-559:head# 2024-09-16T03:58:33.951 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.959 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f877f025:::obj-1-187:head# 2024-09-16T03:58:33.959 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.968 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f992f9e9:::obj-1-402:head# 2024-09-16T03:58:33.968 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.976 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:f9fe960a:::obj-1-418:head# 2024-09-16T03:58:33.976 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.984 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:fa9b882f:::obj-1-165:head# 2024-09-16T03:58:33.985 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:33.993 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:fbd6461c:::obj-1-339:head# 2024-09-16T03:58:33.993 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:34.001 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:fbeab28d:::obj-1-431:head# 2024-09-16T03:58:34.002 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:34.009 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:fdea4138:::obj-1-185:head# 2024-09-16T03:58:34.010 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:34.018 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:fdfa7c9b:::obj-1-183:head# 2024-09-16T03:58:34.018 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:34.026 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:fe1ba57e:::obj-1-90:head# 2024-09-16T03:58:34.026 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:34.034 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:feb7adea:::obj-1-560:head# 2024-09-16T03:58:34.035 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:34.043 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ffab306e:::obj-1-97:head# 2024-09-16T03:58:34.043 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:34.051 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ffdfd397:::obj-1-433:head# 2024-09-16T03:58:34.051 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:34.059 INFO:tasks.workunit.client.0.smithi026.stdout:Write #2:ffe8cf04:::obj-1-303:head# 2024-09-16T03:58:34.060 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:34.068 INFO:tasks.workunit.client.0.smithi026.stdout:write_pg epoch 42 info 2.0( v 42'600 (42'500,42'600] local-lis/les=39/40 n=600 ec=26/26 lis/c=39/39 les/c/f=40/40/0 sis=39) 2024-09-16T03:58:34.085 INFO:tasks.workunit.client.0.smithi026.stdout:Import successful 2024-09-16T03:58:34.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:494: TEST_backfill_multi_partial: _objectstore_tool_nodown td/osd-backfill-space 1 --op import --pgid 1.0 --file td/osd-backfill-space/fillexport.out 2024-09-16T03:58:34.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-backfill-space 2024-09-16T03:58:34.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2024-09-16T03:58:34.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2024-09-16T03:58:34.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2024-09-16T03:58:34.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-backfill-space/1 2024-09-16T03:58:34.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-backfill-space/1 --op import --pgid 1.0 --file td/osd-backfill-space/fillexport.out 2024-09-16T03:58:35.574 INFO:tasks.workunit.client.0.smithi026.stdout:get_pg_num_history pg_num_history pg_num_history(e47 pg_nums {1={21=1},2={26=1},3={31=1}} deleted_pools ) 2024-09-16T03:58:35.574 INFO:tasks.workunit.client.0.smithi026.stdout:Importing pgid 1.0 2024-09-16T03:58:35.574 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0002d87b:::obj-fill-318:head# 2024-09-16T03:58:35.574 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.593 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:00676868:::obj-fill-583:head# 2024-09-16T03:58:35.594 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.602 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:00f4514e:::obj-fill-547:head# 2024-09-16T03:58:35.602 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.610 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:01596a3c:::obj-fill-533:head# 2024-09-16T03:58:35.610 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.618 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0285e89c:::obj-fill-190:head# 2024-09-16T03:58:35.618 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.627 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:02bd591e:::obj-fill-463:head# 2024-09-16T03:58:35.627 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.635 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:02c01ffe:::obj-fill-28:head# 2024-09-16T03:58:35.635 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.644 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:03ada31e:::obj-fill-285:head# 2024-09-16T03:58:35.644 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.652 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:03b07c3f:::obj-fill-568:head# 2024-09-16T03:58:35.652 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.660 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:03b85770:::obj-fill-573:head# 2024-09-16T03:58:35.660 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.668 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:03dcbe89:::obj-fill-375:head# 2024-09-16T03:58:35.669 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.677 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:04231826:::obj-fill-594:head# 2024-09-16T03:58:35.677 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.685 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:04d48684:::obj-fill-421:head# 2024-09-16T03:58:35.685 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.693 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:05385fcc:::obj-fill-299:head# 2024-09-16T03:58:35.693 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.702 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:05785d38:::obj-fill-159:head# 2024-09-16T03:58:35.702 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.710 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:057ec231:::obj-fill-138:head# 2024-09-16T03:58:35.710 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.719 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:06058b5e:::obj-fill-569:head# 2024-09-16T03:58:35.719 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.738 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:06d2a3d9:::obj-fill-284:head# 2024-09-16T03:58:35.739 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.788 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:07597b63:::obj-fill-459:head# 2024-09-16T03:58:35.789 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.839 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:075f4069:::obj-fill-550:head# 2024-09-16T03:58:35.839 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.869 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:08234052:::obj-fill-17:head# 2024-09-16T03:58:35.869 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.877 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:091ce2ec:::obj-fill-472:head# 2024-09-16T03:58:35.877 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.885 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:095fd509:::obj-fill-210:head# 2024-09-16T03:58:35.885 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.894 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0a52a594:::obj-fill-116:head# 2024-09-16T03:58:35.894 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.902 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0a63716b:::obj-fill-225:head# 2024-09-16T03:58:35.902 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.910 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0b0fa6fb:::obj-fill-541:head# 2024-09-16T03:58:35.910 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.919 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0b673f72:::obj-fill-232:head# 2024-09-16T03:58:35.919 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.927 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0bbcd1b2:::obj-fill-582:head# 2024-09-16T03:58:35.928 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.935 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0caf8ce3:::obj-fill-214:head# 2024-09-16T03:58:35.935 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.944 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0d94b9fb:::obj-fill-415:head# 2024-09-16T03:58:35.944 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.952 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0de4e6f7:::obj-fill-94:head# 2024-09-16T03:58:35.952 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.960 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0ef75768:::obj-fill-489:head# 2024-09-16T03:58:35.961 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.969 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0f67284f:::obj-fill-213:head# 2024-09-16T03:58:35.969 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.977 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:0f823df2:::obj-fill-234:head# 2024-09-16T03:58:35.977 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.986 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1005c08d:::obj-fill-490:head# 2024-09-16T03:58:35.986 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:35.994 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1039525f:::obj-fill-369:head# 2024-09-16T03:58:35.994 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.002 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:105fb36c:::obj-fill-226:head# 2024-09-16T03:58:36.003 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.011 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:111abdeb:::obj-fill-554:head# 2024-09-16T03:58:36.011 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.019 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:11392f3d:::obj-fill-453:head# 2024-09-16T03:58:36.019 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.027 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1169976c:::obj-fill-417:head# 2024-09-16T03:58:36.027 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.036 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:11840a2a:::obj-fill-477:head# 2024-09-16T03:58:36.036 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.044 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:11a4832e:::obj-fill-279:head# 2024-09-16T03:58:36.044 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.053 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:11a4d2f6:::obj-fill-256:head# 2024-09-16T03:58:36.053 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.061 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:12d52a31:::obj-fill-22:head# 2024-09-16T03:58:36.061 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.069 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:133c45db:::obj-fill-257:head# 2024-09-16T03:58:36.069 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.077 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:13563256:::obj-fill-150:head# 2024-09-16T03:58:36.078 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.086 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:13c09e00:::obj-fill-71:head# 2024-09-16T03:58:36.086 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.094 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:13e9fbed:::obj-fill-242:head# 2024-09-16T03:58:36.094 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.102 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:13fae6c2:::obj-fill-163:head# 2024-09-16T03:58:36.102 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.111 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:145025e0:::obj-fill-543:head# 2024-09-16T03:58:36.111 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.119 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:14517c84:::obj-fill-13:head# 2024-09-16T03:58:36.119 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.128 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:14802e9c:::obj-fill-127:head# 2024-09-16T03:58:36.129 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.136 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:150f1c96:::obj-fill-62:head# 2024-09-16T03:58:36.136 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.144 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:155e90a2:::obj-fill-537:head# 2024-09-16T03:58:36.144 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.153 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1632c776:::obj-fill-262:head# 2024-09-16T03:58:36.153 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.161 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:163bde28:::obj-fill-523:head# 2024-09-16T03:58:36.161 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.169 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:169c4ad0:::obj-fill-85:head# 2024-09-16T03:58:36.170 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.178 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:16c4da1d:::obj-fill-436:head# 2024-09-16T03:58:36.178 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.186 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:17b28c32:::obj-fill-345:head# 2024-09-16T03:58:36.186 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.194 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:17b34255:::obj-fill-577:head# 2024-09-16T03:58:36.194 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.203 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:17d2541f:::obj-fill-426:head# 2024-09-16T03:58:36.203 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.211 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:17ea19f2:::obj-fill-542:head# 2024-09-16T03:58:36.211 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.220 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:189155ea:::obj-fill-496:head# 2024-09-16T03:58:36.220 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.228 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:191a6d81:::obj-fill-548:head# 2024-09-16T03:58:36.228 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.236 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1a964993:::obj-fill-576:head# 2024-09-16T03:58:36.237 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.281 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1aa623dc:::obj-fill-356:head# 2024-09-16T03:58:36.281 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.294 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1abe5c38:::obj-fill-561:head# 2024-09-16T03:58:36.295 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.303 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1bddc06b:::obj-fill-7:head# 2024-09-16T03:58:36.303 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.311 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1be86b71:::obj-fill-295:head# 2024-09-16T03:58:36.311 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.319 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1c499bca:::obj-fill-240:head# 2024-09-16T03:58:36.320 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.328 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1c545e27:::obj-fill-509:head# 2024-09-16T03:58:36.328 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.336 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1c63c8f4:::obj-fill-4:head# 2024-09-16T03:58:36.336 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.344 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1d5a8f59:::obj-fill-377:head# 2024-09-16T03:58:36.344 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.386 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1d85b5df:::obj-fill-201:head# 2024-09-16T03:58:36.387 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.394 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1d9a0d5b:::obj-fill-581:head# 2024-09-16T03:58:36.395 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.404 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1dcf5667:::obj-fill-488:head# 2024-09-16T03:58:36.404 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.411 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1fa3090d:::obj-fill-458:head# 2024-09-16T03:58:36.411 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.420 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1fe937f6:::obj-fill-337:head# 2024-09-16T03:58:36.420 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.428 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:1ff54542:::obj-fill-349:head# 2024-09-16T03:58:36.428 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.436 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:20d9e0ca:::obj-fill-367:head# 2024-09-16T03:58:36.436 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.445 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:21b8e3bb:::obj-fill-538:head# 2024-09-16T03:58:36.445 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.453 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:227183d4:::obj-fill-235:head# 2024-09-16T03:58:36.453 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.461 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:229e5e5d:::obj-fill-522:head# 2024-09-16T03:58:36.462 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.470 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:234f8861:::obj-fill-476:head# 2024-09-16T03:58:36.470 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.478 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:23ac2c9d:::obj-fill-471:head# 2024-09-16T03:58:36.478 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.487 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:25db1742:::obj-fill-200:head# 2024-09-16T03:58:36.487 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.495 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:264f8545:::obj-fill-230:head# 2024-09-16T03:58:36.495 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.503 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:267ba97f:::obj-fill-493:head# 2024-09-16T03:58:36.503 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.511 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:26b067e8:::obj-fill-208:head# 2024-09-16T03:58:36.512 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.520 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:26f521cb:::obj-fill-300:head# 2024-09-16T03:58:36.520 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.528 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:27e70a11:::obj-fill-368:head# 2024-09-16T03:58:36.528 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.536 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:29357d4a:::obj-fill-456:head# 2024-09-16T03:58:36.537 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.545 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:29f2567e:::obj-fill-414:head# 2024-09-16T03:58:36.545 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.553 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2a10cbb6:::obj-fill-228:head# 2024-09-16T03:58:36.553 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.562 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2a1519a6:::obj-fill-148:head# 2024-09-16T03:58:36.562 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.570 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2a686ca6:::obj-fill-411:head# 2024-09-16T03:58:36.570 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.578 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2ab3f384:::obj-fill-77:head# 2024-09-16T03:58:36.578 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.587 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2ae6a1d0:::obj-fill-187:head# 2024-09-16T03:58:36.587 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.595 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2b890959:::obj-fill-222:head# 2024-09-16T03:58:36.595 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.603 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2bcc26c4:::obj-fill-114:head# 2024-09-16T03:58:36.603 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.612 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2bd3a3a2:::obj-fill-281:head# 2024-09-16T03:58:36.612 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.620 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2c1a21d7:::obj-fill-505:head# 2024-09-16T03:58:36.620 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.628 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2c255347:::obj-fill-95:head# 2024-09-16T03:58:36.628 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.637 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2c2a3f62:::obj-fill-131:head# 2024-09-16T03:58:36.637 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.645 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2c7d92ce:::obj-fill-442:head# 2024-09-16T03:58:36.645 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.653 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2d1ad117:::obj-fill-443:head# 2024-09-16T03:58:36.654 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.662 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2d57b2f7:::obj-fill-192:head# 2024-09-16T03:58:36.662 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.670 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2d7b53ea:::obj-fill-79:head# 2024-09-16T03:58:36.670 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.679 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2db25266:::obj-fill-121:head# 2024-09-16T03:58:36.679 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.687 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2e27853e:::obj-fill-473:head# 2024-09-16T03:58:36.687 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.695 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2f12cb21:::obj-fill-386:head# 2024-09-16T03:58:36.695 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.704 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2f957332:::obj-fill-422:head# 2024-09-16T03:58:36.704 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.712 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:2feae493:::obj-fill-301:head# 2024-09-16T03:58:36.712 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.720 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:302c95d2:::obj-fill-110:head# 2024-09-16T03:58:36.720 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.729 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:302d6b76:::obj-fill-374:head# 2024-09-16T03:58:36.729 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.737 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:30581f34:::obj-fill-313:head# 2024-09-16T03:58:36.737 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.745 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:307e86ac:::obj-fill-381:head# 2024-09-16T03:58:36.745 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.754 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:30ab77bf:::obj-fill-275:head# 2024-09-16T03:58:36.754 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.762 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:31127e6d:::obj-fill-250:head# 2024-09-16T03:58:36.762 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.770 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:32c93500:::obj-fill-155:head# 2024-09-16T03:58:36.770 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.779 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:339880b7:::obj-fill-227:head# 2024-09-16T03:58:36.779 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.787 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:34069e1e:::obj-fill-292:head# 2024-09-16T03:58:36.787 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.795 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:346dff31:::obj-fill-157:head# 2024-09-16T03:58:36.795 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.804 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:34ade0f1:::obj-fill-575:head# 2024-09-16T03:58:36.804 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.812 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:34bbae43:::obj-fill-90:head# 2024-09-16T03:58:36.813 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.821 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:34e97cf8:::obj-fill-334:head# 2024-09-16T03:58:36.821 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.829 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:35d7ccc2:::obj-fill-510:head# 2024-09-16T03:58:36.829 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.856 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:35f519b6:::obj-fill-513:head# 2024-09-16T03:58:36.856 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.882 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:364727e8:::obj-fill-130:head# 2024-09-16T03:58:36.882 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.929 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:364c0361:::obj-fill-586:head# 2024-09-16T03:58:36.929 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.937 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:368e7baf:::obj-fill-546:head# 2024-09-16T03:58:36.937 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.946 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:36ffb224:::obj-fill-82:head# 2024-09-16T03:58:36.946 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.954 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:371cb800:::obj-fill-330:head# 2024-09-16T03:58:36.954 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.962 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:37d5378d:::obj-fill-175:head# 2024-09-16T03:58:36.962 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.971 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:385593f3:::obj-fill-325:head# 2024-09-16T03:58:36.971 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.979 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:388d5073:::obj-fill-317:head# 2024-09-16T03:58:36.980 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.988 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:394af079:::obj-fill-59:head# 2024-09-16T03:58:36.988 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:36.996 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:3a41ad37:::obj-fill-409:head# 2024-09-16T03:58:36.996 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.004 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:3b3c63d2:::obj-fill-136:head# 2024-09-16T03:58:37.004 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.013 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:3bb50131:::obj-fill-512:head# 2024-09-16T03:58:37.013 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.021 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:3bb52bb5:::obj-fill-188:head# 2024-09-16T03:58:37.021 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.029 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:3c0683d1:::obj-fill-372:head# 2024-09-16T03:58:37.029 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.038 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:3c67d3f4:::obj-fill-249:head# 2024-09-16T03:58:37.038 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.046 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:3c6a4a4c:::obj-fill-495:head# 2024-09-16T03:58:37.046 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.054 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:3c7fc8c9:::obj-fill-324:head# 2024-09-16T03:58:37.054 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.063 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:3d940c50:::obj-fill-591:head# 2024-09-16T03:58:37.063 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.071 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:3ed5508e:::obj-fill-558:head# 2024-09-16T03:58:37.071 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.079 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:3f598316:::obj-fill-389:head# 2024-09-16T03:58:37.080 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.088 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:401cd0ce:::obj-fill-251:head# 2024-09-16T03:58:37.088 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.096 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:40fae006:::obj-fill-14:head# 2024-09-16T03:58:37.096 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.104 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4120b10f:::obj-fill-165:head# 2024-09-16T03:58:37.104 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.113 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:41b382c2:::obj-fill-289:head# 2024-09-16T03:58:37.113 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.121 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4277cdea:::obj-fill-319:head# 2024-09-16T03:58:37.121 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.129 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:42978c3c:::obj-fill-174:head# 2024-09-16T03:58:37.130 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.138 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:42b08dc2:::obj-fill-553:head# 2024-09-16T03:58:37.138 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.146 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:42ec4bf6:::obj-fill-209:head# 2024-09-16T03:58:37.146 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.154 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:430c129d:::obj-fill-448:head# 2024-09-16T03:58:37.154 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.163 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4335d553:::obj-fill-600:head# 2024-09-16T03:58:37.163 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.171 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:44804f62:::obj-fill-532:head# 2024-09-16T03:58:37.171 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.179 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:44954d54:::obj-fill-2:head# 2024-09-16T03:58:37.180 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.188 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4502f904:::obj-fill-429:head# 2024-09-16T03:58:37.188 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.196 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4568ddcb:::obj-fill-382:head# 2024-09-16T03:58:37.196 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.205 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:45939974:::obj-fill-563:head# 2024-09-16T03:58:37.205 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.213 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:462a5bbd:::obj-fill-567:head# 2024-09-16T03:58:37.213 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.222 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:47773ae4:::obj-fill-307:head# 2024-09-16T03:58:37.222 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.230 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4802b263:::obj-fill-387:head# 2024-09-16T03:58:37.230 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.238 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:483d938e:::obj-fill-128:head# 2024-09-16T03:58:37.238 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.246 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:48a7ad29:::obj-fill-147:head# 2024-09-16T03:58:37.246 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.255 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:493b61ce:::obj-fill-454:head# 2024-09-16T03:58:37.255 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.263 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4afb70fe:::obj-fill-186:head# 2024-09-16T03:58:37.263 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.271 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4bff08e3:::obj-fill-352:head# 2024-09-16T03:58:37.271 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.280 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4c01eabe:::obj-fill-370:head# 2024-09-16T03:58:37.280 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.288 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4c131560:::obj-fill-6:head# 2024-09-16T03:58:37.288 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.297 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4c4c5e14:::obj-fill-350:head# 2024-09-16T03:58:37.297 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.305 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4c80dc2c:::obj-fill-357:head# 2024-09-16T03:58:37.305 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.313 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4c9dee9b:::obj-fill-540:head# 2024-09-16T03:58:37.313 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.321 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4ce40c18:::obj-fill-280:head# 2024-09-16T03:58:37.322 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.330 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4d854fc3:::obj-fill-585:head# 2024-09-16T03:58:37.330 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.338 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:4f615b53:::obj-fill-101:head# 2024-09-16T03:58:37.339 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.347 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5042b30f:::obj-fill-84:head# 2024-09-16T03:58:37.347 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.355 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:507dc08b:::obj-fill-336:head# 2024-09-16T03:58:37.355 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.363 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:512fcf5a:::obj-fill-169:head# 2024-09-16T03:58:37.363 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.372 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:51a0c8f8:::obj-fill-578:head# 2024-09-16T03:58:37.372 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.380 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:51fd05a2:::obj-fill-425:head# 2024-09-16T03:58:37.380 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.388 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:52400ebc:::obj-fill-81:head# 2024-09-16T03:58:37.389 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.397 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5288d40c:::obj-fill-16:head# 2024-09-16T03:58:37.397 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.405 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5295b0ee:::obj-fill-224:head# 2024-09-16T03:58:37.405 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.414 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:531e4c60:::obj-fill-103:head# 2024-09-16T03:58:37.414 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.439 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:54259f28:::obj-fill-584:head# 2024-09-16T03:58:37.439 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.447 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:542d619c:::obj-fill-528:head# 2024-09-16T03:58:37.447 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.455 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5503ca3e:::obj-fill-494:head# 2024-09-16T03:58:37.455 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.463 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5555c48b:::obj-fill-403:head# 2024-09-16T03:58:37.464 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.472 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:558d1ec7:::obj-fill-447:head# 2024-09-16T03:58:37.472 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.505 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:55aa2233:::obj-fill-21:head# 2024-09-16T03:58:37.506 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.514 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:55aaf8c4:::obj-fill-29:head# 2024-09-16T03:58:37.514 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.522 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:55e246e1:::obj-fill-65:head# 2024-09-16T03:58:37.522 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.530 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:563b14a8:::obj-fill-120:head# 2024-09-16T03:58:37.531 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.539 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:56e1df25:::obj-fill-305:head# 2024-09-16T03:58:37.539 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.547 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5702979c:::obj-fill-73:head# 2024-09-16T03:58:37.547 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.555 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:570722ba:::obj-fill-219:head# 2024-09-16T03:58:37.556 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.564 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:57f7a09b:::obj-fill-571:head# 2024-09-16T03:58:37.564 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.572 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:585309ba:::obj-fill-144:head# 2024-09-16T03:58:37.572 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.581 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:585c7c9c:::obj-fill-437:head# 2024-09-16T03:58:37.581 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.589 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:587c63db:::obj-fill-182:head# 2024-09-16T03:58:37.589 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.597 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:58f34d6b:::obj-fill-598:head# 2024-09-16T03:58:37.597 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.605 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:58f40088:::obj-fill-298:head# 2024-09-16T03:58:37.605 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.614 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:591e150c:::obj-fill-32:head# 2024-09-16T03:58:37.614 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.622 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:59971ddb:::obj-fill-559:head# 2024-09-16T03:58:37.622 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.630 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5adafca4:::obj-fill-56:head# 2024-09-16T03:58:37.631 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.640 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5b32b04f:::obj-fill-484:head# 2024-09-16T03:58:37.640 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.647 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5bdaeb16:::obj-fill-99:head# 2024-09-16T03:58:37.647 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.655 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5c1d6f4b:::obj-fill-133:head# 2024-09-16T03:58:37.656 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.664 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5c92b8f1:::obj-fill-255:head# 2024-09-16T03:58:37.664 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.681 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5ca4850f:::obj-fill-238:head# 2024-09-16T03:58:37.681 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.697 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5d928a5b:::obj-fill-395:head# 2024-09-16T03:58:37.698 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.706 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5dd49320:::obj-fill-423:head# 2024-09-16T03:58:37.706 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.714 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5e7bc368:::obj-fill-506:head# 2024-09-16T03:58:37.714 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.723 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5ebd5ee3:::obj-fill-322:head# 2024-09-16T03:58:37.723 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.765 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5edeedf1:::obj-fill-557:head# 2024-09-16T03:58:37.765 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.798 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:5facf8e2:::obj-fill-15:head# 2024-09-16T03:58:37.798 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.857 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:603a2c76:::obj-fill-439:head# 2024-09-16T03:58:37.857 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.890 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:60b30714:::obj-fill-53:head# 2024-09-16T03:58:37.890 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.898 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:612b4a8a:::obj-fill-412:head# 2024-09-16T03:58:37.898 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.906 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:61a111b6:::obj-fill-87:head# 2024-09-16T03:58:37.907 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.915 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:63a0e8a2:::obj-fill-266:head# 2024-09-16T03:58:37.915 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.923 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:63aa4d60:::obj-fill-68:head# 2024-09-16T03:58:37.923 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.931 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:63ac5b95:::obj-fill-405:head# 2024-09-16T03:58:37.931 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.940 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6415a9e3:::obj-fill-400:head# 2024-09-16T03:58:37.940 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.948 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:64ba03ae:::obj-fill-20:head# 2024-09-16T03:58:37.948 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.956 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6512f015:::obj-fill-597:head# 2024-09-16T03:58:37.956 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.965 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:65433104:::obj-fill-504:head# 2024-09-16T03:58:37.965 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.973 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:65950c58:::obj-fill-86:head# 2024-09-16T03:58:37.973 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.981 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:65b6b2d7:::obj-fill-39:head# 2024-09-16T03:58:37.981 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.990 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:661c8afd:::obj-fill-267:head# 2024-09-16T03:58:37.990 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:37.998 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:66f87c94:::obj-fill-229:head# 2024-09-16T03:58:37.998 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.006 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:67292cef:::obj-fill-93:head# 2024-09-16T03:58:38.006 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.015 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:67f0e12c:::obj-fill-363:head# 2024-09-16T03:58:38.015 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.023 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:696eb83b:::obj-fill-185:head# 2024-09-16T03:58:38.023 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.031 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6b33981c:::obj-fill-259:head# 2024-09-16T03:58:38.031 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.040 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6b5a527c:::obj-fill-485:head# 2024-09-16T03:58:38.040 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.048 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6b6f1852:::obj-fill-390:head# 2024-09-16T03:58:38.048 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.057 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6ba5c5f8:::obj-fill-304:head# 2024-09-16T03:58:38.057 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.065 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6bce929d:::obj-fill-518:head# 2024-09-16T03:58:38.065 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.073 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6c8ffc04:::obj-fill-61:head# 2024-09-16T03:58:38.073 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.082 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6ca7e551:::obj-fill-40:head# 2024-09-16T03:58:38.082 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.090 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6caff2cd:::obj-fill-332:head# 2024-09-16T03:58:38.090 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.098 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6ce4adc7:::obj-fill-574:head# 2024-09-16T03:58:38.098 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.106 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6d09d770:::obj-fill-74:head# 2024-09-16T03:58:38.107 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.115 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6e039822:::obj-fill-278:head# 2024-09-16T03:58:38.115 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.123 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6f2cd109:::obj-fill-297:head# 2024-09-16T03:58:38.123 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.132 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6f3754c4:::obj-fill-88:head# 2024-09-16T03:58:38.132 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.140 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6f86cfd2:::obj-fill-511:head# 2024-09-16T03:58:38.140 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.149 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:6fe3f3f7:::obj-fill-193:head# 2024-09-16T03:58:38.149 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.157 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7002c57d:::obj-fill-50:head# 2024-09-16T03:58:38.157 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.165 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7030b2a3:::obj-fill-217:head# 2024-09-16T03:58:38.165 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.173 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:70665087:::obj-fill-51:head# 2024-09-16T03:58:38.174 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.182 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:70a0f5e0:::obj-fill-11:head# 2024-09-16T03:58:38.182 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.215 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:71f4643d:::obj-fill-236:head# 2024-09-16T03:58:38.216 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.223 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:722fbd0f:::obj-fill-302:head# 2024-09-16T03:58:38.224 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.232 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:72584da9:::obj-fill-445:head# 2024-09-16T03:58:38.232 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.240 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:72d91d24:::obj-fill-218:head# 2024-09-16T03:58:38.240 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.248 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:72f7268b:::obj-fill-106:head# 2024-09-16T03:58:38.249 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.257 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:74077abf:::obj-fill-435:head# 2024-09-16T03:58:38.257 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.265 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:740ca050:::obj-fill-112:head# 2024-09-16T03:58:38.265 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.273 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7435e881:::obj-fill-78:head# 2024-09-16T03:58:38.274 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.282 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:74ba0bb7:::obj-fill-478:head# 2024-09-16T03:58:38.282 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.290 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:74d82091:::obj-fill-96:head# 2024-09-16T03:58:38.290 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.299 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7515f56c:::obj-fill-483:head# 2024-09-16T03:58:38.299 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.307 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7550d6fe:::obj-fill-286:head# 2024-09-16T03:58:38.307 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.315 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:75807edc:::obj-fill-223:head# 2024-09-16T03:58:38.316 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.323 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:762ba324:::obj-fill-172:head# 2024-09-16T03:58:38.324 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.332 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:76369bda:::obj-fill-570:head# 2024-09-16T03:58:38.332 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.340 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7667a5b0:::obj-fill-196:head# 2024-09-16T03:58:38.341 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.349 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:77736c0c:::obj-fill-566:head# 2024-09-16T03:58:38.349 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.357 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:77fb47a4:::obj-fill-314:head# 2024-09-16T03:58:38.357 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.365 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:785ad894:::obj-fill-80:head# 2024-09-16T03:58:38.365 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.374 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:785e3d14:::obj-fill-530:head# 2024-09-16T03:58:38.374 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.382 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:788efef4:::obj-fill-595:head# 2024-09-16T03:58:38.382 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.390 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:789ec5ab:::obj-fill-44:head# 2024-09-16T03:58:38.390 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.408 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:798a3fa8:::obj-fill-517:head# 2024-09-16T03:58:38.408 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.415 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:79a105ef:::obj-fill-315:head# 2024-09-16T03:58:38.416 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.424 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:79d02f04:::obj-fill-243:head# 2024-09-16T03:58:38.424 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.432 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7a00dfcb:::obj-fill-402:head# 2024-09-16T03:58:38.432 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.440 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7b982684:::obj-fill-168:head# 2024-09-16T03:58:38.441 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.449 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7bb36851:::obj-fill-440:head# 2024-09-16T03:58:38.449 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.457 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7bb49d8c:::obj-fill-55:head# 2024-09-16T03:58:38.457 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.466 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7c77b783:::obj-fill-580:head# 2024-09-16T03:58:38.466 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.474 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7c89d75b:::obj-fill-555:head# 2024-09-16T03:58:38.474 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.482 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7d12fb67:::obj-fill-399:head# 2024-09-16T03:58:38.482 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.491 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7d139961:::obj-fill-92:head# 2024-09-16T03:58:38.491 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.499 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7d39ffd0:::obj-fill-135:head# 2024-09-16T03:58:38.499 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.507 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7e534cc4:::obj-fill-282:head# 2024-09-16T03:58:38.507 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7e7a08e0:::obj-fill-108:head# 2024-09-16T03:58:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.524 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7e8e2b67:::obj-fill-244:head# 2024-09-16T03:58:38.524 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.533 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7eea215e:::obj-fill-139:head# 2024-09-16T03:58:38.533 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.541 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7efa3c6e:::obj-fill-408:head# 2024-09-16T03:58:38.541 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.549 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7f03a24b:::obj-fill-45:head# 2024-09-16T03:58:38.549 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.557 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7f6a2e2b:::obj-fill-427:head# 2024-09-16T03:58:38.558 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.566 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7fb0abd6:::obj-fill-479:head# 2024-09-16T03:58:38.566 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.574 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:7fb77de1:::obj-fill-167:head# 2024-09-16T03:58:38.574 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.583 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:80012a03:::obj-fill-105:head# 2024-09-16T03:58:38.583 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.591 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:80075ae5:::obj-fill-376:head# 2024-09-16T03:58:38.591 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.599 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8089baa5:::obj-fill-97:head# 2024-09-16T03:58:38.599 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.608 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:80d0b4c5:::obj-fill-123:head# 2024-09-16T03:58:38.608 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.616 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:810f319f:::obj-fill-552:head# 2024-09-16T03:58:38.616 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.624 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:81427ef2:::obj-fill-474:head# 2024-09-16T03:58:38.625 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.633 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:818d780c:::obj-fill-33:head# 2024-09-16T03:58:38.633 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.641 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:819f31b9:::obj-fill-366:head# 2024-09-16T03:58:38.641 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.649 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8205549d:::obj-fill-125:head# 2024-09-16T03:58:38.649 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.658 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:821f56e5:::obj-fill-339:head# 2024-09-16T03:58:38.658 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.666 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:822807c6:::obj-fill-69:head# 2024-09-16T03:58:38.666 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.675 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:822fcf61:::obj-fill-560:head# 2024-09-16T03:58:38.675 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.683 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:82ad696b:::obj-fill-149:head# 2024-09-16T03:58:38.683 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.691 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:835cc771:::obj-fill-446:head# 2024-09-16T03:58:38.691 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.699 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8386bee1:::obj-fill-137:head# 2024-09-16T03:58:38.700 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.708 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:83c1303a:::obj-fill-311:head# 2024-09-16T03:58:38.708 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.716 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:83cf1c2a:::obj-fill-360:head# 2024-09-16T03:58:38.716 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.725 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:83d70321:::obj-fill-351:head# 2024-09-16T03:58:38.725 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.733 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:83ef162d:::obj-fill-331:head# 2024-09-16T03:58:38.733 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.741 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:840f8f20:::obj-fill-398:head# 2024-09-16T03:58:38.741 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.750 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:84d2e456:::obj-fill-207:head# 2024-09-16T03:58:38.750 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.791 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:856697ff:::obj-fill-333:head# 2024-09-16T03:58:38.792 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.800 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:858be937:::obj-fill-418:head# 2024-09-16T03:58:38.800 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.808 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:85a0b302:::obj-fill-438:head# 2024-09-16T03:58:38.808 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.816 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:85fa942e:::obj-fill-272:head# 2024-09-16T03:58:38.816 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.825 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:863eb6f8:::obj-fill-320:head# 2024-09-16T03:58:38.825 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.833 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:868d4588:::obj-fill-19:head# 2024-09-16T03:58:38.833 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.875 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8759d023:::obj-fill-466:head# 2024-09-16T03:58:38.875 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.917 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:88072111:::obj-fill-312:head# 2024-09-16T03:58:38.917 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.925 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:886edcef:::obj-fill-380:head# 2024-09-16T03:58:38.925 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.933 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:88ce753e:::obj-fill-43:head# 2024-09-16T03:58:38.934 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.941 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:890e1d83:::obj-fill-590:head# 2024-09-16T03:58:38.942 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.950 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:891566a3:::obj-fill-341:head# 2024-09-16T03:58:38.950 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.958 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:891ca235:::obj-fill-177:head# 2024-09-16T03:58:38.958 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.967 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:897fa9d0:::obj-fill-283:head# 2024-09-16T03:58:38.967 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.975 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:89cd304b:::obj-fill-592:head# 2024-09-16T03:58:38.975 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.983 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:89d04c4a:::obj-fill-388:head# 2024-09-16T03:58:38.983 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:38.992 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:89db45d9:::obj-fill-247:head# 2024-09-16T03:58:38.992 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.000 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8ad879c5:::obj-fill-492:head# 2024-09-16T03:58:39.000 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.008 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8af4b5de:::obj-fill-37:head# 2024-09-16T03:58:39.008 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.017 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8b132e86:::obj-fill-35:head# 2024-09-16T03:58:39.017 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.025 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8b80a60a:::obj-fill-100:head# 2024-09-16T03:58:39.025 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.033 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8bb64fa6:::obj-fill-599:head# 2024-09-16T03:58:39.033 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.042 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8bed03f5:::obj-fill-5:head# 2024-09-16T03:58:39.042 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.050 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8c60e135:::obj-fill-470:head# 2024-09-16T03:58:39.050 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.067 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8c774623:::obj-fill-38:head# 2024-09-16T03:58:39.067 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.075 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8cc528ae:::obj-fill-519:head# 2024-09-16T03:58:39.075 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.083 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8cf73826:::obj-fill-460:head# 2024-09-16T03:58:39.084 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.092 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8d3564b3:::obj-fill-452:head# 2024-09-16T03:58:39.092 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.100 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8dfe1ca2:::obj-fill-469:head# 2024-09-16T03:58:39.100 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.108 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8e527672:::obj-fill-246:head# 2024-09-16T03:58:39.109 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.117 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8e96103f:::obj-fill-444:head# 2024-09-16T03:58:39.117 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.125 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8ed6417f:::obj-fill-146:head# 2024-09-16T03:58:39.125 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.133 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8eda2ffc:::obj-fill-539:head# 2024-09-16T03:58:39.134 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.142 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8f08dd48:::obj-fill-26:head# 2024-09-16T03:58:39.142 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.150 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8f111b25:::obj-fill-18:head# 2024-09-16T03:58:39.150 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.159 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:8fde63f8:::obj-fill-338:head# 2024-09-16T03:58:39.159 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.167 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9030746d:::obj-fill-468:head# 2024-09-16T03:58:39.167 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.175 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9115d8a1:::obj-fill-260:head# 2024-09-16T03:58:39.175 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.183 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:91649909:::obj-fill-140:head# 2024-09-16T03:58:39.184 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.192 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:91c1081d:::obj-fill-404:head# 2024-09-16T03:58:39.192 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.201 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:91f42503:::obj-fill-216:head# 2024-09-16T03:58:39.201 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.209 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:927b34a0:::obj-fill-63:head# 2024-09-16T03:58:39.209 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.217 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:92a00a91:::obj-fill-467:head# 2024-09-16T03:58:39.217 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.225 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:930a7268:::obj-fill-450:head# 2024-09-16T03:58:39.226 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.234 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:93c3d0bf:::obj-fill-118:head# 2024-09-16T03:58:39.234 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.242 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:93ca7c9e:::obj-fill-132:head# 2024-09-16T03:58:39.242 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.259 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:942435d5:::obj-fill-378:head# 2024-09-16T03:58:39.259 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.267 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9445f8c5:::obj-fill-245:head# 2024-09-16T03:58:39.268 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.275 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9457c8d9:::obj-fill-535:head# 2024-09-16T03:58:39.275 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.284 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:950dc56e:::obj-fill-348:head# 2024-09-16T03:58:39.284 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.301 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9559ee1d:::obj-fill-545:head# 2024-09-16T03:58:39.301 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.317 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:957c5cc4:::obj-fill-212:head# 2024-09-16T03:58:39.317 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.325 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:95bdac02:::obj-fill-588:head# 2024-09-16T03:58:39.326 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.342 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:95f202af:::obj-fill-126:head# 2024-09-16T03:58:39.343 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.359 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:96789003:::obj-fill-83:head# 2024-09-16T03:58:39.359 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.376 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:96d494a8:::obj-fill-316:head# 2024-09-16T03:58:39.376 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.393 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:97adb85b:::obj-fill-233:head# 2024-09-16T03:58:39.393 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.401 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:980d998c:::obj-fill-197:head# 2024-09-16T03:58:39.401 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.417 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:98235c44:::obj-fill-396:head# 2024-09-16T03:58:39.418 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.426 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:987d3b87:::obj-fill-327:head# 2024-09-16T03:58:39.426 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.434 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:990a5e24:::obj-fill-515:head# 2024-09-16T03:58:39.434 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.451 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:995fec05:::obj-fill-191:head# 2024-09-16T03:58:39.451 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.468 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9a769b75:::obj-fill-587:head# 2024-09-16T03:58:39.468 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.476 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9b141990:::obj-fill-394:head# 2024-09-16T03:58:39.476 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.518 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9bb108fb:::obj-fill-579:head# 2024-09-16T03:58:39.518 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.534 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9ce19d92:::obj-fill-361:head# 2024-09-16T03:58:39.534 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.551 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9d8c3f95:::obj-fill-572:head# 2024-09-16T03:58:39.551 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.568 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9e283e00:::obj-fill-254:head# 2024-09-16T03:58:39.568 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.585 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9e3a1a61:::obj-fill-58:head# 2024-09-16T03:58:39.585 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.601 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9e8f6029:::obj-fill-41:head# 2024-09-16T03:58:39.601 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.618 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9ef117aa:::obj-fill-520:head# 2024-09-16T03:58:39.618 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.634 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9f3bdfc2:::obj-fill-184:head# 2024-09-16T03:58:39.635 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.651 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9fd89320:::obj-fill-364:head# 2024-09-16T03:58:39.651 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.668 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:9feb7062:::obj-fill-419:head# 2024-09-16T03:58:39.668 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.684 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a07504c4:::obj-fill-516:head# 2024-09-16T03:58:39.685 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.701 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a1897e34:::obj-fill-153:head# 2024-09-16T03:58:39.702 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.718 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a19a9d76:::obj-fill-30:head# 2024-09-16T03:58:39.718 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.741 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a1a49c98:::obj-fill-98:head# 2024-09-16T03:58:39.741 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.775 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a1ea911a:::obj-fill-36:head# 2024-09-16T03:58:39.775 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.818 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a24bad98:::obj-fill-335:head# 2024-09-16T03:58:39.818 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.858 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a263b16f:::obj-fill-326:head# 2024-09-16T03:58:39.858 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.876 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a27d661e:::obj-fill-152:head# 2024-09-16T03:58:39.876 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.893 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a282a129:::obj-fill-451:head# 2024-09-16T03:58:39.893 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.909 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a28f05ba:::obj-fill-241:head# 2024-09-16T03:58:39.910 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.927 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a2cdc5cc:::obj-fill-180:head# 2024-09-16T03:58:39.927 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.943 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a30777ea:::obj-fill-486:head# 2024-09-16T03:58:39.943 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.960 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a3a65661:::obj-fill-151:head# 2024-09-16T03:58:39.960 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.976 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a3cb2967:::obj-fill-195:head# 2024-09-16T03:58:39.977 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:39.993 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a3ffc098:::obj-fill-293:head# 2024-09-16T03:58:39.993 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a4a31ccc:::obj-fill-413:head# 2024-09-16T03:58:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.026 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a51c3677:::obj-fill-384:head# 2024-09-16T03:58:40.027 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.043 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a5e941a7:::obj-fill-141:head# 2024-09-16T03:58:40.043 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.060 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a6cdd8b2:::obj-fill-342:head# 2024-09-16T03:58:40.060 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.076 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a6e20b86:::obj-fill-593:head# 2024-09-16T03:58:40.077 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.093 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a7a9ccf9:::obj-fill-129:head# 2024-09-16T03:58:40.093 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.110 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a7b702d3:::obj-fill-49:head# 2024-09-16T03:58:40.110 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.126 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a8daf8bd:::obj-fill-391:head# 2024-09-16T03:58:40.127 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.143 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:a99c3cef:::obj-fill-171:head# 2024-09-16T03:58:40.143 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.162 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:aabb5718:::obj-fill-521:head# 2024-09-16T03:58:40.162 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.176 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ab0cb851:::obj-fill-183:head# 2024-09-16T03:58:40.177 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.193 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ab7a05e4:::obj-fill-203:head# 2024-09-16T03:58:40.193 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.210 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ab7dda83:::obj-fill-113:head# 2024-09-16T03:58:40.210 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.227 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:abb3502c:::obj-fill-461:head# 2024-09-16T03:58:40.227 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.243 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ac1c41be:::obj-fill-162:head# 2024-09-16T03:58:40.243 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.260 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ac2114ba:::obj-fill-239:head# 2024-09-16T03:58:40.260 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.277 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ad355fca:::obj-fill-271:head# 2024-09-16T03:58:40.277 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.293 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ad4634a0:::obj-fill-487:head# 2024-09-16T03:58:40.294 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.310 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:add2bb13:::obj-fill-31:head# 2024-09-16T03:58:40.310 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.327 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:aeb6258d:::obj-fill-124:head# 2024-09-16T03:58:40.327 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.343 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:af17f7d7:::obj-fill-464:head# 2024-09-16T03:58:40.343 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.360 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:af1e1cf0:::obj-fill-237:head# 2024-09-16T03:58:40.360 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.377 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:afc439ce:::obj-fill-248:head# 2024-09-16T03:58:40.377 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.393 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:afceab4d:::obj-fill-527:head# 2024-09-16T03:58:40.394 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.410 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b03af40c:::obj-fill-143:head# 2024-09-16T03:58:40.410 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.427 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b04cf0db:::obj-fill-507:head# 2024-09-16T03:58:40.427 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.443 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b07896f0:::obj-fill-269:head# 2024-09-16T03:58:40.443 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.460 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b0b954d5:::obj-fill-524:head# 2024-09-16T03:58:40.460 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.477 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b1cbfcb7:::obj-fill-134:head# 2024-09-16T03:58:40.477 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.494 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b2978fd3:::obj-fill-27:head# 2024-09-16T03:58:40.494 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.510 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b394798f:::obj-fill-156:head# 2024-09-16T03:58:40.510 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.527 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b3c6f36d:::obj-fill-401:head# 2024-09-16T03:58:40.527 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.543 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b3f8e5ac:::obj-fill-290:head# 2024-09-16T03:58:40.544 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.560 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b41ed5f8:::obj-fill-76:head# 2024-09-16T03:58:40.560 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.577 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b4878e76:::obj-fill-253:head# 2024-09-16T03:58:40.577 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b4e19741:::obj-fill-503:head# 2024-09-16T03:58:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.610 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b53a3690:::obj-fill-264:head# 2024-09-16T03:58:40.610 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.627 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b545ab4f:::obj-fill-24:head# 2024-09-16T03:58:40.627 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.644 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b55af5e6:::obj-fill-491:head# 2024-09-16T03:58:40.644 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.685 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b57edf82:::obj-fill-526:head# 2024-09-16T03:58:40.686 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.702 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b589d2be:::obj-fill-323:head# 2024-09-16T03:58:40.702 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.721 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b6207f32:::obj-fill-344:head# 2024-09-16T03:58:40.722 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.735 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b757ee2e:::obj-fill-433:head# 2024-09-16T03:58:40.735 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.752 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b75cc479:::obj-fill-34:head# 2024-09-16T03:58:40.752 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.769 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b7b03117:::obj-fill-42:head# 2024-09-16T03:58:40.769 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.785 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b7e6205d:::obj-fill-501:head# 2024-09-16T03:58:40.785 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.802 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b8d18b7a:::obj-fill-353:head# 2024-09-16T03:58:40.802 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.819 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b9189c29:::obj-fill-328:head# 2024-09-16T03:58:40.819 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.836 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b98e07aa:::obj-fill-54:head# 2024-09-16T03:58:40.836 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.877 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:b9cd1e9a:::obj-fill-371:head# 2024-09-16T03:58:40.877 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.911 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:bc3322bb:::obj-fill-340:head# 2024-09-16T03:58:40.911 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.927 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:bcf43161:::obj-fill-294:head# 2024-09-16T03:58:40.927 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.944 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:bd07fc4f:::obj-fill-549:head# 2024-09-16T03:58:40.944 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:40.961 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:bdf48e47:::obj-fill-430:head# 2024-09-16T03:58:40.961 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.002 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:be01c111:::obj-fill-1:head# 2024-09-16T03:58:41.003 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.019 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:be3a4bc7:::obj-fill-102:head# 2024-09-16T03:58:41.019 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.036 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:be8e1fcd:::obj-fill-321:head# 2024-09-16T03:58:41.036 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.052 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:bf5fcbac:::obj-fill-287:head# 2024-09-16T03:58:41.052 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.069 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:bf806d14:::obj-fill-115:head# 2024-09-16T03:58:41.069 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.086 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:bfb28823:::obj-fill-72:head# 2024-09-16T03:58:41.086 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.102 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:bfef805e:::obj-fill-119:head# 2024-09-16T03:58:41.102 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.119 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c02f8e10:::obj-fill-497:head# 2024-09-16T03:58:41.119 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.136 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c050cd6e:::obj-fill-8:head# 2024-09-16T03:58:41.136 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.152 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c218e297:::obj-fill-173:head# 2024-09-16T03:58:41.153 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.169 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c2bc66fe:::obj-fill-252:head# 2024-09-16T03:58:41.169 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.186 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c3b55903:::obj-fill-428:head# 2024-09-16T03:58:41.186 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.202 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c51907b0:::obj-fill-457:head# 2024-09-16T03:58:41.203 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.219 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c561dc83:::obj-fill-75:head# 2024-09-16T03:58:41.219 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.236 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c5d1e1a9:::obj-fill-268:head# 2024-09-16T03:58:41.236 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.253 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c60ab0d0:::obj-fill-303:head# 2024-09-16T03:58:41.253 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.269 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c644ce52:::obj-fill-514:head# 2024-09-16T03:58:41.269 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.286 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c6ab3a11:::obj-fill-407:head# 2024-09-16T03:58:41.286 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.302 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c74377bf:::obj-fill-432:head# 2024-09-16T03:58:41.303 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.319 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c767fff6:::obj-fill-531:head# 2024-09-16T03:58:41.320 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.336 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c7a9adad:::obj-fill-475:head# 2024-09-16T03:58:41.336 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.350 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c7e3a9c2:::obj-fill-465:head# 2024-09-16T03:58:41.350 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.366 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c850aed7:::obj-fill-424:head# 2024-09-16T03:58:41.366 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.383 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c8a0088a:::obj-fill-329:head# 2024-09-16T03:58:41.383 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.400 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:c9d419f9:::obj-fill-176:head# 2024-09-16T03:58:41.400 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.417 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:caf25ec2:::obj-fill-274:head# 2024-09-16T03:58:41.417 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.433 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cb625830:::obj-fill-70:head# 2024-09-16T03:58:41.433 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.450 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cbb65125:::obj-fill-529:head# 2024-09-16T03:58:41.450 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.467 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cbe2544c:::obj-fill-3:head# 2024-09-16T03:58:41.467 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.483 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cbfce4ee:::obj-fill-455:head# 2024-09-16T03:58:41.483 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.500 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cc62419c:::obj-fill-498:head# 2024-09-16T03:58:41.500 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.516 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cce831fa:::obj-fill-160:head# 2024-09-16T03:58:41.517 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.533 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cda71af4:::obj-fill-122:head# 2024-09-16T03:58:41.533 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.550 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cea7a728:::obj-fill-265:head# 2024-09-16T03:58:41.550 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.566 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cee19f0a:::obj-fill-142:head# 2024-09-16T03:58:41.566 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.583 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cf22117e:::obj-fill-499:head# 2024-09-16T03:58:41.583 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.600 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cfbfa66d:::obj-fill-66:head# 2024-09-16T03:58:41.600 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.616 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cfc2552c:::obj-fill-211:head# 2024-09-16T03:58:41.617 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.633 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:cfc563e8:::obj-fill-392:head# 2024-09-16T03:58:41.633 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.650 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d02d8880:::obj-fill-362:head# 2024-09-16T03:58:41.650 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.666 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d054947e:::obj-fill-67:head# 2024-09-16T03:58:41.667 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.683 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d061c977:::obj-fill-164:head# 2024-09-16T03:58:41.683 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.700 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d06a5f57:::obj-fill-296:head# 2024-09-16T03:58:41.700 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.717 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d110062a:::obj-fill-343:head# 2024-09-16T03:58:41.717 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.741 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d1b8ad47:::obj-fill-383:head# 2024-09-16T03:58:41.742 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.775 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d1e80db6:::obj-fill-117:head# 2024-09-16T03:58:41.775 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.808 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d210027e:::obj-fill-231:head# 2024-09-16T03:58:41.809 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.850 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d24428ed:::obj-fill-199:head# 2024-09-16T03:58:41.851 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.875 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d27c3c4b:::obj-fill-154:head# 2024-09-16T03:58:41.875 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.909 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d28957e3:::obj-fill-263:head# 2024-09-16T03:58:41.909 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.925 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d2d44da7:::obj-fill-544:head# 2024-09-16T03:58:41.925 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.942 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d31004a4:::obj-fill-434:head# 2024-09-16T03:58:41.942 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.959 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d32487c3:::obj-fill-385:head# 2024-09-16T03:58:41.959 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.975 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d340891c:::obj-fill-12:head# 2024-09-16T03:58:41.975 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:41.992 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d4135728:::obj-fill-310:head# 2024-09-16T03:58:41.992 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.009 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d5a43972:::obj-fill-9:head# 2024-09-16T03:58:42.009 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.025 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d5efeb15:::obj-fill-347:head# 2024-09-16T03:58:42.025 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.042 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d6463f70:::obj-fill-536:head# 2024-09-16T03:58:42.042 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.059 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d666d9b7:::obj-fill-420:head# 2024-09-16T03:58:42.059 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.075 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d6e86688:::obj-fill-166:head# 2024-09-16T03:58:42.075 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.092 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d730370d:::obj-fill-206:head# 2024-09-16T03:58:42.092 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.109 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d783551c:::obj-fill-109:head# 2024-09-16T03:58:42.109 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.125 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d7f77e5f:::obj-fill-551:head# 2024-09-16T03:58:42.125 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.142 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d843056c:::obj-fill-291:head# 2024-09-16T03:58:42.142 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.159 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d84eb173:::obj-fill-221:head# 2024-09-16T03:58:42.159 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.176 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d8dd069c:::obj-fill-60:head# 2024-09-16T03:58:42.176 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.192 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d8f2f750:::obj-fill-562:head# 2024-09-16T03:58:42.192 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.209 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d8f80ac2:::obj-fill-179:head# 2024-09-16T03:58:42.209 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.226 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:d9f904cf:::obj-fill-308:head# 2024-09-16T03:58:42.226 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.242 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:db0a534b:::obj-fill-410:head# 2024-09-16T03:58:42.242 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.259 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:dc4403f4:::obj-fill-416:head# 2024-09-16T03:58:42.259 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.275 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:dc66c3ca:::obj-fill-220:head# 2024-09-16T03:58:42.276 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.292 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:dc8198dc:::obj-fill-596:head# 2024-09-16T03:58:42.293 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.309 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:dcbade2b:::obj-fill-10:head# 2024-09-16T03:58:42.309 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.325 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ddb787ea:::obj-fill-556:head# 2024-09-16T03:58:42.326 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.342 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:de58065b:::obj-fill-306:head# 2024-09-16T03:58:42.342 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.359 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:deaa6fab:::obj-fill-194:head# 2024-09-16T03:58:42.359 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.376 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:dfee7714:::obj-fill-202:head# 2024-09-16T03:58:42.376 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.393 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:dff5df4a:::obj-fill-565:head# 2024-09-16T03:58:42.393 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.409 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e2053442:::obj-fill-107:head# 2024-09-16T03:58:42.409 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.426 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e32055b8:::obj-fill-57:head# 2024-09-16T03:58:42.426 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.442 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e37fac1e:::obj-fill-161:head# 2024-09-16T03:58:42.443 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.459 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e388f5aa:::obj-fill-273:head# 2024-09-16T03:58:42.459 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e38b1f4d:::obj-fill-393:head# 2024-09-16T03:58:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.492 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e4792474:::obj-fill-158:head# 2024-09-16T03:58:42.493 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.509 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e4899cb0:::obj-fill-270:head# 2024-09-16T03:58:42.509 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.526 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e62ae9f1:::obj-fill-288:head# 2024-09-16T03:58:42.526 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.542 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e64fd95a:::obj-fill-449:head# 2024-09-16T03:58:42.543 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.559 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e6682cfc:::obj-fill-373:head# 2024-09-16T03:58:42.559 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.576 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e716717b:::obj-fill-178:head# 2024-09-16T03:58:42.576 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.593 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e80226af:::obj-fill-354:head# 2024-09-16T03:58:42.593 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.609 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e83a5940:::obj-fill-564:head# 2024-09-16T03:58:42.609 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.626 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e854bfbe:::obj-fill-589:head# 2024-09-16T03:58:42.626 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.643 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e8b197bc:::obj-fill-89:head# 2024-09-16T03:58:42.643 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.659 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e92fca88:::obj-fill-397:head# 2024-09-16T03:58:42.659 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.684 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e94d8f7b:::obj-fill-261:head# 2024-09-16T03:58:42.684 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.709 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:e98cc0a4:::obj-fill-525:head# 2024-09-16T03:58:42.710 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.726 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ea5a9459:::obj-fill-431:head# 2024-09-16T03:58:42.726 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.743 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ebc54d47:::obj-fill-258:head# 2024-09-16T03:58:42.743 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.759 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ec0002dd:::obj-fill-205:head# 2024-09-16T03:58:42.760 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.776 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ec740b5c:::obj-fill-46:head# 2024-09-16T03:58:42.776 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.793 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ed35dda4:::obj-fill-170:head# 2024-09-16T03:58:42.793 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.810 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ed51b8f7:::obj-fill-91:head# 2024-09-16T03:58:42.810 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.826 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:edd96161:::obj-fill-48:head# 2024-09-16T03:58:42.826 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.859 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ee3f0d4b:::obj-fill-47:head# 2024-09-16T03:58:42.859 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.901 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ee4784dd:::obj-fill-480:head# 2024-09-16T03:58:42.901 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.926 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ee5a8271:::obj-fill-198:head# 2024-09-16T03:58:42.926 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.943 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ef745b66:::obj-fill-145:head# 2024-09-16T03:58:42.943 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.960 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:efa5309d:::obj-fill-215:head# 2024-09-16T03:58:42.960 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.976 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:efbdd3a1:::obj-fill-276:head# 2024-09-16T03:58:42.976 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:42.993 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f059d4c0:::obj-fill-482:head# 2024-09-16T03:58:42.993 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.010 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f0f9fb7a:::obj-fill-379:head# 2024-09-16T03:58:43.010 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.026 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f16a3656:::obj-fill-462:head# 2024-09-16T03:58:43.026 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.059 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f1b395ae:::obj-fill-25:head# 2024-09-16T03:58:43.059 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.076 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f5876dad:::obj-fill-359:head# 2024-09-16T03:58:43.077 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.093 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f5a283cd:::obj-fill-534:head# 2024-09-16T03:58:43.093 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.110 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f5cd905a:::obj-fill-358:head# 2024-09-16T03:58:43.110 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.127 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f5e48302:::obj-fill-406:head# 2024-09-16T03:58:43.127 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.143 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f5ea65fc:::obj-fill-52:head# 2024-09-16T03:58:43.143 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.160 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f642de6b:::obj-fill-204:head# 2024-09-16T03:58:43.160 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.176 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f716eafd:::obj-fill-502:head# 2024-09-16T03:58:43.177 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.193 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f752e9cb:::obj-fill-23:head# 2024-09-16T03:58:43.193 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.210 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f85fe42c:::obj-fill-346:head# 2024-09-16T03:58:43.210 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.226 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:f882fd3b:::obj-fill-355:head# 2024-09-16T03:58:43.227 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.243 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:fa133332:::obj-fill-309:head# 2024-09-16T03:58:43.243 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.260 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:fa875e52:::obj-fill-64:head# 2024-09-16T03:58:43.260 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.276 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:fad91a22:::obj-fill-481:head# 2024-09-16T03:58:43.277 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.293 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:fbbc3122:::obj-fill-111:head# 2024-09-16T03:58:43.293 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.310 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:fc539ddb:::obj-fill-181:head# 2024-09-16T03:58:43.310 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.327 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:fc54128d:::obj-fill-104:head# 2024-09-16T03:58:43.327 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.343 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:fe00aded:::obj-fill-365:head# 2024-09-16T03:58:43.344 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.360 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:fe1e9971:::obj-fill-189:head# 2024-09-16T03:58:43.360 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.377 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ff0e0563:::obj-fill-508:head# 2024-09-16T03:58:43.377 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.393 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ff4e156c:::obj-fill-441:head# 2024-09-16T03:58:43.393 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.410 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:ffa355f7:::obj-fill-500:head# 2024-09-16T03:58:43.410 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.426 INFO:tasks.workunit.client.0.smithi026.stdout:Write #1:fff6c93b:::obj-fill-277:head# 2024-09-16T03:58:43.427 INFO:tasks.workunit.client.0.smithi026.stdout:snapset 0=[]:{} 2024-09-16T03:58:43.443 INFO:tasks.workunit.client.0.smithi026.stdout:write_pg epoch 36 info 1.0( v 36'600 (36'500,36'600] local-lis/les=23/25 n=600 ec=21/21 lis/c=23/23 les/c/f=25/25/0 sis=23) 2024-09-16T03:58:43.460 INFO:tasks.workunit.client.0.smithi026.stdout:Import successful 2024-09-16T03:58:43.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:495: TEST_backfill_multi_partial: ceph pg dump pgs 2024-09-16T03:58:44.390 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T03:58:44.390 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:58:21.981793+0000 0'0 48:40 [2,0] 2 [2,0] 2 0'0 2024-09-16T03:55:47.162674+0000 0'0 2024-09-16T03:55:47.162674+0000 0 0 periodic scrub scheduled @ 2024-09-17T11:49:19.787353+0000 0 0 2024-09-16T03:58:44.390 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 600 0 0 0 0 614400 0 0 100 500 100 active+clean 2024-09-16T03:58:22.016726+0000 42'600 48:668 [2,0] 2 [2,0] 2 0'0 2024-09-16T03:55:44.259994+0000 0'0 2024-09-16T03:55:44.259994+0000 0 0 periodic scrub scheduled @ 2024-09-17T06:59:52.553744+0000 0 0 2024-09-16T03:58:44.390 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 564 0 0 0 0 1472604 0 0 64 500 64 stale+active+clean 2024-09-16T03:55:44.048735+0000 36'564 36:606 [1] 1 [1] 1 0'0 2024-09-16T03:55:41.373963+0000 0'0 2024-09-16T03:55:41.373963+0000 0 0 periodic scrub scheduled @ 2024-09-17T04:23:26.138883+0000 0 0 2024-09-16T03:58:44.390 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T03:58:44.390 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T03:58:44.390 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:58:44.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:496: TEST_backfill_multi_partial: sleep 20 2024-09-16T03:59:04.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:497: TEST_backfill_multi_partial: ceph pg dump pgs 2024-09-16T03:59:04.802 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T03:59:04.802 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T03:58:21.981793+0000 0'0 48:40 [2,0] 2 [2,0] 2 0'0 2024-09-16T03:55:47.162674+0000 0'0 2024-09-16T03:55:47.162674+0000 0 0 periodic scrub scheduled @ 2024-09-17T11:49:19.787353+0000 0 0 2024-09-16T03:59:04.802 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 600 0 0 0 0 614400 0 0 100 500 100 active+clean 2024-09-16T03:58:22.016726+0000 42'600 48:668 [2,0] 2 [2,0] 2 0'0 2024-09-16T03:55:44.259994+0000 0'0 2024-09-16T03:55:44.259994+0000 0 0 periodic scrub scheduled @ 2024-09-17T06:59:52.553744+0000 0 0 2024-09-16T03:59:04.802 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 564 0 0 0 0 1472604 0 0 64 500 64 stale+active+clean 2024-09-16T03:55:44.048735+0000 36'564 36:606 [1] 1 [1] 1 0'0 2024-09-16T03:55:41.373963+0000 0'0 2024-09-16T03:55:41.373963+0000 0 0 periodic scrub scheduled @ 2024-09-17T04:23:26.138883+0000 0 0 2024-09-16T03:59:04.802 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T03:59:04.802 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T03:59:04.803 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T03:59:04.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:500: TEST_backfill_multi_partial: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=2611 count=1 2024-09-16T03:59:04.814 INFO:tasks.workunit.client.0.smithi026.stderr:1+0 records in 2024-09-16T03:59:04.814 INFO:tasks.workunit.client.0.smithi026.stderr:1+0 records out 2024-09-16T03:59:04.814 INFO:tasks.workunit.client.0.smithi026.stderr:2611 bytes (2.6 kB, 2.5 KiB) copied, 8.6642e-05 s, 30.1 MB/s 2024-09-16T03:59:04.814 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: seq 1 600 2024-09-16T03:59:04.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:04.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:04.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:04.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-1 td/osd-backfill-space/datafile 2024-09-16T03:59:04.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:04.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-1 td/osd-backfill-space/datafile 2024-09-16T03:59:05.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:05.036 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:05.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:05.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-2 td/osd-backfill-space/datafile 2024-09-16T03:59:05.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:05.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-2 td/osd-backfill-space/datafile 2024-09-16T03:59:05.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:05.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:05.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:05.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-3 td/osd-backfill-space/datafile 2024-09-16T03:59:05.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:05.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-3 td/osd-backfill-space/datafile 2024-09-16T03:59:05.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:05.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:05.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:05.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-4 td/osd-backfill-space/datafile 2024-09-16T03:59:05.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:05.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-4 td/osd-backfill-space/datafile 2024-09-16T03:59:05.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:05.655 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:05.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:05.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-5 td/osd-backfill-space/datafile 2024-09-16T03:59:05.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:05.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-5 td/osd-backfill-space/datafile 2024-09-16T03:59:05.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:05.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:05.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:05.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-6 td/osd-backfill-space/datafile 2024-09-16T03:59:05.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:05.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-6 td/osd-backfill-space/datafile 2024-09-16T03:59:06.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:06.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:06.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:06.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-7 td/osd-backfill-space/datafile 2024-09-16T03:59:06.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:06.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-7 td/osd-backfill-space/datafile 2024-09-16T03:59:06.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:06.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:06.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:06.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-8 td/osd-backfill-space/datafile 2024-09-16T03:59:06.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:06.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-8 td/osd-backfill-space/datafile 2024-09-16T03:59:06.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:06.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:06.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:06.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-9 td/osd-backfill-space/datafile 2024-09-16T03:59:06.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:06.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-9 td/osd-backfill-space/datafile 2024-09-16T03:59:06.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:06.717 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:06.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:06.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-10 td/osd-backfill-space/datafile 2024-09-16T03:59:06.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:06.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-10 td/osd-backfill-space/datafile 2024-09-16T03:59:06.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:06.943 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:06.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:06.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-11 td/osd-backfill-space/datafile 2024-09-16T03:59:07.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:07.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-11 td/osd-backfill-space/datafile 2024-09-16T03:59:07.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:07.137 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:07.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:07.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-12 td/osd-backfill-space/datafile 2024-09-16T03:59:07.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:07.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-12 td/osd-backfill-space/datafile 2024-09-16T03:59:07.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:07.319 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:07.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:07.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-13 td/osd-backfill-space/datafile 2024-09-16T03:59:07.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:07.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-13 td/osd-backfill-space/datafile 2024-09-16T03:59:07.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:07.528 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:07.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:07.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-14 td/osd-backfill-space/datafile 2024-09-16T03:59:07.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:07.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-14 td/osd-backfill-space/datafile 2024-09-16T03:59:07.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:07.729 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:07.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:07.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-15 td/osd-backfill-space/datafile 2024-09-16T03:59:07.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:07.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-15 td/osd-backfill-space/datafile 2024-09-16T03:59:07.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:07.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:07.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:07.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-16 td/osd-backfill-space/datafile 2024-09-16T03:59:08.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:08.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-16 td/osd-backfill-space/datafile 2024-09-16T03:59:08.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:08.150 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:08.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:08.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-17 td/osd-backfill-space/datafile 2024-09-16T03:59:08.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:08.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-17 td/osd-backfill-space/datafile 2024-09-16T03:59:08.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:08.333 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:08.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:08.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-18 td/osd-backfill-space/datafile 2024-09-16T03:59:08.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:08.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-18 td/osd-backfill-space/datafile 2024-09-16T03:59:08.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:08.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:08.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:08.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-19 td/osd-backfill-space/datafile 2024-09-16T03:59:08.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:08.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-19 td/osd-backfill-space/datafile 2024-09-16T03:59:08.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:08.751 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:08.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:08.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-20 td/osd-backfill-space/datafile 2024-09-16T03:59:08.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:08.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-20 td/osd-backfill-space/datafile 2024-09-16T03:59:08.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:08.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:08.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:08.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-21 td/osd-backfill-space/datafile 2024-09-16T03:59:09.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:09.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-21 td/osd-backfill-space/datafile 2024-09-16T03:59:09.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:09.195 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:09.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:09.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-22 td/osd-backfill-space/datafile 2024-09-16T03:59:09.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:09.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-22 td/osd-backfill-space/datafile 2024-09-16T03:59:09.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:09.412 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:09.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:09.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-23 td/osd-backfill-space/datafile 2024-09-16T03:59:09.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:09.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-23 td/osd-backfill-space/datafile 2024-09-16T03:59:09.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:09.621 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:09.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:09.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-24 td/osd-backfill-space/datafile 2024-09-16T03:59:09.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:09.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-24 td/osd-backfill-space/datafile 2024-09-16T03:59:09.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:09.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:09.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:09.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-25 td/osd-backfill-space/datafile 2024-09-16T03:59:09.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:09.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-25 td/osd-backfill-space/datafile 2024-09-16T03:59:10.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:10.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:10.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:10.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-26 td/osd-backfill-space/datafile 2024-09-16T03:59:10.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:10.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-26 td/osd-backfill-space/datafile 2024-09-16T03:59:10.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:10.265 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:10.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:10.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-27 td/osd-backfill-space/datafile 2024-09-16T03:59:10.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:10.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-27 td/osd-backfill-space/datafile 2024-09-16T03:59:10.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:10.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:10.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:10.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-28 td/osd-backfill-space/datafile 2024-09-16T03:59:10.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:10.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-28 td/osd-backfill-space/datafile 2024-09-16T03:59:10.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:10.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:10.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:10.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-29 td/osd-backfill-space/datafile 2024-09-16T03:59:10.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:10.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-29 td/osd-backfill-space/datafile 2024-09-16T03:59:10.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:10.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:10.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:10.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-30 td/osd-backfill-space/datafile 2024-09-16T03:59:10.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:10.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-30 td/osd-backfill-space/datafile 2024-09-16T03:59:11.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:11.068 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:11.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:11.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-31 td/osd-backfill-space/datafile 2024-09-16T03:59:11.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:11.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-31 td/osd-backfill-space/datafile 2024-09-16T03:59:11.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:11.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:11.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:11.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-32 td/osd-backfill-space/datafile 2024-09-16T03:59:11.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:11.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-32 td/osd-backfill-space/datafile 2024-09-16T03:59:11.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:11.461 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:11.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:11.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-33 td/osd-backfill-space/datafile 2024-09-16T03:59:11.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:11.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-33 td/osd-backfill-space/datafile 2024-09-16T03:59:11.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:11.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:11.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:11.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-34 td/osd-backfill-space/datafile 2024-09-16T03:59:11.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:11.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-34 td/osd-backfill-space/datafile 2024-09-16T03:59:11.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:11.863 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:11.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:11.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-35 td/osd-backfill-space/datafile 2024-09-16T03:59:11.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:11.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-35 td/osd-backfill-space/datafile 2024-09-16T03:59:12.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:12.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:12.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:12.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-36 td/osd-backfill-space/datafile 2024-09-16T03:59:12.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:12.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-36 td/osd-backfill-space/datafile 2024-09-16T03:59:12.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:12.298 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:12.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:12.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-37 td/osd-backfill-space/datafile 2024-09-16T03:59:12.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:12.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-37 td/osd-backfill-space/datafile 2024-09-16T03:59:12.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:12.498 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:12.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:12.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-38 td/osd-backfill-space/datafile 2024-09-16T03:59:12.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:12.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-38 td/osd-backfill-space/datafile 2024-09-16T03:59:12.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:12.699 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:12.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:12.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-39 td/osd-backfill-space/datafile 2024-09-16T03:59:12.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:12.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-39 td/osd-backfill-space/datafile 2024-09-16T03:59:12.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:12.917 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:12.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:12.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-40 td/osd-backfill-space/datafile 2024-09-16T03:59:13.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:13.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-40 td/osd-backfill-space/datafile 2024-09-16T03:59:13.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:13.118 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:13.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:13.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-41 td/osd-backfill-space/datafile 2024-09-16T03:59:13.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:13.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-41 td/osd-backfill-space/datafile 2024-09-16T03:59:13.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:13.351 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:13.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:13.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-42 td/osd-backfill-space/datafile 2024-09-16T03:59:13.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:13.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-42 td/osd-backfill-space/datafile 2024-09-16T03:59:13.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:13.552 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:13.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:13.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-43 td/osd-backfill-space/datafile 2024-09-16T03:59:13.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:13.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-43 td/osd-backfill-space/datafile 2024-09-16T03:59:13.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:13.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:13.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:13.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-44 td/osd-backfill-space/datafile 2024-09-16T03:59:13.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:13.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-44 td/osd-backfill-space/datafile 2024-09-16T03:59:13.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:13.954 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:13.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:13.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-45 td/osd-backfill-space/datafile 2024-09-16T03:59:14.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:14.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-45 td/osd-backfill-space/datafile 2024-09-16T03:59:14.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:14.146 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:14.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:14.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-46 td/osd-backfill-space/datafile 2024-09-16T03:59:14.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:14.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-46 td/osd-backfill-space/datafile 2024-09-16T03:59:14.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:14.364 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:14.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:14.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-47 td/osd-backfill-space/datafile 2024-09-16T03:59:14.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:14.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-47 td/osd-backfill-space/datafile 2024-09-16T03:59:14.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:14.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:14.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:14.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-48 td/osd-backfill-space/datafile 2024-09-16T03:59:14.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:14.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-48 td/osd-backfill-space/datafile 2024-09-16T03:59:14.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:14.765 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:14.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:14.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-49 td/osd-backfill-space/datafile 2024-09-16T03:59:14.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:14.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-49 td/osd-backfill-space/datafile 2024-09-16T03:59:14.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:14.983 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:14.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:14.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-50 td/osd-backfill-space/datafile 2024-09-16T03:59:15.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:15.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-50 td/osd-backfill-space/datafile 2024-09-16T03:59:15.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:15.208 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:15.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:15.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-51 td/osd-backfill-space/datafile 2024-09-16T03:59:15.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:15.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-51 td/osd-backfill-space/datafile 2024-09-16T03:59:15.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:15.409 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:15.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:15.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-52 td/osd-backfill-space/datafile 2024-09-16T03:59:15.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:15.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-52 td/osd-backfill-space/datafile 2024-09-16T03:59:15.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:15.609 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:15.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:15.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-53 td/osd-backfill-space/datafile 2024-09-16T03:59:15.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:15.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-53 td/osd-backfill-space/datafile 2024-09-16T03:59:15.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:15.844 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:15.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:15.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-54 td/osd-backfill-space/datafile 2024-09-16T03:59:15.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:15.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-54 td/osd-backfill-space/datafile 2024-09-16T03:59:16.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:16.036 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:16.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:16.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-55 td/osd-backfill-space/datafile 2024-09-16T03:59:16.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:16.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-55 td/osd-backfill-space/datafile 2024-09-16T03:59:16.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:16.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:16.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:16.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-56 td/osd-backfill-space/datafile 2024-09-16T03:59:16.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:16.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-56 td/osd-backfill-space/datafile 2024-09-16T03:59:16.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:16.429 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:16.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:16.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-57 td/osd-backfill-space/datafile 2024-09-16T03:59:16.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:16.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-57 td/osd-backfill-space/datafile 2024-09-16T03:59:16.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:16.622 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:16.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:16.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-58 td/osd-backfill-space/datafile 2024-09-16T03:59:16.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:16.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-58 td/osd-backfill-space/datafile 2024-09-16T03:59:16.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:16.873 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:16.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:16.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-59 td/osd-backfill-space/datafile 2024-09-16T03:59:16.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:16.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-59 td/osd-backfill-space/datafile 2024-09-16T03:59:17.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:17.073 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:17.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:17.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-60 td/osd-backfill-space/datafile 2024-09-16T03:59:17.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:17.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-60 td/osd-backfill-space/datafile 2024-09-16T03:59:17.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:17.240 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:17.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:17.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-61 td/osd-backfill-space/datafile 2024-09-16T03:59:17.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:17.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-61 td/osd-backfill-space/datafile 2024-09-16T03:59:17.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:17.408 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:17.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:17.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-62 td/osd-backfill-space/datafile 2024-09-16T03:59:17.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:17.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-62 td/osd-backfill-space/datafile 2024-09-16T03:59:17.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:17.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:17.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:17.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-63 td/osd-backfill-space/datafile 2024-09-16T03:59:17.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:17.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-63 td/osd-backfill-space/datafile 2024-09-16T03:59:17.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:17.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:17.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:17.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-64 td/osd-backfill-space/datafile 2024-09-16T03:59:17.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:17.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-64 td/osd-backfill-space/datafile 2024-09-16T03:59:17.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:17.976 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:17.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:17.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-65 td/osd-backfill-space/datafile 2024-09-16T03:59:18.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-65 td/osd-backfill-space/datafile 2024-09-16T03:59:18.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:18.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:18.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-66 td/osd-backfill-space/datafile 2024-09-16T03:59:18.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-66 td/osd-backfill-space/datafile 2024-09-16T03:59:18.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:18.327 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:18.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-67 td/osd-backfill-space/datafile 2024-09-16T03:59:18.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-67 td/osd-backfill-space/datafile 2024-09-16T03:59:18.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:18.494 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:18.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-68 td/osd-backfill-space/datafile 2024-09-16T03:59:18.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-68 td/osd-backfill-space/datafile 2024-09-16T03:59:18.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:18.647 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:18.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-69 td/osd-backfill-space/datafile 2024-09-16T03:59:18.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-69 td/osd-backfill-space/datafile 2024-09-16T03:59:18.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:18.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:18.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-70 td/osd-backfill-space/datafile 2024-09-16T03:59:18.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-70 td/osd-backfill-space/datafile 2024-09-16T03:59:18.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:18.931 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:18.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-71 td/osd-backfill-space/datafile 2024-09-16T03:59:18.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:18.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-71 td/osd-backfill-space/datafile 2024-09-16T03:59:19.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:19.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:19.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-72 td/osd-backfill-space/datafile 2024-09-16T03:59:19.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-72 td/osd-backfill-space/datafile 2024-09-16T03:59:19.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:19.197 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:19.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-73 td/osd-backfill-space/datafile 2024-09-16T03:59:19.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-73 td/osd-backfill-space/datafile 2024-09-16T03:59:19.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:19.339 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:19.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-74 td/osd-backfill-space/datafile 2024-09-16T03:59:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-74 td/osd-backfill-space/datafile 2024-09-16T03:59:19.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:19.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:19.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-75 td/osd-backfill-space/datafile 2024-09-16T03:59:19.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-75 td/osd-backfill-space/datafile 2024-09-16T03:59:19.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:19.581 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:19.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-76 td/osd-backfill-space/datafile 2024-09-16T03:59:19.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-76 td/osd-backfill-space/datafile 2024-09-16T03:59:19.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:19.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:19.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-77 td/osd-backfill-space/datafile 2024-09-16T03:59:19.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-77 td/osd-backfill-space/datafile 2024-09-16T03:59:19.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:19.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:19.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-78 td/osd-backfill-space/datafile 2024-09-16T03:59:19.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:19.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-78 td/osd-backfill-space/datafile 2024-09-16T03:59:20.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:20.004 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:20.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-79 td/osd-backfill-space/datafile 2024-09-16T03:59:20.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-79 td/osd-backfill-space/datafile 2024-09-16T03:59:20.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:20.122 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:20.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-80 td/osd-backfill-space/datafile 2024-09-16T03:59:20.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-80 td/osd-backfill-space/datafile 2024-09-16T03:59:20.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:20.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:20.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-81 td/osd-backfill-space/datafile 2024-09-16T03:59:20.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-81 td/osd-backfill-space/datafile 2024-09-16T03:59:20.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:20.364 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:20.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-82 td/osd-backfill-space/datafile 2024-09-16T03:59:20.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-82 td/osd-backfill-space/datafile 2024-09-16T03:59:20.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:20.497 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:20.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-83 td/osd-backfill-space/datafile 2024-09-16T03:59:20.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-83 td/osd-backfill-space/datafile 2024-09-16T03:59:20.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:20.622 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:20.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-84 td/osd-backfill-space/datafile 2024-09-16T03:59:20.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-84 td/osd-backfill-space/datafile 2024-09-16T03:59:20.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:20.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:20.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-85 td/osd-backfill-space/datafile 2024-09-16T03:59:20.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-85 td/osd-backfill-space/datafile 2024-09-16T03:59:20.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:20.931 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:20.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-86 td/osd-backfill-space/datafile 2024-09-16T03:59:20.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:20.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-86 td/osd-backfill-space/datafile 2024-09-16T03:59:21.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:21.056 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:21.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-87 td/osd-backfill-space/datafile 2024-09-16T03:59:21.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-87 td/osd-backfill-space/datafile 2024-09-16T03:59:21.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:21.206 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:21.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-88 td/osd-backfill-space/datafile 2024-09-16T03:59:21.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-88 td/osd-backfill-space/datafile 2024-09-16T03:59:21.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:21.331 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:21.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-89 td/osd-backfill-space/datafile 2024-09-16T03:59:21.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-89 td/osd-backfill-space/datafile 2024-09-16T03:59:21.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:21.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:21.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-90 td/osd-backfill-space/datafile 2024-09-16T03:59:21.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-90 td/osd-backfill-space/datafile 2024-09-16T03:59:21.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:21.573 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:21.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-91 td/osd-backfill-space/datafile 2024-09-16T03:59:21.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-91 td/osd-backfill-space/datafile 2024-09-16T03:59:21.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:21.698 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:21.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-92 td/osd-backfill-space/datafile 2024-09-16T03:59:21.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-92 td/osd-backfill-space/datafile 2024-09-16T03:59:21.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:21.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:21.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-93 td/osd-backfill-space/datafile 2024-09-16T03:59:21.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:21.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-93 td/osd-backfill-space/datafile 2024-09-16T03:59:22.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:22.006 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:22.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-94 td/osd-backfill-space/datafile 2024-09-16T03:59:22.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-94 td/osd-backfill-space/datafile 2024-09-16T03:59:22.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:22.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:22.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-95 td/osd-backfill-space/datafile 2024-09-16T03:59:22.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-95 td/osd-backfill-space/datafile 2024-09-16T03:59:22.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:22.256 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:22.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-96 td/osd-backfill-space/datafile 2024-09-16T03:59:22.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-96 td/osd-backfill-space/datafile 2024-09-16T03:59:22.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:22.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:22.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-97 td/osd-backfill-space/datafile 2024-09-16T03:59:22.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-97 td/osd-backfill-space/datafile 2024-09-16T03:59:22.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:22.514 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:22.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-98 td/osd-backfill-space/datafile 2024-09-16T03:59:22.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-98 td/osd-backfill-space/datafile 2024-09-16T03:59:22.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:22.639 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:22.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-99 td/osd-backfill-space/datafile 2024-09-16T03:59:22.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-99 td/osd-backfill-space/datafile 2024-09-16T03:59:22.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:22.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:22.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-100 td/osd-backfill-space/datafile 2024-09-16T03:59:22.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-100 td/osd-backfill-space/datafile 2024-09-16T03:59:22.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:22.923 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:22.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-101 td/osd-backfill-space/datafile 2024-09-16T03:59:22.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:22.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-101 td/osd-backfill-space/datafile 2024-09-16T03:59:23.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:23.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:23.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-102 td/osd-backfill-space/datafile 2024-09-16T03:59:23.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-102 td/osd-backfill-space/datafile 2024-09-16T03:59:23.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:23.173 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:23.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-103 td/osd-backfill-space/datafile 2024-09-16T03:59:23.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-103 td/osd-backfill-space/datafile 2024-09-16T03:59:23.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:23.298 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:23.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-104 td/osd-backfill-space/datafile 2024-09-16T03:59:23.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-104 td/osd-backfill-space/datafile 2024-09-16T03:59:23.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:23.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:23.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-105 td/osd-backfill-space/datafile 2024-09-16T03:59:23.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-105 td/osd-backfill-space/datafile 2024-09-16T03:59:23.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:23.548 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:23.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-106 td/osd-backfill-space/datafile 2024-09-16T03:59:23.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-106 td/osd-backfill-space/datafile 2024-09-16T03:59:23.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:23.673 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:23.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-107 td/osd-backfill-space/datafile 2024-09-16T03:59:23.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-107 td/osd-backfill-space/datafile 2024-09-16T03:59:23.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:23.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:23.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-108 td/osd-backfill-space/datafile 2024-09-16T03:59:23.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-108 td/osd-backfill-space/datafile 2024-09-16T03:59:23.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:23.981 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:23.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:23.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-109 td/osd-backfill-space/datafile 2024-09-16T03:59:24.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:24.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-109 td/osd-backfill-space/datafile 2024-09-16T03:59:24.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:24.139 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:24.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:24.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-110 td/osd-backfill-space/datafile 2024-09-16T03:59:24.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:24.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-110 td/osd-backfill-space/datafile 2024-09-16T03:59:24.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:24.265 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:24.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:24.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-111 td/osd-backfill-space/datafile 2024-09-16T03:59:24.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:24.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-111 td/osd-backfill-space/datafile 2024-09-16T03:59:24.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:24.398 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:24.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:24.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-112 td/osd-backfill-space/datafile 2024-09-16T03:59:24.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:24.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-112 td/osd-backfill-space/datafile 2024-09-16T03:59:24.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:24.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:24.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:24.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-113 td/osd-backfill-space/datafile 2024-09-16T03:59:24.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:24.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-113 td/osd-backfill-space/datafile 2024-09-16T03:59:24.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:24.956 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:24.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:24.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-114 td/osd-backfill-space/datafile 2024-09-16T03:59:25.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-114 td/osd-backfill-space/datafile 2024-09-16T03:59:25.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:25.081 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:25.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-115 td/osd-backfill-space/datafile 2024-09-16T03:59:25.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-115 td/osd-backfill-space/datafile 2024-09-16T03:59:25.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:25.206 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:25.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-116 td/osd-backfill-space/datafile 2024-09-16T03:59:25.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-116 td/osd-backfill-space/datafile 2024-09-16T03:59:25.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:25.331 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:25.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-117 td/osd-backfill-space/datafile 2024-09-16T03:59:25.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-117 td/osd-backfill-space/datafile 2024-09-16T03:59:25.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:25.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:25.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-118 td/osd-backfill-space/datafile 2024-09-16T03:59:25.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-118 td/osd-backfill-space/datafile 2024-09-16T03:59:25.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:25.581 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:25.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-119 td/osd-backfill-space/datafile 2024-09-16T03:59:25.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-119 td/osd-backfill-space/datafile 2024-09-16T03:59:25.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:25.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:25.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-120 td/osd-backfill-space/datafile 2024-09-16T03:59:25.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-120 td/osd-backfill-space/datafile 2024-09-16T03:59:25.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:25.882 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:25.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-121 td/osd-backfill-space/datafile 2024-09-16T03:59:25.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:25.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-121 td/osd-backfill-space/datafile 2024-09-16T03:59:26.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:26.006 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:26.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-122 td/osd-backfill-space/datafile 2024-09-16T03:59:26.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-122 td/osd-backfill-space/datafile 2024-09-16T03:59:26.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:26.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:26.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-123 td/osd-backfill-space/datafile 2024-09-16T03:59:26.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-123 td/osd-backfill-space/datafile 2024-09-16T03:59:26.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:26.257 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:26.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-124 td/osd-backfill-space/datafile 2024-09-16T03:59:26.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-124 td/osd-backfill-space/datafile 2024-09-16T03:59:26.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:26.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:26.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-125 td/osd-backfill-space/datafile 2024-09-16T03:59:26.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-125 td/osd-backfill-space/datafile 2024-09-16T03:59:26.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:26.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:26.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-126 td/osd-backfill-space/datafile 2024-09-16T03:59:26.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-126 td/osd-backfill-space/datafile 2024-09-16T03:59:26.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:26.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:26.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-127 td/osd-backfill-space/datafile 2024-09-16T03:59:26.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-127 td/osd-backfill-space/datafile 2024-09-16T03:59:26.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:26.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:26.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-128 td/osd-backfill-space/datafile 2024-09-16T03:59:26.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-128 td/osd-backfill-space/datafile 2024-09-16T03:59:26.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:26.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:26.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:26.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-129 td/osd-backfill-space/datafile 2024-09-16T03:59:27.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-129 td/osd-backfill-space/datafile 2024-09-16T03:59:27.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:27.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:27.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-130 td/osd-backfill-space/datafile 2024-09-16T03:59:27.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-130 td/osd-backfill-space/datafile 2024-09-16T03:59:27.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:27.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:27.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-131 td/osd-backfill-space/datafile 2024-09-16T03:59:27.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-131 td/osd-backfill-space/datafile 2024-09-16T03:59:27.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:27.375 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:27.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-132 td/osd-backfill-space/datafile 2024-09-16T03:59:27.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-132 td/osd-backfill-space/datafile 2024-09-16T03:59:27.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:27.498 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:27.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-133 td/osd-backfill-space/datafile 2024-09-16T03:59:27.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-133 td/osd-backfill-space/datafile 2024-09-16T03:59:27.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:27.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:27.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-134 td/osd-backfill-space/datafile 2024-09-16T03:59:27.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-134 td/osd-backfill-space/datafile 2024-09-16T03:59:27.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:27.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:27.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-135 td/osd-backfill-space/datafile 2024-09-16T03:59:27.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-135 td/osd-backfill-space/datafile 2024-09-16T03:59:27.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:27.907 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:27.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-136 td/osd-backfill-space/datafile 2024-09-16T03:59:27.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:27.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-136 td/osd-backfill-space/datafile 2024-09-16T03:59:28.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:28.032 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:28.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-137 td/osd-backfill-space/datafile 2024-09-16T03:59:28.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-137 td/osd-backfill-space/datafile 2024-09-16T03:59:28.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:28.157 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:28.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-138 td/osd-backfill-space/datafile 2024-09-16T03:59:28.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-138 td/osd-backfill-space/datafile 2024-09-16T03:59:28.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:28.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:28.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-139 td/osd-backfill-space/datafile 2024-09-16T03:59:28.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-139 td/osd-backfill-space/datafile 2024-09-16T03:59:28.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:28.407 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:28.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-140 td/osd-backfill-space/datafile 2024-09-16T03:59:28.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-140 td/osd-backfill-space/datafile 2024-09-16T03:59:28.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:28.523 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:28.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-141 td/osd-backfill-space/datafile 2024-09-16T03:59:28.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-141 td/osd-backfill-space/datafile 2024-09-16T03:59:28.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:28.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:28.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-142 td/osd-backfill-space/datafile 2024-09-16T03:59:28.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-142 td/osd-backfill-space/datafile 2024-09-16T03:59:28.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:28.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:28.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-143 td/osd-backfill-space/datafile 2024-09-16T03:59:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-143 td/osd-backfill-space/datafile 2024-09-16T03:59:28.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:28.915 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:28.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-144 td/osd-backfill-space/datafile 2024-09-16T03:59:28.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:28.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-144 td/osd-backfill-space/datafile 2024-09-16T03:59:29.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:29.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:29.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-145 td/osd-backfill-space/datafile 2024-09-16T03:59:29.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-145 td/osd-backfill-space/datafile 2024-09-16T03:59:29.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:29.165 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:29.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-146 td/osd-backfill-space/datafile 2024-09-16T03:59:29.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-146 td/osd-backfill-space/datafile 2024-09-16T03:59:29.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:29.290 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:29.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-147 td/osd-backfill-space/datafile 2024-09-16T03:59:29.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-147 td/osd-backfill-space/datafile 2024-09-16T03:59:29.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:29.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:29.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-148 td/osd-backfill-space/datafile 2024-09-16T03:59:29.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-148 td/osd-backfill-space/datafile 2024-09-16T03:59:29.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:29.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:29.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-149 td/osd-backfill-space/datafile 2024-09-16T03:59:29.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-149 td/osd-backfill-space/datafile 2024-09-16T03:59:29.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:29.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:29.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-150 td/osd-backfill-space/datafile 2024-09-16T03:59:29.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-150 td/osd-backfill-space/datafile 2024-09-16T03:59:29.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:29.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:29.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-151 td/osd-backfill-space/datafile 2024-09-16T03:59:29.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-151 td/osd-backfill-space/datafile 2024-09-16T03:59:29.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:29.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:29.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:29.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-152 td/osd-backfill-space/datafile 2024-09-16T03:59:30.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-152 td/osd-backfill-space/datafile 2024-09-16T03:59:30.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:30.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:30.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-153 td/osd-backfill-space/datafile 2024-09-16T03:59:30.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-153 td/osd-backfill-space/datafile 2024-09-16T03:59:30.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:30.224 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:30.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-154 td/osd-backfill-space/datafile 2024-09-16T03:59:30.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-154 td/osd-backfill-space/datafile 2024-09-16T03:59:30.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:30.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:30.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-155 td/osd-backfill-space/datafile 2024-09-16T03:59:30.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-155 td/osd-backfill-space/datafile 2024-09-16T03:59:30.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:30.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:30.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-156 td/osd-backfill-space/datafile 2024-09-16T03:59:30.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-156 td/osd-backfill-space/datafile 2024-09-16T03:59:30.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:30.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:30.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-157 td/osd-backfill-space/datafile 2024-09-16T03:59:30.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-157 td/osd-backfill-space/datafile 2024-09-16T03:59:30.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:30.707 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:30.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-158 td/osd-backfill-space/datafile 2024-09-16T03:59:30.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-158 td/osd-backfill-space/datafile 2024-09-16T03:59:30.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:30.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:30.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-159 td/osd-backfill-space/datafile 2024-09-16T03:59:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-159 td/osd-backfill-space/datafile 2024-09-16T03:59:30.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:30.974 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:30.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:30.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-160 td/osd-backfill-space/datafile 2024-09-16T03:59:31.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-160 td/osd-backfill-space/datafile 2024-09-16T03:59:31.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:31.091 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:31.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-161 td/osd-backfill-space/datafile 2024-09-16T03:59:31.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-161 td/osd-backfill-space/datafile 2024-09-16T03:59:31.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:31.207 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:31.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-162 td/osd-backfill-space/datafile 2024-09-16T03:59:31.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-162 td/osd-backfill-space/datafile 2024-09-16T03:59:31.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:31.333 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:31.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-163 td/osd-backfill-space/datafile 2024-09-16T03:59:31.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-163 td/osd-backfill-space/datafile 2024-09-16T03:59:31.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:31.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:31.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-164 td/osd-backfill-space/datafile 2024-09-16T03:59:31.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-164 td/osd-backfill-space/datafile 2024-09-16T03:59:31.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:31.582 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:31.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-165 td/osd-backfill-space/datafile 2024-09-16T03:59:31.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-165 td/osd-backfill-space/datafile 2024-09-16T03:59:31.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:31.707 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:31.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-166 td/osd-backfill-space/datafile 2024-09-16T03:59:31.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-166 td/osd-backfill-space/datafile 2024-09-16T03:59:31.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:31.882 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:31.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-167 td/osd-backfill-space/datafile 2024-09-16T03:59:31.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:31.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-167 td/osd-backfill-space/datafile 2024-09-16T03:59:31.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:31.999 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:32.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-168 td/osd-backfill-space/datafile 2024-09-16T03:59:32.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-168 td/osd-backfill-space/datafile 2024-09-16T03:59:32.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:32.116 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:32.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-169 td/osd-backfill-space/datafile 2024-09-16T03:59:32.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-169 td/osd-backfill-space/datafile 2024-09-16T03:59:32.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:32.241 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:32.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-170 td/osd-backfill-space/datafile 2024-09-16T03:59:32.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-170 td/osd-backfill-space/datafile 2024-09-16T03:59:32.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:32.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:32.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-171 td/osd-backfill-space/datafile 2024-09-16T03:59:32.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-171 td/osd-backfill-space/datafile 2024-09-16T03:59:32.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:32.474 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:32.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-172 td/osd-backfill-space/datafile 2024-09-16T03:59:32.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-172 td/osd-backfill-space/datafile 2024-09-16T03:59:32.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:32.599 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:32.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-173 td/osd-backfill-space/datafile 2024-09-16T03:59:32.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-173 td/osd-backfill-space/datafile 2024-09-16T03:59:32.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:32.716 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:32.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-174 td/osd-backfill-space/datafile 2024-09-16T03:59:32.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-174 td/osd-backfill-space/datafile 2024-09-16T03:59:32.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:32.833 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:32.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-175 td/osd-backfill-space/datafile 2024-09-16T03:59:32.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-175 td/osd-backfill-space/datafile 2024-09-16T03:59:32.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:32.991 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:32.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:32.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-176 td/osd-backfill-space/datafile 2024-09-16T03:59:33.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-176 td/osd-backfill-space/datafile 2024-09-16T03:59:33.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:33.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:33.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-177 td/osd-backfill-space/datafile 2024-09-16T03:59:33.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-177 td/osd-backfill-space/datafile 2024-09-16T03:59:33.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:33.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:33.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-178 td/osd-backfill-space/datafile 2024-09-16T03:59:33.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-178 td/osd-backfill-space/datafile 2024-09-16T03:59:33.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:33.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:33.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-179 td/osd-backfill-space/datafile 2024-09-16T03:59:33.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-179 td/osd-backfill-space/datafile 2024-09-16T03:59:33.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:33.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:33.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-180 td/osd-backfill-space/datafile 2024-09-16T03:59:33.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-180 td/osd-backfill-space/datafile 2024-09-16T03:59:33.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:33.641 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:33.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-181 td/osd-backfill-space/datafile 2024-09-16T03:59:33.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-181 td/osd-backfill-space/datafile 2024-09-16T03:59:33.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:33.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:33.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-182 td/osd-backfill-space/datafile 2024-09-16T03:59:33.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-182 td/osd-backfill-space/datafile 2024-09-16T03:59:33.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:33.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:33.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:33.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-183 td/osd-backfill-space/datafile 2024-09-16T03:59:33.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-183 td/osd-backfill-space/datafile 2024-09-16T03:59:34.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:34.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:34.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-184 td/osd-backfill-space/datafile 2024-09-16T03:59:34.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-184 td/osd-backfill-space/datafile 2024-09-16T03:59:34.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:34.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:34.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-185 td/osd-backfill-space/datafile 2024-09-16T03:59:34.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-185 td/osd-backfill-space/datafile 2024-09-16T03:59:34.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:34.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:34.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-186 td/osd-backfill-space/datafile 2024-09-16T03:59:34.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-186 td/osd-backfill-space/datafile 2024-09-16T03:59:34.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:34.408 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:34.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-187 td/osd-backfill-space/datafile 2024-09-16T03:59:34.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-187 td/osd-backfill-space/datafile 2024-09-16T03:59:34.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:34.525 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:34.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-188 td/osd-backfill-space/datafile 2024-09-16T03:59:34.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-188 td/osd-backfill-space/datafile 2024-09-16T03:59:34.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:34.641 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:34.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-189 td/osd-backfill-space/datafile 2024-09-16T03:59:34.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-189 td/osd-backfill-space/datafile 2024-09-16T03:59:34.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:34.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:34.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-190 td/osd-backfill-space/datafile 2024-09-16T03:59:34.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-190 td/osd-backfill-space/datafile 2024-09-16T03:59:34.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:34.925 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:34.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-191 td/osd-backfill-space/datafile 2024-09-16T03:59:34.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:34.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-191 td/osd-backfill-space/datafile 2024-09-16T03:59:35.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:35.041 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:35.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-192 td/osd-backfill-space/datafile 2024-09-16T03:59:35.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-192 td/osd-backfill-space/datafile 2024-09-16T03:59:35.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:35.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:35.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-193 td/osd-backfill-space/datafile 2024-09-16T03:59:35.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-193 td/osd-backfill-space/datafile 2024-09-16T03:59:35.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:35.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:35.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-194 td/osd-backfill-space/datafile 2024-09-16T03:59:35.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-194 td/osd-backfill-space/datafile 2024-09-16T03:59:35.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:35.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:35.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-195 td/osd-backfill-space/datafile 2024-09-16T03:59:35.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-195 td/osd-backfill-space/datafile 2024-09-16T03:59:35.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:35.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:35.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-196 td/osd-backfill-space/datafile 2024-09-16T03:59:35.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-196 td/osd-backfill-space/datafile 2024-09-16T03:59:35.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:35.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:35.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-197 td/osd-backfill-space/datafile 2024-09-16T03:59:35.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-197 td/osd-backfill-space/datafile 2024-09-16T03:59:35.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:35.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:35.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-198 td/osd-backfill-space/datafile 2024-09-16T03:59:35.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-198 td/osd-backfill-space/datafile 2024-09-16T03:59:35.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:35.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:35.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-199 td/osd-backfill-space/datafile 2024-09-16T03:59:35.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:35.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-199 td/osd-backfill-space/datafile 2024-09-16T03:59:36.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:36.050 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:36.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-200 td/osd-backfill-space/datafile 2024-09-16T03:59:36.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-200 td/osd-backfill-space/datafile 2024-09-16T03:59:36.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:36.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:36.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-201 td/osd-backfill-space/datafile 2024-09-16T03:59:36.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-201 td/osd-backfill-space/datafile 2024-09-16T03:59:36.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:36.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:36.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-202 td/osd-backfill-space/datafile 2024-09-16T03:59:36.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-202 td/osd-backfill-space/datafile 2024-09-16T03:59:36.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:36.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:36.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-203 td/osd-backfill-space/datafile 2024-09-16T03:59:36.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-203 td/osd-backfill-space/datafile 2024-09-16T03:59:36.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:36.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:36.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-204 td/osd-backfill-space/datafile 2024-09-16T03:59:36.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-204 td/osd-backfill-space/datafile 2024-09-16T03:59:36.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:36.667 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:36.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-205 td/osd-backfill-space/datafile 2024-09-16T03:59:36.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-205 td/osd-backfill-space/datafile 2024-09-16T03:59:36.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:36.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:36.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-206 td/osd-backfill-space/datafile 2024-09-16T03:59:36.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-206 td/osd-backfill-space/datafile 2024-09-16T03:59:36.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:36.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:36.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:36.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-207 td/osd-backfill-space/datafile 2024-09-16T03:59:37.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-207 td/osd-backfill-space/datafile 2024-09-16T03:59:37.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:37.075 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:37.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-208 td/osd-backfill-space/datafile 2024-09-16T03:59:37.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-208 td/osd-backfill-space/datafile 2024-09-16T03:59:37.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:37.192 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:37.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-209 td/osd-backfill-space/datafile 2024-09-16T03:59:37.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-209 td/osd-backfill-space/datafile 2024-09-16T03:59:37.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:37.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:37.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-210 td/osd-backfill-space/datafile 2024-09-16T03:59:37.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-210 td/osd-backfill-space/datafile 2024-09-16T03:59:37.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:37.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:37.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-211 td/osd-backfill-space/datafile 2024-09-16T03:59:37.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-211 td/osd-backfill-space/datafile 2024-09-16T03:59:37.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:37.559 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:37.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-212 td/osd-backfill-space/datafile 2024-09-16T03:59:37.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-212 td/osd-backfill-space/datafile 2024-09-16T03:59:37.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:37.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:37.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-213 td/osd-backfill-space/datafile 2024-09-16T03:59:37.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-213 td/osd-backfill-space/datafile 2024-09-16T03:59:37.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:37.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:37.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-214 td/osd-backfill-space/datafile 2024-09-16T03:59:37.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-214 td/osd-backfill-space/datafile 2024-09-16T03:59:37.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:37.975 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:37.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:37.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-215 td/osd-backfill-space/datafile 2024-09-16T03:59:38.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-215 td/osd-backfill-space/datafile 2024-09-16T03:59:38.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:38.092 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:38.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-216 td/osd-backfill-space/datafile 2024-09-16T03:59:38.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-216 td/osd-backfill-space/datafile 2024-09-16T03:59:38.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:38.209 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:38.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-217 td/osd-backfill-space/datafile 2024-09-16T03:59:38.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-217 td/osd-backfill-space/datafile 2024-09-16T03:59:38.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:38.325 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:38.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-218 td/osd-backfill-space/datafile 2024-09-16T03:59:38.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-218 td/osd-backfill-space/datafile 2024-09-16T03:59:38.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:38.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:38.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-219 td/osd-backfill-space/datafile 2024-09-16T03:59:38.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-219 td/osd-backfill-space/datafile 2024-09-16T03:59:38.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:38.559 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:38.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-220 td/osd-backfill-space/datafile 2024-09-16T03:59:38.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-220 td/osd-backfill-space/datafile 2024-09-16T03:59:38.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:38.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:38.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-221 td/osd-backfill-space/datafile 2024-09-16T03:59:38.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-221 td/osd-backfill-space/datafile 2024-09-16T03:59:38.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:38.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:38.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-222 td/osd-backfill-space/datafile 2024-09-16T03:59:38.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-222 td/osd-backfill-space/datafile 2024-09-16T03:59:38.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:38.951 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:38.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:38.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-223 td/osd-backfill-space/datafile 2024-09-16T03:59:39.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-223 td/osd-backfill-space/datafile 2024-09-16T03:59:39.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:39.067 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:39.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-224 td/osd-backfill-space/datafile 2024-09-16T03:59:39.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-224 td/osd-backfill-space/datafile 2024-09-16T03:59:39.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:39.209 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:39.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-225 td/osd-backfill-space/datafile 2024-09-16T03:59:39.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-225 td/osd-backfill-space/datafile 2024-09-16T03:59:39.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:39.326 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:39.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-226 td/osd-backfill-space/datafile 2024-09-16T03:59:39.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-226 td/osd-backfill-space/datafile 2024-09-16T03:59:39.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:39.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:39.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-227 td/osd-backfill-space/datafile 2024-09-16T03:59:39.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-227 td/osd-backfill-space/datafile 2024-09-16T03:59:39.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:39.559 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:39.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-228 td/osd-backfill-space/datafile 2024-09-16T03:59:39.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-228 td/osd-backfill-space/datafile 2024-09-16T03:59:39.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:39.676 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:39.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-229 td/osd-backfill-space/datafile 2024-09-16T03:59:39.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-229 td/osd-backfill-space/datafile 2024-09-16T03:59:39.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:39.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:39.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-230 td/osd-backfill-space/datafile 2024-09-16T03:59:39.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-230 td/osd-backfill-space/datafile 2024-09-16T03:59:39.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:39.959 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:39.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:39.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-231 td/osd-backfill-space/datafile 2024-09-16T03:59:40.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-231 td/osd-backfill-space/datafile 2024-09-16T03:59:40.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:40.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:40.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-232 td/osd-backfill-space/datafile 2024-09-16T03:59:40.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-232 td/osd-backfill-space/datafile 2024-09-16T03:59:40.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:40.192 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:40.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-233 td/osd-backfill-space/datafile 2024-09-16T03:59:40.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-233 td/osd-backfill-space/datafile 2024-09-16T03:59:40.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:40.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:40.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-234 td/osd-backfill-space/datafile 2024-09-16T03:59:40.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-234 td/osd-backfill-space/datafile 2024-09-16T03:59:40.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:40.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:40.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-235 td/osd-backfill-space/datafile 2024-09-16T03:59:40.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-235 td/osd-backfill-space/datafile 2024-09-16T03:59:40.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:40.551 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:40.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-236 td/osd-backfill-space/datafile 2024-09-16T03:59:40.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-236 td/osd-backfill-space/datafile 2024-09-16T03:59:40.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:40.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:40.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-237 td/osd-backfill-space/datafile 2024-09-16T03:59:40.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-237 td/osd-backfill-space/datafile 2024-09-16T03:59:40.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:40.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:40.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-238 td/osd-backfill-space/datafile 2024-09-16T03:59:40.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-238 td/osd-backfill-space/datafile 2024-09-16T03:59:40.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:40.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:40.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-239 td/osd-backfill-space/datafile 2024-09-16T03:59:40.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:40.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-239 td/osd-backfill-space/datafile 2024-09-16T03:59:41.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:41.051 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:41.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-240 td/osd-backfill-space/datafile 2024-09-16T03:59:41.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-240 td/osd-backfill-space/datafile 2024-09-16T03:59:41.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:41.168 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:41.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-241 td/osd-backfill-space/datafile 2024-09-16T03:59:41.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-241 td/osd-backfill-space/datafile 2024-09-16T03:59:41.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:41.284 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:41.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-242 td/osd-backfill-space/datafile 2024-09-16T03:59:41.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-242 td/osd-backfill-space/datafile 2024-09-16T03:59:41.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:41.401 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:41.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-243 td/osd-backfill-space/datafile 2024-09-16T03:59:41.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-243 td/osd-backfill-space/datafile 2024-09-16T03:59:41.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:41.518 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:41.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-244 td/osd-backfill-space/datafile 2024-09-16T03:59:41.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-244 td/osd-backfill-space/datafile 2024-09-16T03:59:41.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:41.635 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:41.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-245 td/osd-backfill-space/datafile 2024-09-16T03:59:41.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-245 td/osd-backfill-space/datafile 2024-09-16T03:59:41.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:41.768 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:41.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-246 td/osd-backfill-space/datafile 2024-09-16T03:59:41.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-246 td/osd-backfill-space/datafile 2024-09-16T03:59:41.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:41.943 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:41.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:41.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-247 td/osd-backfill-space/datafile 2024-09-16T03:59:42.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-247 td/osd-backfill-space/datafile 2024-09-16T03:59:42.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:42.059 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:42.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-248 td/osd-backfill-space/datafile 2024-09-16T03:59:42.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-248 td/osd-backfill-space/datafile 2024-09-16T03:59:42.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:42.200 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:42.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-249 td/osd-backfill-space/datafile 2024-09-16T03:59:42.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-249 td/osd-backfill-space/datafile 2024-09-16T03:59:42.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:42.318 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:42.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-250 td/osd-backfill-space/datafile 2024-09-16T03:59:42.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-250 td/osd-backfill-space/datafile 2024-09-16T03:59:42.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:42.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:42.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-251 td/osd-backfill-space/datafile 2024-09-16T03:59:42.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-251 td/osd-backfill-space/datafile 2024-09-16T03:59:42.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:42.551 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:42.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-252 td/osd-backfill-space/datafile 2024-09-16T03:59:42.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-252 td/osd-backfill-space/datafile 2024-09-16T03:59:42.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:42.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:42.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-253 td/osd-backfill-space/datafile 2024-09-16T03:59:42.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-253 td/osd-backfill-space/datafile 2024-09-16T03:59:42.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:42.785 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:42.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-254 td/osd-backfill-space/datafile 2024-09-16T03:59:42.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-254 td/osd-backfill-space/datafile 2024-09-16T03:59:42.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:42.918 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:42.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-255 td/osd-backfill-space/datafile 2024-09-16T03:59:42.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:42.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-255 td/osd-backfill-space/datafile 2024-09-16T03:59:43.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:43.035 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:43.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-256 td/osd-backfill-space/datafile 2024-09-16T03:59:43.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-256 td/osd-backfill-space/datafile 2024-09-16T03:59:43.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:43.151 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-257 td/osd-backfill-space/datafile 2024-09-16T03:59:43.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-257 td/osd-backfill-space/datafile 2024-09-16T03:59:43.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:43.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:43.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-258 td/osd-backfill-space/datafile 2024-09-16T03:59:43.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-258 td/osd-backfill-space/datafile 2024-09-16T03:59:43.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:43.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:43.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-259 td/osd-backfill-space/datafile 2024-09-16T03:59:43.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-259 td/osd-backfill-space/datafile 2024-09-16T03:59:43.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:43.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:43.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-260 td/osd-backfill-space/datafile 2024-09-16T03:59:43.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-260 td/osd-backfill-space/datafile 2024-09-16T03:59:43.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:43.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:43.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-261 td/osd-backfill-space/datafile 2024-09-16T03:59:43.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-261 td/osd-backfill-space/datafile 2024-09-16T03:59:43.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:43.735 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:43.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-262 td/osd-backfill-space/datafile 2024-09-16T03:59:43.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-262 td/osd-backfill-space/datafile 2024-09-16T03:59:43.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:43.893 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:43.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-263 td/osd-backfill-space/datafile 2024-09-16T03:59:43.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:43.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-263 td/osd-backfill-space/datafile 2024-09-16T03:59:44.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:44.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:44.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-264 td/osd-backfill-space/datafile 2024-09-16T03:59:44.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-264 td/osd-backfill-space/datafile 2024-09-16T03:59:44.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:44.126 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:44.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-265 td/osd-backfill-space/datafile 2024-09-16T03:59:44.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-265 td/osd-backfill-space/datafile 2024-09-16T03:59:44.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:44.243 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:44.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-266 td/osd-backfill-space/datafile 2024-09-16T03:59:44.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-266 td/osd-backfill-space/datafile 2024-09-16T03:59:44.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:44.360 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:44.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-267 td/osd-backfill-space/datafile 2024-09-16T03:59:44.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-267 td/osd-backfill-space/datafile 2024-09-16T03:59:44.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:44.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:44.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-268 td/osd-backfill-space/datafile 2024-09-16T03:59:44.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-268 td/osd-backfill-space/datafile 2024-09-16T03:59:44.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:44.593 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:44.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-269 td/osd-backfill-space/datafile 2024-09-16T03:59:44.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-269 td/osd-backfill-space/datafile 2024-09-16T03:59:44.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:44.710 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:44.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-270 td/osd-backfill-space/datafile 2024-09-16T03:59:44.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-270 td/osd-backfill-space/datafile 2024-09-16T03:59:44.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:44.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:44.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-271 td/osd-backfill-space/datafile 2024-09-16T03:59:44.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:44.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-271 td/osd-backfill-space/datafile 2024-09-16T03:59:45.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:45.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:45.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-272 td/osd-backfill-space/datafile 2024-09-16T03:59:45.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-272 td/osd-backfill-space/datafile 2024-09-16T03:59:45.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:45.127 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:45.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-273 td/osd-backfill-space/datafile 2024-09-16T03:59:45.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-273 td/osd-backfill-space/datafile 2024-09-16T03:59:45.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:45.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:45.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-274 td/osd-backfill-space/datafile 2024-09-16T03:59:45.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-274 td/osd-backfill-space/datafile 2024-09-16T03:59:45.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:45.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:45.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-275 td/osd-backfill-space/datafile 2024-09-16T03:59:45.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-275 td/osd-backfill-space/datafile 2024-09-16T03:59:45.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:45.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:45.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-276 td/osd-backfill-space/datafile 2024-09-16T03:59:45.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-276 td/osd-backfill-space/datafile 2024-09-16T03:59:45.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:45.718 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:45.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-277 td/osd-backfill-space/datafile 2024-09-16T03:59:45.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-277 td/osd-backfill-space/datafile 2024-09-16T03:59:45.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:45.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:45.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-278 td/osd-backfill-space/datafile 2024-09-16T03:59:45.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:45.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-278 td/osd-backfill-space/datafile 2024-09-16T03:59:46.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:46.002 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:46.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-279 td/osd-backfill-space/datafile 2024-09-16T03:59:46.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-279 td/osd-backfill-space/datafile 2024-09-16T03:59:46.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:46.118 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:46.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-280 td/osd-backfill-space/datafile 2024-09-16T03:59:46.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-280 td/osd-backfill-space/datafile 2024-09-16T03:59:46.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:46.235 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:46.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-281 td/osd-backfill-space/datafile 2024-09-16T03:59:46.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-281 td/osd-backfill-space/datafile 2024-09-16T03:59:46.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:46.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:46.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-282 td/osd-backfill-space/datafile 2024-09-16T03:59:46.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-282 td/osd-backfill-space/datafile 2024-09-16T03:59:46.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:46.473 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:46.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-283 td/osd-backfill-space/datafile 2024-09-16T03:59:46.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-283 td/osd-backfill-space/datafile 2024-09-16T03:59:46.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:46.585 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:46.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-284 td/osd-backfill-space/datafile 2024-09-16T03:59:46.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-284 td/osd-backfill-space/datafile 2024-09-16T03:59:46.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:46.702 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:46.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-285 td/osd-backfill-space/datafile 2024-09-16T03:59:46.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-285 td/osd-backfill-space/datafile 2024-09-16T03:59:46.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:46.819 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:46.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-286 td/osd-backfill-space/datafile 2024-09-16T03:59:46.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-286 td/osd-backfill-space/datafile 2024-09-16T03:59:46.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:46.977 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:46.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:46.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-287 td/osd-backfill-space/datafile 2024-09-16T03:59:47.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-287 td/osd-backfill-space/datafile 2024-09-16T03:59:47.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:47.094 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:47.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-288 td/osd-backfill-space/datafile 2024-09-16T03:59:47.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-288 td/osd-backfill-space/datafile 2024-09-16T03:59:47.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:47.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:47.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-289 td/osd-backfill-space/datafile 2024-09-16T03:59:47.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-289 td/osd-backfill-space/datafile 2024-09-16T03:59:47.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:47.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:47.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-290 td/osd-backfill-space/datafile 2024-09-16T03:59:47.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-290 td/osd-backfill-space/datafile 2024-09-16T03:59:47.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:47.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:47.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-291 td/osd-backfill-space/datafile 2024-09-16T03:59:47.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-291 td/osd-backfill-space/datafile 2024-09-16T03:59:47.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:47.611 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:47.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-292 td/osd-backfill-space/datafile 2024-09-16T03:59:47.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-292 td/osd-backfill-space/datafile 2024-09-16T03:59:47.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:47.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:47.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-293 td/osd-backfill-space/datafile 2024-09-16T03:59:47.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-293 td/osd-backfill-space/datafile 2024-09-16T03:59:47.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:47.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:47.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:47.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-294 td/osd-backfill-space/datafile 2024-09-16T03:59:48.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-294 td/osd-backfill-space/datafile 2024-09-16T03:59:48.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:48.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:48.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-295 td/osd-backfill-space/datafile 2024-09-16T03:59:48.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-295 td/osd-backfill-space/datafile 2024-09-16T03:59:48.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:48.218 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:48.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-296 td/osd-backfill-space/datafile 2024-09-16T03:59:48.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-296 td/osd-backfill-space/datafile 2024-09-16T03:59:48.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:48.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:48.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-297 td/osd-backfill-space/datafile 2024-09-16T03:59:48.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-297 td/osd-backfill-space/datafile 2024-09-16T03:59:48.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:48.486 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:48.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-298 td/osd-backfill-space/datafile 2024-09-16T03:59:48.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-298 td/osd-backfill-space/datafile 2024-09-16T03:59:48.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:48.619 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:48.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-299 td/osd-backfill-space/datafile 2024-09-16T03:59:48.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-299 td/osd-backfill-space/datafile 2024-09-16T03:59:48.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:48.752 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:48.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-300 td/osd-backfill-space/datafile 2024-09-16T03:59:48.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-300 td/osd-backfill-space/datafile 2024-09-16T03:59:48.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:48.936 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:48.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:48.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-301 td/osd-backfill-space/datafile 2024-09-16T03:59:49.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-301 td/osd-backfill-space/datafile 2024-09-16T03:59:49.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:49.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:49.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-302 td/osd-backfill-space/datafile 2024-09-16T03:59:49.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-302 td/osd-backfill-space/datafile 2024-09-16T03:59:49.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:49.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:49.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-303 td/osd-backfill-space/datafile 2024-09-16T03:59:49.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-303 td/osd-backfill-space/datafile 2024-09-16T03:59:49.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:49.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:49.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-304 td/osd-backfill-space/datafile 2024-09-16T03:59:49.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-304 td/osd-backfill-space/datafile 2024-09-16T03:59:49.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:49.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:49.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-305 td/osd-backfill-space/datafile 2024-09-16T03:59:49.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-305 td/osd-backfill-space/datafile 2024-09-16T03:59:49.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:49.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:49.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-306 td/osd-backfill-space/datafile 2024-09-16T03:59:49.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-306 td/osd-backfill-space/datafile 2024-09-16T03:59:49.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:49.736 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:49.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-307 td/osd-backfill-space/datafile 2024-09-16T03:59:49.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-307 td/osd-backfill-space/datafile 2024-09-16T03:59:49.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:49.911 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:49.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-308 td/osd-backfill-space/datafile 2024-09-16T03:59:49.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:49.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-308 td/osd-backfill-space/datafile 2024-09-16T03:59:50.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:50.044 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:50.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-309 td/osd-backfill-space/datafile 2024-09-16T03:59:50.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-309 td/osd-backfill-space/datafile 2024-09-16T03:59:50.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:50.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:50.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-310 td/osd-backfill-space/datafile 2024-09-16T03:59:50.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-310 td/osd-backfill-space/datafile 2024-09-16T03:59:50.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:50.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:50.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-311 td/osd-backfill-space/datafile 2024-09-16T03:59:50.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-311 td/osd-backfill-space/datafile 2024-09-16T03:59:50.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:50.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:50.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-312 td/osd-backfill-space/datafile 2024-09-16T03:59:50.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-312 td/osd-backfill-space/datafile 2024-09-16T03:59:50.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:50.619 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:50.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-313 td/osd-backfill-space/datafile 2024-09-16T03:59:50.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-313 td/osd-backfill-space/datafile 2024-09-16T03:59:50.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:50.752 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:50.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-314 td/osd-backfill-space/datafile 2024-09-16T03:59:50.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-314 td/osd-backfill-space/datafile 2024-09-16T03:59:50.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:50.952 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:50.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:50.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-315 td/osd-backfill-space/datafile 2024-09-16T03:59:51.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-315 td/osd-backfill-space/datafile 2024-09-16T03:59:51.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:51.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:51.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-316 td/osd-backfill-space/datafile 2024-09-16T03:59:51.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-316 td/osd-backfill-space/datafile 2024-09-16T03:59:51.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:51.244 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:51.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-317 td/osd-backfill-space/datafile 2024-09-16T03:59:51.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-317 td/osd-backfill-space/datafile 2024-09-16T03:59:51.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:51.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:51.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-318 td/osd-backfill-space/datafile 2024-09-16T03:59:51.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-318 td/osd-backfill-space/datafile 2024-09-16T03:59:51.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:51.511 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:51.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-319 td/osd-backfill-space/datafile 2024-09-16T03:59:51.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-319 td/osd-backfill-space/datafile 2024-09-16T03:59:51.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:51.644 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:51.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-320 td/osd-backfill-space/datafile 2024-09-16T03:59:51.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-320 td/osd-backfill-space/datafile 2024-09-16T03:59:51.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:51.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:51.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-321 td/osd-backfill-space/datafile 2024-09-16T03:59:51.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-321 td/osd-backfill-space/datafile 2024-09-16T03:59:51.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:51.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:51.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:51.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-322 td/osd-backfill-space/datafile 2024-09-16T03:59:52.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-322 td/osd-backfill-space/datafile 2024-09-16T03:59:52.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:52.094 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:52.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-323 td/osd-backfill-space/datafile 2024-09-16T03:59:52.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-323 td/osd-backfill-space/datafile 2024-09-16T03:59:52.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:52.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:52.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-324 td/osd-backfill-space/datafile 2024-09-16T03:59:52.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-324 td/osd-backfill-space/datafile 2024-09-16T03:59:52.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:52.361 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:52.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-325 td/osd-backfill-space/datafile 2024-09-16T03:59:52.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-325 td/osd-backfill-space/datafile 2024-09-16T03:59:52.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:52.494 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:52.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-326 td/osd-backfill-space/datafile 2024-09-16T03:59:52.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-326 td/osd-backfill-space/datafile 2024-09-16T03:59:52.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:52.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:52.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-327 td/osd-backfill-space/datafile 2024-09-16T03:59:52.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-327 td/osd-backfill-space/datafile 2024-09-16T03:59:52.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:52.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:52.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-328 td/osd-backfill-space/datafile 2024-09-16T03:59:52.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-328 td/osd-backfill-space/datafile 2024-09-16T03:59:52.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:52.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:52.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-329 td/osd-backfill-space/datafile 2024-09-16T03:59:52.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:52.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-329 td/osd-backfill-space/datafile 2024-09-16T03:59:53.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:53.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:53.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-330 td/osd-backfill-space/datafile 2024-09-16T03:59:53.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-330 td/osd-backfill-space/datafile 2024-09-16T03:59:53.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:53.194 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:53.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-331 td/osd-backfill-space/datafile 2024-09-16T03:59:53.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-331 td/osd-backfill-space/datafile 2024-09-16T03:59:53.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:53.328 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:53.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-332 td/osd-backfill-space/datafile 2024-09-16T03:59:53.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-332 td/osd-backfill-space/datafile 2024-09-16T03:59:53.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:53.461 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:53.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-333 td/osd-backfill-space/datafile 2024-09-16T03:59:53.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-333 td/osd-backfill-space/datafile 2024-09-16T03:59:53.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:53.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:53.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-334 td/osd-backfill-space/datafile 2024-09-16T03:59:53.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-334 td/osd-backfill-space/datafile 2024-09-16T03:59:53.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:53.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:53.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-335 td/osd-backfill-space/datafile 2024-09-16T03:59:53.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-335 td/osd-backfill-space/datafile 2024-09-16T03:59:53.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:53.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:53.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-336 td/osd-backfill-space/datafile 2024-09-16T03:59:53.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:53.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-336 td/osd-backfill-space/datafile 2024-09-16T03:59:54.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:54.053 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:54.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-337 td/osd-backfill-space/datafile 2024-09-16T03:59:54.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-337 td/osd-backfill-space/datafile 2024-09-16T03:59:54.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:54.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:54.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-338 td/osd-backfill-space/datafile 2024-09-16T03:59:54.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-338 td/osd-backfill-space/datafile 2024-09-16T03:59:54.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:54.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:54.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-339 td/osd-backfill-space/datafile 2024-09-16T03:59:54.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-339 td/osd-backfill-space/datafile 2024-09-16T03:59:54.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:54.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:54.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-340 td/osd-backfill-space/datafile 2024-09-16T03:59:54.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-340 td/osd-backfill-space/datafile 2024-09-16T03:59:54.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:54.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:54.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-341 td/osd-backfill-space/datafile 2024-09-16T03:59:54.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-341 td/osd-backfill-space/datafile 2024-09-16T03:59:54.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:54.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:54.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-342 td/osd-backfill-space/datafile 2024-09-16T03:59:54.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-342 td/osd-backfill-space/datafile 2024-09-16T03:59:54.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:54.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:54.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-343 td/osd-backfill-space/datafile 2024-09-16T03:59:54.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:54.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-343 td/osd-backfill-space/datafile 2024-09-16T03:59:55.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:55.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:55.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:55.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-344 td/osd-backfill-space/datafile 2024-09-16T03:59:55.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:55.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-344 td/osd-backfill-space/datafile 2024-09-16T03:59:55.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:55.195 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:55.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:55.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-345 td/osd-backfill-space/datafile 2024-09-16T03:59:55.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:55.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-345 td/osd-backfill-space/datafile 2024-09-16T03:59:55.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:55.328 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:55.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:55.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-346 td/osd-backfill-space/datafile 2024-09-16T03:59:55.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:55.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-346 td/osd-backfill-space/datafile 2024-09-16T03:59:55.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:55.462 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:55.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:55.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-347 td/osd-backfill-space/datafile 2024-09-16T03:59:55.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:55.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-347 td/osd-backfill-space/datafile 2024-09-16T03:59:55.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:55.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:55.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:55.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-348 td/osd-backfill-space/datafile 2024-09-16T03:59:55.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:55.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-348 td/osd-backfill-space/datafile 2024-09-16T03:59:55.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:55.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:55.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:55.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-349 td/osd-backfill-space/datafile 2024-09-16T03:59:56.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:56.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-349 td/osd-backfill-space/datafile 2024-09-16T03:59:56.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:56.604 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:56.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:56.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-350 td/osd-backfill-space/datafile 2024-09-16T03:59:56.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:56.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-350 td/osd-backfill-space/datafile 2024-09-16T03:59:56.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:56.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:56.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:56.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-351 td/osd-backfill-space/datafile 2024-09-16T03:59:56.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:56.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-351 td/osd-backfill-space/datafile 2024-09-16T03:59:56.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:56.927 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:56.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:56.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-352 td/osd-backfill-space/datafile 2024-09-16T03:59:57.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-352 td/osd-backfill-space/datafile 2024-09-16T03:59:57.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:57.078 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:57.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-353 td/osd-backfill-space/datafile 2024-09-16T03:59:57.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-353 td/osd-backfill-space/datafile 2024-09-16T03:59:57.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:57.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:57.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-354 td/osd-backfill-space/datafile 2024-09-16T03:59:57.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-354 td/osd-backfill-space/datafile 2024-09-16T03:59:57.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:57.361 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:57.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-355 td/osd-backfill-space/datafile 2024-09-16T03:59:57.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-355 td/osd-backfill-space/datafile 2024-09-16T03:59:57.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:57.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:57.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-356 td/osd-backfill-space/datafile 2024-09-16T03:59:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-356 td/osd-backfill-space/datafile 2024-09-16T03:59:57.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:57.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:57.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-357 td/osd-backfill-space/datafile 2024-09-16T03:59:57.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-357 td/osd-backfill-space/datafile 2024-09-16T03:59:57.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:57.781 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:57.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-358 td/osd-backfill-space/datafile 2024-09-16T03:59:57.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-358 td/osd-backfill-space/datafile 2024-09-16T03:59:57.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:57.962 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:57.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:57.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-359 td/osd-backfill-space/datafile 2024-09-16T03:59:58.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-359 td/osd-backfill-space/datafile 2024-09-16T03:59:58.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:58.095 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:58.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-360 td/osd-backfill-space/datafile 2024-09-16T03:59:58.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-360 td/osd-backfill-space/datafile 2024-09-16T03:59:58.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:58.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:58.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-361 td/osd-backfill-space/datafile 2024-09-16T03:59:58.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-361 td/osd-backfill-space/datafile 2024-09-16T03:59:58.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:58.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:58.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-362 td/osd-backfill-space/datafile 2024-09-16T03:59:58.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-362 td/osd-backfill-space/datafile 2024-09-16T03:59:58.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:58.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:58.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-363 td/osd-backfill-space/datafile 2024-09-16T03:59:58.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-363 td/osd-backfill-space/datafile 2024-09-16T03:59:58.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:58.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:58.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-364 td/osd-backfill-space/datafile 2024-09-16T03:59:58.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-364 td/osd-backfill-space/datafile 2024-09-16T03:59:58.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:58.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:58.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-365 td/osd-backfill-space/datafile 2024-09-16T03:59:58.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-365 td/osd-backfill-space/datafile 2024-09-16T03:59:58.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:58.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:58.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:58.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-366 td/osd-backfill-space/datafile 2024-09-16T03:59:59.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-366 td/osd-backfill-space/datafile 2024-09-16T03:59:59.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:59.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:59.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-367 td/osd-backfill-space/datafile 2024-09-16T03:59:59.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-367 td/osd-backfill-space/datafile 2024-09-16T03:59:59.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:59.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:59.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-368 td/osd-backfill-space/datafile 2024-09-16T03:59:59.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-368 td/osd-backfill-space/datafile 2024-09-16T03:59:59.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:59.355 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:59.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-369 td/osd-backfill-space/datafile 2024-09-16T03:59:59.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-369 td/osd-backfill-space/datafile 2024-09-16T03:59:59.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:59.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:59.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-370 td/osd-backfill-space/datafile 2024-09-16T03:59:59.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-370 td/osd-backfill-space/datafile 2024-09-16T03:59:59.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:59.637 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:59.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-371 td/osd-backfill-space/datafile 2024-09-16T03:59:59.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-371 td/osd-backfill-space/datafile 2024-09-16T03:59:59.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:59.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:59.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-372 td/osd-backfill-space/datafile 2024-09-16T03:59:59.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-372 td/osd-backfill-space/datafile 2024-09-16T03:59:59.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T03:59:59.987 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T03:59:59.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T03:59:59.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-373 td/osd-backfill-space/datafile 2024-09-16T04:00:00.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-373 td/osd-backfill-space/datafile 2024-09-16T04:00:00.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:00.120 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:00.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-374 td/osd-backfill-space/datafile 2024-09-16T04:00:00.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-374 td/osd-backfill-space/datafile 2024-09-16T04:00:00.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:00.279 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:00.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-375 td/osd-backfill-space/datafile 2024-09-16T04:00:00.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-375 td/osd-backfill-space/datafile 2024-09-16T04:00:00.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:00.421 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:00.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-376 td/osd-backfill-space/datafile 2024-09-16T04:00:00.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-376 td/osd-backfill-space/datafile 2024-09-16T04:00:00.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:00.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:00.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-377 td/osd-backfill-space/datafile 2024-09-16T04:00:00.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-377 td/osd-backfill-space/datafile 2024-09-16T04:00:00.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:00.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:00.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-378 td/osd-backfill-space/datafile 2024-09-16T04:00:00.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-378 td/osd-backfill-space/datafile 2024-09-16T04:00:00.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:00.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:00.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-379 td/osd-backfill-space/datafile 2024-09-16T04:00:00.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:00.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-379 td/osd-backfill-space/datafile 2024-09-16T04:00:01.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:01.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:01.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-380 td/osd-backfill-space/datafile 2024-09-16T04:00:01.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-380 td/osd-backfill-space/datafile 2024-09-16T04:00:01.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:01.137 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:01.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-381 td/osd-backfill-space/datafile 2024-09-16T04:00:01.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-381 td/osd-backfill-space/datafile 2024-09-16T04:00:01.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:01.271 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:01.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-382 td/osd-backfill-space/datafile 2024-09-16T04:00:01.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-382 td/osd-backfill-space/datafile 2024-09-16T04:00:01.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:01.404 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:01.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-383 td/osd-backfill-space/datafile 2024-09-16T04:00:01.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-383 td/osd-backfill-space/datafile 2024-09-16T04:00:01.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:01.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:01.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-384 td/osd-backfill-space/datafile 2024-09-16T04:00:01.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-384 td/osd-backfill-space/datafile 2024-09-16T04:00:01.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:01.671 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:01.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-385 td/osd-backfill-space/datafile 2024-09-16T04:00:01.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-385 td/osd-backfill-space/datafile 2024-09-16T04:00:01.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:01.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:01.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-386 td/osd-backfill-space/datafile 2024-09-16T04:00:01.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-386 td/osd-backfill-space/datafile 2024-09-16T04:00:01.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:01.979 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:01.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:01.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-387 td/osd-backfill-space/datafile 2024-09-16T04:00:02.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-387 td/osd-backfill-space/datafile 2024-09-16T04:00:02.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:02.113 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:02.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-388 td/osd-backfill-space/datafile 2024-09-16T04:00:02.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-388 td/osd-backfill-space/datafile 2024-09-16T04:00:02.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:02.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:02.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-389 td/osd-backfill-space/datafile 2024-09-16T04:00:02.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-389 td/osd-backfill-space/datafile 2024-09-16T04:00:02.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:02.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:02.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-390 td/osd-backfill-space/datafile 2024-09-16T04:00:02.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-390 td/osd-backfill-space/datafile 2024-09-16T04:00:02.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:02.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:02.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-391 td/osd-backfill-space/datafile 2024-09-16T04:00:02.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-391 td/osd-backfill-space/datafile 2024-09-16T04:00:02.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:02.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:02.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-392 td/osd-backfill-space/datafile 2024-09-16T04:00:02.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-392 td/osd-backfill-space/datafile 2024-09-16T04:00:02.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:02.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:02.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-393 td/osd-backfill-space/datafile 2024-09-16T04:00:02.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-393 td/osd-backfill-space/datafile 2024-09-16T04:00:02.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:02.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:02.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:02.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-394 td/osd-backfill-space/datafile 2024-09-16T04:00:03.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-394 td/osd-backfill-space/datafile 2024-09-16T04:00:03.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:03.096 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:03.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-395 td/osd-backfill-space/datafile 2024-09-16T04:00:03.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-395 td/osd-backfill-space/datafile 2024-09-16T04:00:03.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:03.245 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:03.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-396 td/osd-backfill-space/datafile 2024-09-16T04:00:03.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-396 td/osd-backfill-space/datafile 2024-09-16T04:00:03.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:03.380 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:03.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-397 td/osd-backfill-space/datafile 2024-09-16T04:00:03.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-397 td/osd-backfill-space/datafile 2024-09-16T04:00:03.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:03.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:03.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-398 td/osd-backfill-space/datafile 2024-09-16T04:00:03.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-398 td/osd-backfill-space/datafile 2024-09-16T04:00:03.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:03.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:03.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-399 td/osd-backfill-space/datafile 2024-09-16T04:00:03.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-399 td/osd-backfill-space/datafile 2024-09-16T04:00:03.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:03.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:03.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-400 td/osd-backfill-space/datafile 2024-09-16T04:00:03.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-400 td/osd-backfill-space/datafile 2024-09-16T04:00:03.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:03.979 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:03.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:03.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-401 td/osd-backfill-space/datafile 2024-09-16T04:00:04.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-401 td/osd-backfill-space/datafile 2024-09-16T04:00:04.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:04.113 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:04.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-402 td/osd-backfill-space/datafile 2024-09-16T04:00:04.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-402 td/osd-backfill-space/datafile 2024-09-16T04:00:04.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:04.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:04.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-403 td/osd-backfill-space/datafile 2024-09-16T04:00:04.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-403 td/osd-backfill-space/datafile 2024-09-16T04:00:04.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:04.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:04.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-404 td/osd-backfill-space/datafile 2024-09-16T04:00:04.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-404 td/osd-backfill-space/datafile 2024-09-16T04:00:04.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:04.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:04.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-405 td/osd-backfill-space/datafile 2024-09-16T04:00:04.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-405 td/osd-backfill-space/datafile 2024-09-16T04:00:04.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:04.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:04.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-406 td/osd-backfill-space/datafile 2024-09-16T04:00:04.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-406 td/osd-backfill-space/datafile 2024-09-16T04:00:04.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:04.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:04.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-407 td/osd-backfill-space/datafile 2024-09-16T04:00:04.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-407 td/osd-backfill-space/datafile 2024-09-16T04:00:04.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:04.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:04.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:04.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-408 td/osd-backfill-space/datafile 2024-09-16T04:00:05.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-408 td/osd-backfill-space/datafile 2024-09-16T04:00:05.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:05.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:05.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-409 td/osd-backfill-space/datafile 2024-09-16T04:00:05.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-409 td/osd-backfill-space/datafile 2024-09-16T04:00:05.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:05.204 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:05.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-410 td/osd-backfill-space/datafile 2024-09-16T04:00:05.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-410 td/osd-backfill-space/datafile 2024-09-16T04:00:05.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:05.338 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:05.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-411 td/osd-backfill-space/datafile 2024-09-16T04:00:05.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-411 td/osd-backfill-space/datafile 2024-09-16T04:00:05.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:05.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:05.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-412 td/osd-backfill-space/datafile 2024-09-16T04:00:05.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-412 td/osd-backfill-space/datafile 2024-09-16T04:00:05.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:05.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:05.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-413 td/osd-backfill-space/datafile 2024-09-16T04:00:05.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-413 td/osd-backfill-space/datafile 2024-09-16T04:00:05.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:05.729 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:05.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-414 td/osd-backfill-space/datafile 2024-09-16T04:00:05.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-414 td/osd-backfill-space/datafile 2024-09-16T04:00:05.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:05.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:05.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-415 td/osd-backfill-space/datafile 2024-09-16T04:00:05.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:05.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-415 td/osd-backfill-space/datafile 2024-09-16T04:00:06.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:06.062 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:06.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-416 td/osd-backfill-space/datafile 2024-09-16T04:00:06.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-416 td/osd-backfill-space/datafile 2024-09-16T04:00:06.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:06.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:06.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-417 td/osd-backfill-space/datafile 2024-09-16T04:00:06.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-417 td/osd-backfill-space/datafile 2024-09-16T04:00:06.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:06.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:06.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-418 td/osd-backfill-space/datafile 2024-09-16T04:00:06.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-418 td/osd-backfill-space/datafile 2024-09-16T04:00:06.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:06.538 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:06.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-419 td/osd-backfill-space/datafile 2024-09-16T04:00:06.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-419 td/osd-backfill-space/datafile 2024-09-16T04:00:06.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:06.670 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:06.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-420 td/osd-backfill-space/datafile 2024-09-16T04:00:06.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-420 td/osd-backfill-space/datafile 2024-09-16T04:00:06.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:06.804 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:06.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-421 td/osd-backfill-space/datafile 2024-09-16T04:00:06.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-421 td/osd-backfill-space/datafile 2024-09-16T04:00:06.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:06.958 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:06.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:06.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-422 td/osd-backfill-space/datafile 2024-09-16T04:00:07.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-422 td/osd-backfill-space/datafile 2024-09-16T04:00:07.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:07.087 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:07.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-423 td/osd-backfill-space/datafile 2024-09-16T04:00:07.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-423 td/osd-backfill-space/datafile 2024-09-16T04:00:07.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:07.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:07.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-424 td/osd-backfill-space/datafile 2024-09-16T04:00:07.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-424 td/osd-backfill-space/datafile 2024-09-16T04:00:07.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:07.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:07.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-425 td/osd-backfill-space/datafile 2024-09-16T04:00:07.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-425 td/osd-backfill-space/datafile 2024-09-16T04:00:07.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:07.487 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:07.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-426 td/osd-backfill-space/datafile 2024-09-16T04:00:07.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-426 td/osd-backfill-space/datafile 2024-09-16T04:00:07.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:07.621 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:07.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-427 td/osd-backfill-space/datafile 2024-09-16T04:00:07.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-427 td/osd-backfill-space/datafile 2024-09-16T04:00:07.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:07.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:07.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-428 td/osd-backfill-space/datafile 2024-09-16T04:00:07.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-428 td/osd-backfill-space/datafile 2024-09-16T04:00:07.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:07.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:07.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-429 td/osd-backfill-space/datafile 2024-09-16T04:00:07.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:07.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-429 td/osd-backfill-space/datafile 2024-09-16T04:00:08.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:08.062 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:08.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-430 td/osd-backfill-space/datafile 2024-09-16T04:00:08.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-430 td/osd-backfill-space/datafile 2024-09-16T04:00:08.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:08.195 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:08.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-431 td/osd-backfill-space/datafile 2024-09-16T04:00:08.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-431 td/osd-backfill-space/datafile 2024-09-16T04:00:08.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:08.329 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:08.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-432 td/osd-backfill-space/datafile 2024-09-16T04:00:08.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-432 td/osd-backfill-space/datafile 2024-09-16T04:00:08.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:08.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:08.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-433 td/osd-backfill-space/datafile 2024-09-16T04:00:08.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-433 td/osd-backfill-space/datafile 2024-09-16T04:00:08.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:08.621 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:08.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-434 td/osd-backfill-space/datafile 2024-09-16T04:00:08.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-434 td/osd-backfill-space/datafile 2024-09-16T04:00:08.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:08.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:08.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-435 td/osd-backfill-space/datafile 2024-09-16T04:00:08.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-435 td/osd-backfill-space/datafile 2024-09-16T04:00:08.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:08.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:08.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:08.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-436 td/osd-backfill-space/datafile 2024-09-16T04:00:09.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-436 td/osd-backfill-space/datafile 2024-09-16T04:00:09.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:09.095 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:09.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-437 td/osd-backfill-space/datafile 2024-09-16T04:00:09.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-437 td/osd-backfill-space/datafile 2024-09-16T04:00:09.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:09.254 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:09.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-438 td/osd-backfill-space/datafile 2024-09-16T04:00:09.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-438 td/osd-backfill-space/datafile 2024-09-16T04:00:09.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:09.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:09.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-439 td/osd-backfill-space/datafile 2024-09-16T04:00:09.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-439 td/osd-backfill-space/datafile 2024-09-16T04:00:09.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:09.520 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:09.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-440 td/osd-backfill-space/datafile 2024-09-16T04:00:09.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-440 td/osd-backfill-space/datafile 2024-09-16T04:00:09.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:09.654 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:09.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-441 td/osd-backfill-space/datafile 2024-09-16T04:00:09.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-441 td/osd-backfill-space/datafile 2024-09-16T04:00:09.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:09.839 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:09.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-442 td/osd-backfill-space/datafile 2024-09-16T04:00:09.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-442 td/osd-backfill-space/datafile 2024-09-16T04:00:09.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:09.971 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:09.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:09.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-443 td/osd-backfill-space/datafile 2024-09-16T04:00:10.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-443 td/osd-backfill-space/datafile 2024-09-16T04:00:10.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:10.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:10.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-444 td/osd-backfill-space/datafile 2024-09-16T04:00:10.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-444 td/osd-backfill-space/datafile 2024-09-16T04:00:10.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:10.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:10.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-445 td/osd-backfill-space/datafile 2024-09-16T04:00:10.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-445 td/osd-backfill-space/datafile 2024-09-16T04:00:10.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:10.371 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:10.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-446 td/osd-backfill-space/datafile 2024-09-16T04:00:10.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-446 td/osd-backfill-space/datafile 2024-09-16T04:00:10.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:10.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:10.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-447 td/osd-backfill-space/datafile 2024-09-16T04:00:10.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-447 td/osd-backfill-space/datafile 2024-09-16T04:00:10.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:10.637 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:10.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-448 td/osd-backfill-space/datafile 2024-09-16T04:00:10.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-448 td/osd-backfill-space/datafile 2024-09-16T04:00:10.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:10.772 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:10.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-449 td/osd-backfill-space/datafile 2024-09-16T04:00:10.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-449 td/osd-backfill-space/datafile 2024-09-16T04:00:10.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:10.922 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:10.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-450 td/osd-backfill-space/datafile 2024-09-16T04:00:10.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:10.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-450 td/osd-backfill-space/datafile 2024-09-16T04:00:11.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:11.054 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:11.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-451 td/osd-backfill-space/datafile 2024-09-16T04:00:11.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-451 td/osd-backfill-space/datafile 2024-09-16T04:00:11.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:11.187 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:11.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-452 td/osd-backfill-space/datafile 2024-09-16T04:00:11.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-452 td/osd-backfill-space/datafile 2024-09-16T04:00:11.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:11.321 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:11.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-453 td/osd-backfill-space/datafile 2024-09-16T04:00:11.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-453 td/osd-backfill-space/datafile 2024-09-16T04:00:11.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:11.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:11.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-454 td/osd-backfill-space/datafile 2024-09-16T04:00:11.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-454 td/osd-backfill-space/datafile 2024-09-16T04:00:11.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:11.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:11.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-455 td/osd-backfill-space/datafile 2024-09-16T04:00:11.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-455 td/osd-backfill-space/datafile 2024-09-16T04:00:11.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:11.721 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:11.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-456 td/osd-backfill-space/datafile 2024-09-16T04:00:11.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-456 td/osd-backfill-space/datafile 2024-09-16T04:00:11.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:11.880 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:11.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-457 td/osd-backfill-space/datafile 2024-09-16T04:00:11.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:11.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-457 td/osd-backfill-space/datafile 2024-09-16T04:00:12.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:12.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:12.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-458 td/osd-backfill-space/datafile 2024-09-16T04:00:12.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-458 td/osd-backfill-space/datafile 2024-09-16T04:00:12.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:12.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:12.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-459 td/osd-backfill-space/datafile 2024-09-16T04:00:12.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-459 td/osd-backfill-space/datafile 2024-09-16T04:00:12.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:12.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:12.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-460 td/osd-backfill-space/datafile 2024-09-16T04:00:12.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-460 td/osd-backfill-space/datafile 2024-09-16T04:00:12.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:12.479 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:12.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-461 td/osd-backfill-space/datafile 2024-09-16T04:00:12.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-461 td/osd-backfill-space/datafile 2024-09-16T04:00:12.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:12.612 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:12.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-462 td/osd-backfill-space/datafile 2024-09-16T04:00:12.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-462 td/osd-backfill-space/datafile 2024-09-16T04:00:12.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:12.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:12.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-463 td/osd-backfill-space/datafile 2024-09-16T04:00:12.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-463 td/osd-backfill-space/datafile 2024-09-16T04:00:12.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:12.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:12.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-464 td/osd-backfill-space/datafile 2024-09-16T04:00:12.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:12.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-464 td/osd-backfill-space/datafile 2024-09-16T04:00:13.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:13.029 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:13.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-465 td/osd-backfill-space/datafile 2024-09-16T04:00:13.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-465 td/osd-backfill-space/datafile 2024-09-16T04:00:13.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:13.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:13.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-466 td/osd-backfill-space/datafile 2024-09-16T04:00:13.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-466 td/osd-backfill-space/datafile 2024-09-16T04:00:13.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:13.304 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:13.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-467 td/osd-backfill-space/datafile 2024-09-16T04:00:13.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-467 td/osd-backfill-space/datafile 2024-09-16T04:00:13.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:13.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:13.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-468 td/osd-backfill-space/datafile 2024-09-16T04:00:13.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-468 td/osd-backfill-space/datafile 2024-09-16T04:00:13.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:13.571 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:13.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-469 td/osd-backfill-space/datafile 2024-09-16T04:00:13.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-469 td/osd-backfill-space/datafile 2024-09-16T04:00:13.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:13.704 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:13.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-470 td/osd-backfill-space/datafile 2024-09-16T04:00:13.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-470 td/osd-backfill-space/datafile 2024-09-16T04:00:13.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:13.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:13.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-471 td/osd-backfill-space/datafile 2024-09-16T04:00:13.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:13.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-471 td/osd-backfill-space/datafile 2024-09-16T04:00:14.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:14.013 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:14.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-472 td/osd-backfill-space/datafile 2024-09-16T04:00:14.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-472 td/osd-backfill-space/datafile 2024-09-16T04:00:14.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:14.148 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:14.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-473 td/osd-backfill-space/datafile 2024-09-16T04:00:14.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-473 td/osd-backfill-space/datafile 2024-09-16T04:00:14.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:14.279 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:14.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-474 td/osd-backfill-space/datafile 2024-09-16T04:00:14.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-474 td/osd-backfill-space/datafile 2024-09-16T04:00:14.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:14.413 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:14.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-475 td/osd-backfill-space/datafile 2024-09-16T04:00:14.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-475 td/osd-backfill-space/datafile 2024-09-16T04:00:14.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:14.546 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:14.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-476 td/osd-backfill-space/datafile 2024-09-16T04:00:14.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-476 td/osd-backfill-space/datafile 2024-09-16T04:00:14.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:14.680 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:14.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-477 td/osd-backfill-space/datafile 2024-09-16T04:00:14.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-477 td/osd-backfill-space/datafile 2024-09-16T04:00:14.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:14.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:14.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-478 td/osd-backfill-space/datafile 2024-09-16T04:00:14.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:14.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-478 td/osd-backfill-space/datafile 2024-09-16T04:00:15.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:15.022 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:15.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-479 td/osd-backfill-space/datafile 2024-09-16T04:00:15.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-479 td/osd-backfill-space/datafile 2024-09-16T04:00:15.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:15.155 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:15.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-480 td/osd-backfill-space/datafile 2024-09-16T04:00:15.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-480 td/osd-backfill-space/datafile 2024-09-16T04:00:15.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:15.305 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:15.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-481 td/osd-backfill-space/datafile 2024-09-16T04:00:15.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-481 td/osd-backfill-space/datafile 2024-09-16T04:00:15.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:15.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:15.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-482 td/osd-backfill-space/datafile 2024-09-16T04:00:15.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-482 td/osd-backfill-space/datafile 2024-09-16T04:00:15.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:15.571 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:15.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-483 td/osd-backfill-space/datafile 2024-09-16T04:00:15.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-483 td/osd-backfill-space/datafile 2024-09-16T04:00:15.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:15.705 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:15.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-484 td/osd-backfill-space/datafile 2024-09-16T04:00:15.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-484 td/osd-backfill-space/datafile 2024-09-16T04:00:15.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:15.913 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:15.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-485 td/osd-backfill-space/datafile 2024-09-16T04:00:15.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:15.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-485 td/osd-backfill-space/datafile 2024-09-16T04:00:16.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:16.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:16.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-486 td/osd-backfill-space/datafile 2024-09-16T04:00:16.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-486 td/osd-backfill-space/datafile 2024-09-16T04:00:16.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:16.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:16.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-487 td/osd-backfill-space/datafile 2024-09-16T04:00:16.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-487 td/osd-backfill-space/datafile 2024-09-16T04:00:16.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:16.313 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:16.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-488 td/osd-backfill-space/datafile 2024-09-16T04:00:16.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-488 td/osd-backfill-space/datafile 2024-09-16T04:00:16.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:16.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:16.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-489 td/osd-backfill-space/datafile 2024-09-16T04:00:16.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-489 td/osd-backfill-space/datafile 2024-09-16T04:00:16.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:16.580 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:16.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-490 td/osd-backfill-space/datafile 2024-09-16T04:00:16.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-490 td/osd-backfill-space/datafile 2024-09-16T04:00:16.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:16.713 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:16.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-491 td/osd-backfill-space/datafile 2024-09-16T04:00:16.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-491 td/osd-backfill-space/datafile 2024-09-16T04:00:16.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:16.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:16.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-492 td/osd-backfill-space/datafile 2024-09-16T04:00:16.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:16.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-492 td/osd-backfill-space/datafile 2024-09-16T04:00:17.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:17.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:17.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-493 td/osd-backfill-space/datafile 2024-09-16T04:00:17.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-493 td/osd-backfill-space/datafile 2024-09-16T04:00:17.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:17.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:17.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-494 td/osd-backfill-space/datafile 2024-09-16T04:00:17.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-494 td/osd-backfill-space/datafile 2024-09-16T04:00:17.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:17.338 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:17.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-495 td/osd-backfill-space/datafile 2024-09-16T04:00:17.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-495 td/osd-backfill-space/datafile 2024-09-16T04:00:17.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:17.472 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:17.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-496 td/osd-backfill-space/datafile 2024-09-16T04:00:17.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-496 td/osd-backfill-space/datafile 2024-09-16T04:00:17.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:17.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:17.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-497 td/osd-backfill-space/datafile 2024-09-16T04:00:17.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-497 td/osd-backfill-space/datafile 2024-09-16T04:00:17.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:17.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:17.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-498 td/osd-backfill-space/datafile 2024-09-16T04:00:17.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-498 td/osd-backfill-space/datafile 2024-09-16T04:00:17.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:17.956 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:17.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:17.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-499 td/osd-backfill-space/datafile 2024-09-16T04:00:18.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-499 td/osd-backfill-space/datafile 2024-09-16T04:00:18.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:18.123 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:18.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-500 td/osd-backfill-space/datafile 2024-09-16T04:00:18.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-500 td/osd-backfill-space/datafile 2024-09-16T04:00:18.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:18.279 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:18.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-501 td/osd-backfill-space/datafile 2024-09-16T04:00:18.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-501 td/osd-backfill-space/datafile 2024-09-16T04:00:18.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:18.431 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:18.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-502 td/osd-backfill-space/datafile 2024-09-16T04:00:18.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-502 td/osd-backfill-space/datafile 2024-09-16T04:00:18.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:18.581 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:18.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-503 td/osd-backfill-space/datafile 2024-09-16T04:00:18.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-503 td/osd-backfill-space/datafile 2024-09-16T04:00:18.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:18.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:18.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-504 td/osd-backfill-space/datafile 2024-09-16T04:00:18.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-504 td/osd-backfill-space/datafile 2024-09-16T04:00:18.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:18.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:18.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-505 td/osd-backfill-space/datafile 2024-09-16T04:00:18.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:18.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-505 td/osd-backfill-space/datafile 2024-09-16T04:00:19.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:19.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:19.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-506 td/osd-backfill-space/datafile 2024-09-16T04:00:19.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-506 td/osd-backfill-space/datafile 2024-09-16T04:00:19.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:19.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:19.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-507 td/osd-backfill-space/datafile 2024-09-16T04:00:19.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-507 td/osd-backfill-space/datafile 2024-09-16T04:00:19.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:19.331 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:19.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-508 td/osd-backfill-space/datafile 2024-09-16T04:00:19.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-508 td/osd-backfill-space/datafile 2024-09-16T04:00:19.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:19.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:19.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-509 td/osd-backfill-space/datafile 2024-09-16T04:00:19.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-509 td/osd-backfill-space/datafile 2024-09-16T04:00:19.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:19.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:19.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-510 td/osd-backfill-space/datafile 2024-09-16T04:00:19.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-510 td/osd-backfill-space/datafile 2024-09-16T04:00:19.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:19.831 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:19.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-511 td/osd-backfill-space/datafile 2024-09-16T04:00:19.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-511 td/osd-backfill-space/datafile 2024-09-16T04:00:19.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:19.973 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:19.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:19.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-512 td/osd-backfill-space/datafile 2024-09-16T04:00:20.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-512 td/osd-backfill-space/datafile 2024-09-16T04:00:20.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:20.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:20.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-513 td/osd-backfill-space/datafile 2024-09-16T04:00:20.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-513 td/osd-backfill-space/datafile 2024-09-16T04:00:20.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:20.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:20.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-514 td/osd-backfill-space/datafile 2024-09-16T04:00:20.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-514 td/osd-backfill-space/datafile 2024-09-16T04:00:20.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:20.431 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:20.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-515 td/osd-backfill-space/datafile 2024-09-16T04:00:20.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-515 td/osd-backfill-space/datafile 2024-09-16T04:00:20.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:20.582 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:20.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-516 td/osd-backfill-space/datafile 2024-09-16T04:00:20.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-516 td/osd-backfill-space/datafile 2024-09-16T04:00:20.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:20.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:20.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-517 td/osd-backfill-space/datafile 2024-09-16T04:00:20.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-517 td/osd-backfill-space/datafile 2024-09-16T04:00:20.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:20.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:20.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-518 td/osd-backfill-space/datafile 2024-09-16T04:00:20.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:20.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-518 td/osd-backfill-space/datafile 2024-09-16T04:00:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:21.049 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:21.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:21.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-519 td/osd-backfill-space/datafile 2024-09-16T04:00:21.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:21.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-519 td/osd-backfill-space/datafile 2024-09-16T04:00:21.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:21.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:21.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:21.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-520 td/osd-backfill-space/datafile 2024-09-16T04:00:21.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:21.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-520 td/osd-backfill-space/datafile 2024-09-16T04:00:21.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:21.373 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:21.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:21.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-521 td/osd-backfill-space/datafile 2024-09-16T04:00:21.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:21.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-521 td/osd-backfill-space/datafile 2024-09-16T04:00:21.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:21.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:21.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:21.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-522 td/osd-backfill-space/datafile 2024-09-16T04:00:21.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:21.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-522 td/osd-backfill-space/datafile 2024-09-16T04:00:21.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:21.682 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:21.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:21.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-523 td/osd-backfill-space/datafile 2024-09-16T04:00:21.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:21.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-523 td/osd-backfill-space/datafile 2024-09-16T04:00:21.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:21.860 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:21.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:21.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-524 td/osd-backfill-space/datafile 2024-09-16T04:00:21.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:21.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-524 td/osd-backfill-space/datafile 2024-09-16T04:00:22.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:22.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:22.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-525 td/osd-backfill-space/datafile 2024-09-16T04:00:22.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-525 td/osd-backfill-space/datafile 2024-09-16T04:00:22.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:22.165 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:22.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-526 td/osd-backfill-space/datafile 2024-09-16T04:00:22.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-526 td/osd-backfill-space/datafile 2024-09-16T04:00:22.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:22.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:22.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-527 td/osd-backfill-space/datafile 2024-09-16T04:00:22.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-527 td/osd-backfill-space/datafile 2024-09-16T04:00:22.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:22.465 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:22.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-528 td/osd-backfill-space/datafile 2024-09-16T04:00:22.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-528 td/osd-backfill-space/datafile 2024-09-16T04:00:22.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:22.615 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:22.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-529 td/osd-backfill-space/datafile 2024-09-16T04:00:22.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-529 td/osd-backfill-space/datafile 2024-09-16T04:00:22.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:22.765 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:22.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-530 td/osd-backfill-space/datafile 2024-09-16T04:00:22.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-530 td/osd-backfill-space/datafile 2024-09-16T04:00:22.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:22.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:22.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:22.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-531 td/osd-backfill-space/datafile 2024-09-16T04:00:23.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-531 td/osd-backfill-space/datafile 2024-09-16T04:00:23.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:23.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:23.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-532 td/osd-backfill-space/datafile 2024-09-16T04:00:23.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-532 td/osd-backfill-space/datafile 2024-09-16T04:00:23.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:23.240 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:23.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-533 td/osd-backfill-space/datafile 2024-09-16T04:00:23.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-533 td/osd-backfill-space/datafile 2024-09-16T04:00:23.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:23.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:23.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-534 td/osd-backfill-space/datafile 2024-09-16T04:00:23.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-534 td/osd-backfill-space/datafile 2024-09-16T04:00:23.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:23.540 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:23.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-535 td/osd-backfill-space/datafile 2024-09-16T04:00:23.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-535 td/osd-backfill-space/datafile 2024-09-16T04:00:23.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:23.690 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:23.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-536 td/osd-backfill-space/datafile 2024-09-16T04:00:23.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-536 td/osd-backfill-space/datafile 2024-09-16T04:00:23.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:23.864 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:23.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-537 td/osd-backfill-space/datafile 2024-09-16T04:00:23.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:23.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-537 td/osd-backfill-space/datafile 2024-09-16T04:00:24.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:24.032 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:24.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-538 td/osd-backfill-space/datafile 2024-09-16T04:00:24.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-538 td/osd-backfill-space/datafile 2024-09-16T04:00:24.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:24.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:24.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-539 td/osd-backfill-space/datafile 2024-09-16T04:00:24.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-539 td/osd-backfill-space/datafile 2024-09-16T04:00:24.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:24.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:24.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-540 td/osd-backfill-space/datafile 2024-09-16T04:00:24.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-540 td/osd-backfill-space/datafile 2024-09-16T04:00:24.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:24.473 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:24.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-541 td/osd-backfill-space/datafile 2024-09-16T04:00:24.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-541 td/osd-backfill-space/datafile 2024-09-16T04:00:24.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:24.624 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:24.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-542 td/osd-backfill-space/datafile 2024-09-16T04:00:24.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-542 td/osd-backfill-space/datafile 2024-09-16T04:00:24.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:24.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:24.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-543 td/osd-backfill-space/datafile 2024-09-16T04:00:24.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-543 td/osd-backfill-space/datafile 2024-09-16T04:00:24.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:24.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:24.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:24.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-544 td/osd-backfill-space/datafile 2024-09-16T04:00:25.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-544 td/osd-backfill-space/datafile 2024-09-16T04:00:25.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:25.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:25.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-545 td/osd-backfill-space/datafile 2024-09-16T04:00:25.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-545 td/osd-backfill-space/datafile 2024-09-16T04:00:25.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:25.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:25.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-546 td/osd-backfill-space/datafile 2024-09-16T04:00:25.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-546 td/osd-backfill-space/datafile 2024-09-16T04:00:25.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:25.399 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:25.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-547 td/osd-backfill-space/datafile 2024-09-16T04:00:25.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-547 td/osd-backfill-space/datafile 2024-09-16T04:00:25.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:25.549 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:25.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-548 td/osd-backfill-space/datafile 2024-09-16T04:00:25.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-548 td/osd-backfill-space/datafile 2024-09-16T04:00:25.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:25.699 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:25.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-549 td/osd-backfill-space/datafile 2024-09-16T04:00:25.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-549 td/osd-backfill-space/datafile 2024-09-16T04:00:25.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:25.899 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:25.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-550 td/osd-backfill-space/datafile 2024-09-16T04:00:25.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:25.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-550 td/osd-backfill-space/datafile 2024-09-16T04:00:26.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:26.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:26.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-551 td/osd-backfill-space/datafile 2024-09-16T04:00:26.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-551 td/osd-backfill-space/datafile 2024-09-16T04:00:26.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:26.209 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:26.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-552 td/osd-backfill-space/datafile 2024-09-16T04:00:26.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-552 td/osd-backfill-space/datafile 2024-09-16T04:00:26.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:26.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:26.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-553 td/osd-backfill-space/datafile 2024-09-16T04:00:26.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-553 td/osd-backfill-space/datafile 2024-09-16T04:00:26.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:26.507 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:26.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-554 td/osd-backfill-space/datafile 2024-09-16T04:00:26.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-554 td/osd-backfill-space/datafile 2024-09-16T04:00:26.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:26.657 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:26.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-555 td/osd-backfill-space/datafile 2024-09-16T04:00:26.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-555 td/osd-backfill-space/datafile 2024-09-16T04:00:26.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:26.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:26.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-556 td/osd-backfill-space/datafile 2024-09-16T04:00:26.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-556 td/osd-backfill-space/datafile 2024-09-16T04:00:26.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:26.982 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:26.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:26.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-557 td/osd-backfill-space/datafile 2024-09-16T04:00:27.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:27.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-557 td/osd-backfill-space/datafile 2024-09-16T04:00:27.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:27.149 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:27.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:27.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-558 td/osd-backfill-space/datafile 2024-09-16T04:00:27.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:27.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-558 td/osd-backfill-space/datafile 2024-09-16T04:00:27.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:27.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:27.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:27.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-559 td/osd-backfill-space/datafile 2024-09-16T04:00:27.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:27.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-559 td/osd-backfill-space/datafile 2024-09-16T04:00:27.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:27.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:27.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:27.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-560 td/osd-backfill-space/datafile 2024-09-16T04:00:27.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:27.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-560 td/osd-backfill-space/datafile 2024-09-16T04:00:28.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:28.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:28.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:28.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-561 td/osd-backfill-space/datafile 2024-09-16T04:00:28.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:28.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-561 td/osd-backfill-space/datafile 2024-09-16T04:00:28.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:28.332 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:28.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:28.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-562 td/osd-backfill-space/datafile 2024-09-16T04:00:28.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:28.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-562 td/osd-backfill-space/datafile 2024-09-16T04:00:28.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:28.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:28.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:28.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-563 td/osd-backfill-space/datafile 2024-09-16T04:00:28.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:28.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-563 td/osd-backfill-space/datafile 2024-09-16T04:00:28.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:28.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:28.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:28.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-564 td/osd-backfill-space/datafile 2024-09-16T04:00:28.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:28.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-564 td/osd-backfill-space/datafile 2024-09-16T04:00:28.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:28.782 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:28.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:28.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-565 td/osd-backfill-space/datafile 2024-09-16T04:00:28.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:28.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-565 td/osd-backfill-space/datafile 2024-09-16T04:00:28.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:28.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:28.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:28.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-566 td/osd-backfill-space/datafile 2024-09-16T04:00:29.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-566 td/osd-backfill-space/datafile 2024-09-16T04:00:29.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:29.091 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:29.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-567 td/osd-backfill-space/datafile 2024-09-16T04:00:29.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-567 td/osd-backfill-space/datafile 2024-09-16T04:00:29.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:29.240 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:29.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-568 td/osd-backfill-space/datafile 2024-09-16T04:00:29.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-568 td/osd-backfill-space/datafile 2024-09-16T04:00:29.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:29.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:29.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-569 td/osd-backfill-space/datafile 2024-09-16T04:00:29.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-569 td/osd-backfill-space/datafile 2024-09-16T04:00:29.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:29.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:29.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-570 td/osd-backfill-space/datafile 2024-09-16T04:00:29.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-570 td/osd-backfill-space/datafile 2024-09-16T04:00:29.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:29.690 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:29.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-571 td/osd-backfill-space/datafile 2024-09-16T04:00:29.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-571 td/osd-backfill-space/datafile 2024-09-16T04:00:29.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:29.891 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:29.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-572 td/osd-backfill-space/datafile 2024-09-16T04:00:29.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:29.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-572 td/osd-backfill-space/datafile 2024-09-16T04:00:30.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:30.074 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:30.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:30.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-573 td/osd-backfill-space/datafile 2024-09-16T04:00:30.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:30.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-573 td/osd-backfill-space/datafile 2024-09-16T04:00:30.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:30.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:30.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:30.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-574 td/osd-backfill-space/datafile 2024-09-16T04:00:30.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:30.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-574 td/osd-backfill-space/datafile 2024-09-16T04:00:30.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:30.399 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:30.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:30.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-575 td/osd-backfill-space/datafile 2024-09-16T04:00:30.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:30.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-575 td/osd-backfill-space/datafile 2024-09-16T04:00:30.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:30.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:30.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:30.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-576 td/osd-backfill-space/datafile 2024-09-16T04:00:30.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:30.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-576 td/osd-backfill-space/datafile 2024-09-16T04:00:30.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:30.699 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:30.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:30.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-577 td/osd-backfill-space/datafile 2024-09-16T04:00:30.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:30.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-577 td/osd-backfill-space/datafile 2024-09-16T04:00:30.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:30.849 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:30.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:30.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-578 td/osd-backfill-space/datafile 2024-09-16T04:00:30.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:30.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-578 td/osd-backfill-space/datafile 2024-09-16T04:00:31.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:31.016 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:31.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-579 td/osd-backfill-space/datafile 2024-09-16T04:00:31.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-579 td/osd-backfill-space/datafile 2024-09-16T04:00:31.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:31.166 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:31.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-580 td/osd-backfill-space/datafile 2024-09-16T04:00:31.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-580 td/osd-backfill-space/datafile 2024-09-16T04:00:31.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:31.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:31.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-581 td/osd-backfill-space/datafile 2024-09-16T04:00:31.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-581 td/osd-backfill-space/datafile 2024-09-16T04:00:31.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:31.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:31.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-582 td/osd-backfill-space/datafile 2024-09-16T04:00:31.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-582 td/osd-backfill-space/datafile 2024-09-16T04:00:31.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:31.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:31.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-583 td/osd-backfill-space/datafile 2024-09-16T04:00:31.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-583 td/osd-backfill-space/datafile 2024-09-16T04:00:31.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:31.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:31.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-584 td/osd-backfill-space/datafile 2024-09-16T04:00:31.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-584 td/osd-backfill-space/datafile 2024-09-16T04:00:31.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:31.975 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:31.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:31.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-585 td/osd-backfill-space/datafile 2024-09-16T04:00:32.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-585 td/osd-backfill-space/datafile 2024-09-16T04:00:32.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:32.125 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:32.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-586 td/osd-backfill-space/datafile 2024-09-16T04:00:32.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-586 td/osd-backfill-space/datafile 2024-09-16T04:00:32.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:32.274 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:32.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-587 td/osd-backfill-space/datafile 2024-09-16T04:00:32.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-587 td/osd-backfill-space/datafile 2024-09-16T04:00:32.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:32.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:32.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-588 td/osd-backfill-space/datafile 2024-09-16T04:00:32.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-588 td/osd-backfill-space/datafile 2024-09-16T04:00:32.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:32.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:32.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-589 td/osd-backfill-space/datafile 2024-09-16T04:00:32.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-589 td/osd-backfill-space/datafile 2024-09-16T04:00:32.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:32.690 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:32.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-590 td/osd-backfill-space/datafile 2024-09-16T04:00:32.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-590 td/osd-backfill-space/datafile 2024-09-16T04:00:32.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:32.823 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:32.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-591 td/osd-backfill-space/datafile 2024-09-16T04:00:32.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-591 td/osd-backfill-space/datafile 2024-09-16T04:00:32.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:32.990 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:32.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:32.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-592 td/osd-backfill-space/datafile 2024-09-16T04:00:33.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-592 td/osd-backfill-space/datafile 2024-09-16T04:00:33.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:33.148 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:33.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-593 td/osd-backfill-space/datafile 2024-09-16T04:00:33.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-593 td/osd-backfill-space/datafile 2024-09-16T04:00:33.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:33.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:33.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-594 td/osd-backfill-space/datafile 2024-09-16T04:00:33.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-594 td/osd-backfill-space/datafile 2024-09-16T04:00:33.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:33.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:33.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-595 td/osd-backfill-space/datafile 2024-09-16T04:00:33.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-595 td/osd-backfill-space/datafile 2024-09-16T04:00:33.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:33.573 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:33.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-596 td/osd-backfill-space/datafile 2024-09-16T04:00:33.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-596 td/osd-backfill-space/datafile 2024-09-16T04:00:33.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:33.707 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:33.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-597 td/osd-backfill-space/datafile 2024-09-16T04:00:33.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-597 td/osd-backfill-space/datafile 2024-09-16T04:00:33.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:33.915 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:33.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-598 td/osd-backfill-space/datafile 2024-09-16T04:00:33.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:33.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-598 td/osd-backfill-space/datafile 2024-09-16T04:00:34.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:34.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:34.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:34.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-599 td/osd-backfill-space/datafile 2024-09-16T04:00:34.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:34.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-599 td/osd-backfill-space/datafile 2024-09-16T04:00:34.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:501: TEST_backfill_multi_partial: for o in $(seq 1 $objects) 2024-09-16T04:00:34.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:00:34.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:34.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test1 put obj-1-600 td/osd-backfill-space/datafile 2024-09-16T04:00:34.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:503: TEST_backfill_multi_partial: for p in $(seq 1 $pools) 2024-09-16T04:00:34.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:505: TEST_backfill_multi_partial: rados -p test2 put obj-2-600 td/osd-backfill-space/datafile 2024-09-16T04:00:34.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:509: TEST_backfill_multi_partial: kill_daemon td/osd-backfill-space/osd.2.pid TERM 2024-09-16T04:00:34.340 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: cat td/osd-backfill-space/osd.2.pid 2024-09-16T04:00:34.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: local pid=177806 2024-09-16T04:00:34.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:247: kill_daemon: local send_signal=TERM 2024-09-16T04:00:34.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:248: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2024-09-16T04:00:34.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:249: kill_daemon: local exit_code=1 2024-09-16T04:00:34.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T04:00:34.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -TERM 177806 2024-09-16T04:00:34.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2024-09-16T04:00:34.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2024-09-16T04:00:34.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.1 2024-09-16T04:00:34.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T04:00:34.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 177806 2024-09-16T04:00:34.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2024-09-16T04:00:34.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2024-09-16T04:00:34.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.2 2024-09-16T04:00:34.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T04:00:34.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 177806 2024-09-16T04:00:34.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: exit_code=0 2024-09-16T04:00:34.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: break 2024-09-16T04:00:34.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: return 0 2024-09-16T04:00:34.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:510: TEST_backfill_multi_partial: ceph osd out osd.2 2024-09-16T04:00:35.218 INFO:tasks.workunit.client.0.smithi026.stderr:osd.2 is already out. 2024-09-16T04:00:35.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:512: TEST_backfill_multi_partial: activate_osd td/osd-backfill-space 1 2024-09-16T04:00:35.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-backfill-space 2024-09-16T04:00:35.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T04:00:35.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2024-09-16T04:00:35.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T04:00:35.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-backfill-space/1 2024-09-16T04:00:35.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:00:35.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:00:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:00:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:00:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-09-16T04:00:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-09-16T04:00:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T04:00:35.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2024-09-16T04:00:35.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:00:35.239 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T04:00:35.239 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:00:35.239 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:00:35.239 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:00:35.240 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:00:35.240 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:00:35.240 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:00:35.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:00:35.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:00:35.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:00:35.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:00:35.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:00:35.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:00:35.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:00:35.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:00:35.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T04:00:35.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T04:00:35.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-backfill-space/1 2024-09-16T04:00:35.242 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T04:00:35.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2024-09-16T04:00:35.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:00:35.244 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-backfill-space/1/whoami 2024-09-16T04:00:35.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2024-09-16T04:00:35.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T04:00:35.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T04:00:35.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T04:00:35.267 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:00:35.264+0000 7f869b358640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:35.269 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:00:35.266+0000 7f869b358640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:35.270 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:00:35.268+0000 7f869b358640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:00:35.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2024-09-16T04:00:35.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:00:35.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:00:35.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:00:35.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:00:35.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:35.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:00:35.683 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:00:35.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:35.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:00:36.111 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:00:36.108+0000 7f869b358640 -1 Falling back to public interface 2024-09-16T04:00:36.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:37.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:37.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:37.128 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:00:37.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:00:37.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:37.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:00:37.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:38.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:38.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:38.585 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:00:38.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:00:38.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:38.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:00:38.835 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:00:38.833+0000 7f869b358640 -1 osd.1 47 log_to_monitors true 2024-09-16T04:00:39.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:00:40.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:00:40.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:00:40.033 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:00:40.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:00:40.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:00:40.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:00:40.567 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up out weight 0 up_from 53 up_thru 54 down_at 48 last_clean_interval [42,47) [v2:127.0.0.1:6810/363548137,v1:127.0.0.1:6811/363548137] [v2:127.0.0.1:6812/363548137,v1:127.0.0.1:6813/363548137] exists,up c7947f11-e894-41de-b15f-a5c3658a4a1f 2024-09-16T04:00:40.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:00:40.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:00:40.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:00:40.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:513: TEST_backfill_multi_partial: ceph osd in osd.1 2024-09-16T04:00:41.274 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already in. 2024-09-16T04:00:41.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:514: TEST_backfill_multi_partial: sleep 30 2024-09-16T04:01:11.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:516: TEST_backfill_multi_partial: wait_for_not_backfilling 1200 2024-09-16T04:01:11.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:83: wait_for_not_backfilling: local timeout=1200 2024-09-16T04:01:11.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:84: wait_for_not_backfilling: wait_for_not_state backfilling 1200 2024-09-16T04:01:11.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=backfilling 2024-09-16T04:01:11.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-09-16T04:01:11.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-09-16T04:01:11.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 1200 5 2024-09-16T04:01:11.292 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:01:11.292 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:01:11.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:01:11.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:01:11.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:01:11.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15') 2024-09-16T04:01:11.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-09-16T04:01:11.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-09-16T04:01:11.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-09-16T04:01:11.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:01:11.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:01:12.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:01:12.315 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:01:12.315 INFO:tasks.workunit.client.0.smithi026.stderr:2' 2024-09-16T04:01:12.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:01:12.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:01:12.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:01:12.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836567 2024-09-16T04:01:12.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836567 2024-09-16T04:01:12.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836567' 2024-09-16T04:01:12.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:01:12.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:01:12.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=227633266697 2024-09-16T04:01:12.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 227633266697 2024-09-16T04:01:12.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836567 1-227633266697' 2024-09-16T04:01:12.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:01:12.569 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:01:12.658 INFO:tasks.workunit.client.0.smithi026.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T04:01:12.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq= 2024-09-16T04:01:12.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z '' 2024-09-16T04:01:12.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: continue 2024-09-16T04:01:12.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:01:12.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836567 2024-09-16T04:01:12.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:01:12.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:01:12.662 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836567 2024-09-16T04:01:12.662 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:01:12.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836567 2024-09-16T04:01:12.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836567' 2024-09-16T04:01:12.663 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836567 2024-09-16T04:01:12.664 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:01:13.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836567 -lt 21474836567 2024-09-16T04:01:13.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:01:13.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-227633266697 2024-09-16T04:01:13.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:01:13.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:01:13.084 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-227633266697 2024-09-16T04:01:13.084 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:01:13.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=227633266697 2024-09-16T04:01:13.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 227633266697' 2024-09-16T04:01:13.085 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 227633266697 2024-09-16T04:01:13.085 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:01:13.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 227633266697 -lt 227633266697 2024-09-16T04:01:13.509 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-09-16T04:01:13.509 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:01:13.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:01:14.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 3 == 0 2024-09-16T04:01:14.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:01:14.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:01:14.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:01:14.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:01:14.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:01:14.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:01:14.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:01:14.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-09-16T04:01:14.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-09-16T04:01:14.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-09-16T04:01:14.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-09-16T04:01:14.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:517: TEST_backfill_multi_partial: wait_for_not_activating 60 2024-09-16T04:01:14.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:89: wait_for_not_activating: local timeout=60 2024-09-16T04:01:14.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:90: wait_for_not_activating: wait_for_not_state activating 60 2024-09-16T04:01:14.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=activating 2024-09-16T04:01:14.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-09-16T04:01:14.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-09-16T04:01:14.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 60 5 2024-09-16T04:01:14.492 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:01:14.492 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:01:14.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:01:14.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:01:14.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:01:14.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15') 2024-09-16T04:01:14.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-09-16T04:01:14.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-09-16T04:01:14.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-09-16T04:01:14.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:01:14.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:01:15.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:01:15.028 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:01:15.028 INFO:tasks.workunit.client.0.smithi026.stderr:2' 2024-09-16T04:01:15.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:01:15.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:01:15.029 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:01:15.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836570 2024-09-16T04:01:15.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836570 2024-09-16T04:01:15.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836570' 2024-09-16T04:01:15.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:01:15.189 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:01:15.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=227633266700 2024-09-16T04:01:15.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 227633266700 2024-09-16T04:01:15.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836570 1-227633266700' 2024-09-16T04:01:15.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:01:15.312 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:01:15.401 INFO:tasks.workunit.client.0.smithi026.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T04:01:15.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq= 2024-09-16T04:01:15.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z '' 2024-09-16T04:01:15.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: continue 2024-09-16T04:01:15.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:01:15.403 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836570 2024-09-16T04:01:15.403 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:01:15.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:01:15.405 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836570 2024-09-16T04:01:15.405 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:01:15.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836570 2024-09-16T04:01:15.406 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836570 2024-09-16T04:01:15.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836570' 2024-09-16T04:01:15.406 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:01:15.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836568 -lt 21474836570 2024-09-16T04:01:15.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:01:16.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:01:16.865 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:01:17.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836570 -lt 21474836570 2024-09-16T04:01:17.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:01:17.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-227633266700 2024-09-16T04:01:17.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:01:17.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:01:17.308 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-227633266700 2024-09-16T04:01:17.308 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:01:17.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=227633266700 2024-09-16T04:01:17.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 227633266700' 2024-09-16T04:01:17.310 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 227633266700 2024-09-16T04:01:17.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:01:17.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 227633266700 -lt 227633266700 2024-09-16T04:01:17.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-09-16T04:01:17.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:01:17.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:01:18.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 3 == 0 2024-09-16T04:01:18.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:01:18.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state activating 2024-09-16T04:01:18.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=activating 2024-09-16T04:01:18.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:01:18.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("activating"))' 2024-09-16T04:01:18.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:01:18.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2024-09-16T04:01:18.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-09-16T04:01:18.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-09-16T04:01:18.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-09-16T04:01:18.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-09-16T04:01:18.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:519: TEST_backfill_multi_partial: flush_pg_stats 2024-09-16T04:01:18.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:01:18.725 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:01:19.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:01:19.176 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:01:19.176 INFO:tasks.workunit.client.0.smithi026.stderr:2' 2024-09-16T04:01:19.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:01:19.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:01:19.176 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:01:19.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836572 2024-09-16T04:01:19.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836572 2024-09-16T04:01:19.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836572' 2024-09-16T04:01:19.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:01:19.319 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:01:19.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=227633266703 2024-09-16T04:01:19.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 227633266703 2024-09-16T04:01:19.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836572 1-227633266703' 2024-09-16T04:01:19.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:01:19.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:01:19.543 INFO:tasks.workunit.client.0.smithi026.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T04:01:19.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq= 2024-09-16T04:01:19.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z '' 2024-09-16T04:01:19.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: continue 2024-09-16T04:01:19.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:01:19.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836572 2024-09-16T04:01:19.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:01:19.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:01:19.547 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836572 2024-09-16T04:01:19.547 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:01:19.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836572 2024-09-16T04:01:19.548 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836572 2024-09-16T04:01:19.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836572' 2024-09-16T04:01:19.548 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:01:19.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836570 -lt 21474836572 2024-09-16T04:01:19.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:01:20.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:01:20.999 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:01:21.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836573 -lt 21474836572 2024-09-16T04:01:21.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:01:21.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-227633266703 2024-09-16T04:01:21.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:01:21.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:01:21.450 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-227633266703 2024-09-16T04:01:21.450 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:01:21.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=227633266703 2024-09-16T04:01:21.451 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 227633266703 2024-09-16T04:01:21.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 227633266703' 2024-09-16T04:01:21.452 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:01:21.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 227633266703 -lt 227633266703 2024-09-16T04:01:21.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:520: TEST_backfill_multi_partial: ceph pg dump pgs 2024-09-16T04:01:22.289 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:01:22.289 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 600 0 600 0 0 1566600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-09-16T04:01:11.939965+0000 48'600 60:676 [1,0] 1 [0] 0 0'0 2024-09-16T03:55:47.162674+0000 0'0 2024-09-16T03:55:47.162674+0000 0 0 no scrub is scheduled 0 0 2024-09-16T04:01:22.289 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 600 0 0 0 0 1566600 0 0 10 1190 10 active+clean 2024-09-16T04:00:53.043568+0000 48'1200 60:2507 [1,0] 1 [1,0] 1 0'0 2024-09-16T03:55:44.259994+0000 0'0 2024-09-16T03:55:44.259994+0000 0 0 periodic scrub scheduled @ 2024-09-17T12:46:23.864839+0000 0 0 2024-09-16T04:01:22.290 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 600 0 0 0 0 1566600 0 0 100 500 100 active+clean 2024-09-16T04:00:41.401493+0000 36'600 60:667 [1] 1 [1] 1 0'0 2024-09-16T03:55:41.373963+0000 0'0 2024-09-16T03:55:41.373963+0000 0 0 periodic scrub scheduled @ 2024-09-17T05:56:54.013598+0000 0 0 2024-09-16T04:01:22.290 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:01:22.290 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:01:22.290 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:01:22.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:522: TEST_backfill_multi_partial: ERRORS=0 2024-09-16T04:01:22.301 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:523: TEST_backfill_multi_partial: get_num_in_state backfill_toofull 2024-09-16T04:01:22.301 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfill_toofull 2024-09-16T04:01:22.301 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:01:22.301 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfill_toofull"))' 2024-09-16T04:01:22.302 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:01:22.302 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfill_toofull"))] | length' 2024-09-16T04:01:22.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:523: TEST_backfill_multi_partial: '[' 1 '!=' 1 ']' 2024-09-16T04:01:22.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:529: TEST_backfill_multi_partial: get_num_in_state active+clean 2024-09-16T04:01:22.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=active+clean 2024-09-16T04:01:22.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:01:22.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("active+clean"))' 2024-09-16T04:01:22.707 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:01:22.707 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("active+clean"))] | length' 2024-09-16T04:01:23.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:529: TEST_backfill_multi_partial: '[' 2 '!=' 2 ']' 2024-09-16T04:01:23.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:535: TEST_backfill_multi_partial: '[' 0 '!=' 0 ']' 2024-09-16T04:01:23.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:540: TEST_backfill_multi_partial: delete_pool fillpool 2024-09-16T04:01:23.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=fillpool 2024-09-16T04:01:23.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it 2024-09-16T04:01:23.640 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'fillpool' does not exist 2024-09-16T04:01:23.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:541: TEST_backfill_multi_partial: seq 1 2 2024-09-16T04:01:23.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:541: TEST_backfill_multi_partial: for i in $(seq 1 $pools) 2024-09-16T04:01:23.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:543: TEST_backfill_multi_partial: delete_pool test1 2024-09-16T04:01:23.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test1 2024-09-16T04:01:23.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-09-16T04:01:24.190 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' does not exist 2024-09-16T04:01:24.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:541: TEST_backfill_multi_partial: for i in $(seq 1 $pools) 2024-09-16T04:01:24.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:543: TEST_backfill_multi_partial: delete_pool test2 2024-09-16T04:01:24.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test2 2024-09-16T04:01:24.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-09-16T04:01:24.987 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' does not exist 2024-09-16T04:01:24.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:545: TEST_backfill_multi_partial: kill_daemons td/osd-backfill-space 2024-09-16T04:01:24.999 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:01:24.999 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:01:24.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:01:24.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:01:24.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:01:26.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:01:26.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:546: TEST_backfill_multi_partial: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log 2024-09-16T04:01:26.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-09-16T04:01:26.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:01:26.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:01:26.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:01:26.367 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:01:26.367 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:01:26.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:01:26.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:01:26.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:01:26.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:01:26.373 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:01:26.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:01:26.374 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:01:26.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:01:26.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:01:26.376 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:01:26.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:01:26.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:01:26.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:01:26.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:01:26.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:01:26.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:01:26.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:01:26.468 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:01:26.468 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:01:26.468 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:01:26.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-space 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-space 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:01:26.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:01:26.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:01:26.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:01:26.471 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:01:26.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:01:26.473 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:01:26.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:01:26.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:01:26.474 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:01:26.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:01:26.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:01:26.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:01:26.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:01:26.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:01:26.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:01:26.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:01:26.479 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:01:26.479 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:01:26.479 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:01:26.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:01:26.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:01:26.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:01:26.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-space 2024-09-16T04:01:26.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:01:26.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:01:26.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:01:26.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.114688 2024-09-16T04:01:26.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:01:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:01:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:01:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-09-16T04:01:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_backfill_test_multi td/osd-backfill-space 2024-09-16T04:01:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:192: TEST_backfill_test_multi: local dir=td/osd-backfill-space 2024-09-16T04:01:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:193: TEST_backfill_test_multi: local pools=8 2024-09-16T04:01:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:194: TEST_backfill_test_multi: local OSDS=20 2024-09-16T04:01:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:196: TEST_backfill_test_multi: run_mon td/osd-backfill-space a 2024-09-16T04:01:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-space 2024-09-16T04:01:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:01:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:01:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:01:26.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-space/a 2024-09-16T04:01:26.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-09-16T04:01:26.978 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:01:26.979 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:01:26.979 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:01:26.979 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:01:26.979 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:01:26.979 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:01:26.979 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:01:26.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:01:27.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:01:27.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:01:27.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:01:27.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:01:27.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:01:27.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:01:27.181 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:01:27.181 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:01:27.181 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:01:27.182 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:01:27.182 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:01:27.182 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:01:27.182 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T04:01:27.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:01:27.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get fsid 2024-09-16T04:01:27.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:01:27.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:01:27.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:01:27.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:01:27.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:01:27.269 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:01:27.269 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:01:27.269 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:01:27.269 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:01:27.269 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:01:27.269 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:01:27.269 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T04:01:27.270 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:01:27.270 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get mon_host 2024-09-16T04:01:27.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:197: TEST_backfill_test_multi: run_mgr td/osd-backfill-space x 2024-09-16T04:01:27.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-space 2024-09-16T04:01:27.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:01:27.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:01:27.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:01:27.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-space/x 2024-09-16T04:01:27.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:01:28.229 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:01:28.230 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:01:28.230 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:01:28.230 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:01:28.230 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:01:28.230 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:01:28.230 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:01:28.230 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:01:28.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:01:28.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:198: TEST_backfill_test_multi: export CEPH_ARGS 2024-09-16T04:01:28.265 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: expr 20 - 1 2024-09-16T04:01:28.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: seq 0 19 2024-09-16T04:01:28.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:01:28.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 0 2024-09-16T04:01:28.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:01:28.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:01:28.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T04:01:28.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:01:28.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/0 2024-09-16T04:01:28.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:01:28.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:01:28.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:01:28.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:01:28.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-09-16T04:01:28.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-09-16T04:01:28.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:01:28.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:01:28.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:01:28.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:01:28.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:01:28.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:01:28.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:01:28.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:01:28.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:01:28.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/0 2024-09-16T04:01:28.273 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:01:28.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a6d1677b-4882-46d2-87be-d9288f57e459 2024-09-16T04:01:28.274 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 a6d1677b-4882-46d2-87be-d9288f57e459 2024-09-16T04:01:28.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a6d1677b-4882-46d2-87be-d9288f57e459' 2024-09-16T04:01:28.274 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:01:28.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCYredm3zt4ERAANF2rPxLXO8utYys0rJrJiw== 2024-09-16T04:01:28.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCYredm3zt4ERAANF2rPxLXO8utYys0rJrJiw=="}' 2024-09-16T04:01:28.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a6d1677b-4882-46d2-87be-d9288f57e459 -i td/osd-backfill-space/0/new.json 2024-09-16T04:01:28.562 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:01:28.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/0/new.json 2024-09-16T04:01:28.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCYredm3zt4ERAANF2rPxLXO8utYys0rJrJiw== --osd-uuid a6d1677b-4882-46d2-87be-d9288f57e459 2024-09-16T04:01:28.609 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:01:28.607+0000 7f2be3d43640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:28.631 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:01:28.629+0000 7f2be3d43640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:28.633 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:01:28.630+0000 7f2be3d43640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:28.633 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:01:28.631+0000 7f2be3d43640 -1 bdev(0x55ebb2d93c00 td/osd-backfill-space/0/block) open stat got: (1) Operation not permitted 2024-09-16T04:01:28.633 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:01:28.631+0000 7f2be3d43640 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-09-16T04:01:34.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-09-16T04:01:34.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:01:34.326 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T04:01:34.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T04:01:34.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:01:34.912 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T04:01:34.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T04:01:34.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:01:34.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:01:34.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:01:34.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:01:34.946 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:01:34.943+0000 7fcb957cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:34.948 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:01:34.945+0000 7fcb957cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:34.949 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:01:34.946+0000 7fcb957cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:01:35.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T04:01:35.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:01:35.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:01:35.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:01:35.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:01:35.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:35.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:01:35.366 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:01:35.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:35.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:35.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:36.048 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:01:36.045+0000 7fcb957cc640 -1 Falling back to public interface 2024-09-16T04:01:36.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:36.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:36.818 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:01:36.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:01:36.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:36.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:37.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:38.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:38.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:38.268 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:01:38.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:01:38.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:38.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:38.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:39.096 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:01:39.093+0000 7fcb957cc640 -1 osd.0 0 log_to_monitors true 2024-09-16T04:01:39.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:39.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:39.688 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:01:39.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:01:39.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:39.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:40.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:41.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:41.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:41.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:01:41.176 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:01:41.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:41.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:41.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:42.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:42.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:42.623 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:01:42.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:01:42.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:42.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:43.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:44.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:44.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:44.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:01:44.156 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:01:44.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:44.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:44.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:45.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:45.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:45.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:01:45.593 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:01:45.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:45.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:46.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:47.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:47.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:47.020 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:01:47.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:01:47.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:47.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:47.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:48.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:48.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:48.450 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:01:48.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:01:48.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:48.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:48.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:49.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:49.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:49.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:01:49.900 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:01:49.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:49.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:50.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:51.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:51.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:51.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:01:51.343 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:01:51.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:51.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:51.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:52.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:52.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:52.794 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:01:52.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:01:52.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:52.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:53.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:54.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:54.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:54.741 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:01:54.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:01:54.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:54.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:55.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:56.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:56.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:56.444 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:01:56.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:01:56.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:56.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:57.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:58.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:58.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:58.429 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:01:58.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:01:58.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:58.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:01:58.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:01:59.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:01:59.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:01:59.867 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:01:59.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:01:59.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:01:59.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:02:00.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:01.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:01.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:01.575 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:02:01.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:02:01.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:01.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:02:02.038 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/13699824,v1:127.0.0.1:6803/13699824] [v2:127.0.0.1:6804/13699824,v1:127.0.0.1:6805/13699824] exists,up a6d1677b-4882-46d2-87be-d9288f57e459 2024-09-16T04:02:02.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:02:02.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:02:02.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:02:02.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:02:02.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 1 2024-09-16T04:02:02.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:02:02.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:02:02.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T04:02:02.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:02:02.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/1 2024-09-16T04:02:02.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:02:02.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:02:02.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:02:02.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:02:02.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-09-16T04:02:02.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-09-16T04:02:02.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:02:02.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:02:02.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:02:02.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:02:02.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:02:02.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:02:02.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:02:02.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:02:02.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:02:02.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:02:02.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/1 2024-09-16T04:02:02.044 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:02:02.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=30b4e001-c663-4039-b338-d15ba747c284 2024-09-16T04:02:02.045 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 30b4e001-c663-4039-b338-d15ba747c284 2024-09-16T04:02:02.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 30b4e001-c663-4039-b338-d15ba747c284' 2024-09-16T04:02:02.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:02:02.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC6redmiNDMAxAAQqGTF1ZRbkUXnpbpUyrCYg== 2024-09-16T04:02:02.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC6redmiNDMAxAAQqGTF1ZRbkUXnpbpUyrCYg=="}' 2024-09-16T04:02:02.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 30b4e001-c663-4039-b338-d15ba747c284 -i td/osd-backfill-space/1/new.json 2024-09-16T04:02:02.621 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:02:02.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/1/new.json 2024-09-16T04:02:02.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC6redmiNDMAxAAQqGTF1ZRbkUXnpbpUyrCYg== --osd-uuid 30b4e001-c663-4039-b338-d15ba747c284 2024-09-16T04:02:02.670 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:02.668+0000 7fdda5040640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:02.690 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:02.689+0000 7fdda5040640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:02.691 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:02.690+0000 7fdda5040640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:02.692 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:02.690+0000 7fdda5040640 -1 bdev(0x55cb48fafc00 td/osd-backfill-space/1/block) open stat got: (1) Operation not permitted 2024-09-16T04:02:02.692 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:02.690+0000 7fdda5040640 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-09-16T04:02:08.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-09-16T04:02:08.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:02:08.653 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T04:02:08.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T04:02:08.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:02:09.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T04:02:09.222 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T04:02:09.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:02:09.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:02:09.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:02:09.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:02:09.256 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:09.255+0000 7fd1c3e1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:09.258 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:09.257+0000 7fd1c3e1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:09.259 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:09.258+0000 7fd1c3e1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:09.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T04:02:09.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:02:09.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:02:09.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:02:09.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:02:09.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:09.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:02:09.645 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:02:09.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:09.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:10.097 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:10.096+0000 7fd1c3e1e640 -1 Falling back to public interface 2024-09-16T04:02:10.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:11.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:11.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:11.128 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:02:11.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:02:11.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:11.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:11.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:12.524 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:12.522+0000 7fd1c3e1e640 -1 osd.1 0 log_to_monitors true 2024-09-16T04:02:12.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:12.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:12.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:02:12.688 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:02:12.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:12.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:13.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:14.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:14.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:14.312 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:02:14.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:02:14.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:14.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:14.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:15.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:15.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:15.774 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:02:15.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:02:15.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:15.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:16.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:17.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:17.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:17.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:02:17.200 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:02:17.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:17.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:17.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:18.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:18.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:18.806 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:02:18.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:02:18.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:18.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:19.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:20.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:20.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:20.260 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:02:20.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:02:20.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:20.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:20.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:21.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:21.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:21.758 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:02:21.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:02:21.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:21.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:22.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:23.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:23.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:23.234 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:02:23.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:02:23.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:23.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:23.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:24.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:24.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:24.856 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:02:24.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:02:24.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:24.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:26.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:27.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:27.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:27.146 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:02:27.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:02:27.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:27.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:28.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:29.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:29.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:29.097 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:02:29.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:02:29.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:29.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:30.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:31.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:31.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:31.194 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:02:31.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:02:31.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:31.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:31.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:32.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:32.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:32.963 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:02:32.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:02:32.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:32.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:34.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:35.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:35.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:35.317 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:02:35.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:02:35.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:35.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:02:35.770 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/309022594,v1:127.0.0.1:6811/309022594] [v2:127.0.0.1:6812/309022594,v1:127.0.0.1:6813/309022594] exists,up 30b4e001-c663-4039-b338-d15ba747c284 2024-09-16T04:02:35.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:02:35.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:02:35.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:02:35.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 2 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/2 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-09-16T04:02:35.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:02:35.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:02:35.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:02:35.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:02:35.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:02:35.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:02:35.776 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:02:35.776 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:02:35.776 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:02:35.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:02:35.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:02:35.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:02:35.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:02:35.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:02:35.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:02:35.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:02:35.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:02:35.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:02:35.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:02:35.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:02:35.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:02:35.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:02:35.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/2 2024-09-16T04:02:35.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:02:35.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f9a14243-a99e-4dc9-8fbe-4991cbf4cf07 2024-09-16T04:02:35.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 f9a14243-a99e-4dc9-8fbe-4991cbf4cf07' 2024-09-16T04:02:35.779 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 f9a14243-a99e-4dc9-8fbe-4991cbf4cf07 2024-09-16T04:02:35.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:02:35.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDbredmrS9wLxAAuOWBprYtPcHgjhqmRpt4JQ== 2024-09-16T04:02:35.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDbredmrS9wLxAAuOWBprYtPcHgjhqmRpt4JQ=="}' 2024-09-16T04:02:35.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f9a14243-a99e-4dc9-8fbe-4991cbf4cf07 -i td/osd-backfill-space/2/new.json 2024-09-16T04:02:36.337 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:02:36.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/2/new.json 2024-09-16T04:02:36.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDbredmrS9wLxAAuOWBprYtPcHgjhqmRpt4JQ== --osd-uuid f9a14243-a99e-4dc9-8fbe-4991cbf4cf07 2024-09-16T04:02:36.385 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:36.383+0000 7fe91f5b9640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:36.387 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:36.385+0000 7fe91f5b9640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:36.388 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:36.386+0000 7fe91f5b9640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:36.388 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:36.387+0000 7fe91f5b9640 -1 bdev(0x55ade476fc00 td/osd-backfill-space/2/block) open stat got: (1) Operation not permitted 2024-09-16T04:02:36.389 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:36.387+0000 7fe91f5b9640 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-09-16T04:02:42.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-09-16T04:02:42.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:02:42.337 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T04:02:42.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T04:02:42.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:02:42.903 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T04:02:42.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T04:02:42.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:02:42.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:02:42.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:02:42.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:02:42.938 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:42.935+0000 7f96c281d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:42.940 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:42.938+0000 7f96c281d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:42.942 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:42.939+0000 7f96c281d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:02:43.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T04:02:43.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:02:43.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:02:43.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:02:43.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:02:43.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:43.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:02:43.356 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:02:43.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:43.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:43.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:44.284 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:44.281+0000 7f96c281d640 -1 Falling back to public interface 2024-09-16T04:02:44.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:44.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:44.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:02:44.808 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:02:44.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:44.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:45.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:46.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:46.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:46.304 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:02:46.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:02:46.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:46.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:46.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:47.254 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:02:47.251+0000 7f96c281d640 -1 osd.2 0 log_to_monitors true 2024-09-16T04:02:47.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:47.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:47.661 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:02:47.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:02:47.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:47.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:48.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:49.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:49.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:49.097 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:02:49.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:02:49.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:49.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:49.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:50.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:50.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:50.607 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:02:50.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:02:50.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:50.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:51.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:52.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:52.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:52.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:02:52.123 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:02:52.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:52.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:52.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:53.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:53.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:53.556 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:02:53.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:02:53.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:53.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:54.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:55.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:55.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:55.086 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:02:55.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:02:55.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:55.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:55.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:56.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:56.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:56.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:02:56.614 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:02:56.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:56.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:57.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:58.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:58.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:58.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:02:58.120 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:02:58.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:58.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:02:58.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:02:59.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:02:59.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:02:59.553 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:02:59.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:02:59.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:02:59.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:03:00.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:01.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:01.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:01.072 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:03:01.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:03:01.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:01.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:03:01.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:02.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:02.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:02.911 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:03:02.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:03:02.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:02.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:03:03.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:04.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:04.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:04.672 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:03:04.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:03:04.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:04.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:03:05.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:06.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:06.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:06.342 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:03:06.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:03:06.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:06.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:03:06.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:07.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:07.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:07.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:03:07.824 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:03:07.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:07.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:03:08.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:09.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:09.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:09.473 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:03:09.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:03:09.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:09.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:03:10.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:11.364 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:03:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:03:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:03:11.805 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/186579735,v1:127.0.0.1:6819/186579735] [v2:127.0.0.1:6820/186579735,v1:127.0.0.1:6821/186579735] exists,up f9a14243-a99e-4dc9-8fbe-4991cbf4cf07 2024-09-16T04:03:11.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:03:11.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:03:11.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:03:11.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:03:11.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 3 2024-09-16T04:03:11.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:03:11.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:03:11.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T04:03:11.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:03:11.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/3 2024-09-16T04:03:11.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:03:11.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:03:11.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:03:11.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:03:11.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:03:11.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/3 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=19bc3996-2f0b-4229-b0a7-8841a8c4d243 2024-09-16T04:03:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 19bc3996-2f0b-4229-b0a7-8841a8c4d243' 2024-09-16T04:03:11.812 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 19bc3996-2f0b-4229-b0a7-8841a8c4d243 2024-09-16T04:03:11.812 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:03:11.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD/redmtSuAMRAA5Y8u09iWqL6RCuZUkUskBg== 2024-09-16T04:03:11.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD/redmtSuAMRAA5Y8u09iWqL6RCuZUkUskBg=="}' 2024-09-16T04:03:11.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 19bc3996-2f0b-4229-b0a7-8841a8c4d243 -i td/osd-backfill-space/3/new.json 2024-09-16T04:03:12.356 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:03:12.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/3/new.json 2024-09-16T04:03:12.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD/redmtSuAMRAA5Y8u09iWqL6RCuZUkUskBg== --osd-uuid 19bc3996-2f0b-4229-b0a7-8841a8c4d243 2024-09-16T04:03:12.405 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:12.403+0000 7f98e6c18640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:12.407 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:12.405+0000 7f98e6c18640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:12.408 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:12.406+0000 7f98e6c18640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:12.408 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:12.407+0000 7f98e6c18640 -1 bdev(0x561577d63c00 td/osd-backfill-space/3/block) open stat got: (1) Operation not permitted 2024-09-16T04:03:12.408 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:12.407+0000 7f98e6c18640 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2024-09-16T04:03:18.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2024-09-16T04:03:18.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:03:18.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T04:03:18.391 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T04:03:18.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:03:18.956 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T04:03:18.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T04:03:18.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:03:18.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:03:18.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:03:18.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:03:18.992 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:18.990+0000 7fa747b45640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:18.995 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:18.993+0000 7fa747b45640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:18.996 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:18.994+0000 7fa747b45640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:19.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T04:03:19.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:03:19.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T04:03:19.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:03:19.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:03:19.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:19.426 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:03:19.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:03:19.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:19.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:19.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:20.339 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:20.337+0000 7fa747b45640 -1 Falling back to public interface 2024-09-16T04:03:20.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:20.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:20.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:03:20.870 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:03:20.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:20.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:21.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:22.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:22.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:22.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:03:22.330 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:03:22.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:22.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:22.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:23.333 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:23.331+0000 7fa747b45640 -1 osd.3 0 log_to_monitors true 2024-09-16T04:03:23.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:23.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:23.793 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:03:23.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:03:23.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:23.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:24.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:25.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:25.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:25.239 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:03:25.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:03:25.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:25.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:25.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:26.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:26.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:26.772 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:03:26.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:03:26.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:26.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:27.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:28.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:28.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:28.244 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:03:28.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:03:28.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:28.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:28.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:29.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:29.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:29.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:03:29.693 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:03:29.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:29.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:30.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:31.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:31.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:31.265 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:03:31.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:03:31.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:31.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:31.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:32.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:32.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:32.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:03:32.807 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:03:32.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:32.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:33.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:34.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:34.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:34.334 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:03:34.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:03:34.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:34.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:34.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:35.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:35.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:35.801 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:03:35.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:03:35.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:35.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:36.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:37.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:37.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:37.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:03:37.498 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:03:37.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:37.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:38.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:39.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:39.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:39.346 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:03:39.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:03:39.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:39.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:40.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:41.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:41.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:41.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:03:41.375 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:03:41.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:41.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:42.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:43.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:43.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:43.144 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:03:43.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:03:43.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:43.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:44.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:45.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:45.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:45.090 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:03:45.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:03:45.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:45.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:45.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:46.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:46.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:46.792 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:03:46.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:03:46.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:46.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:03:47.246 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/649501065,v1:127.0.0.1:6827/649501065] [v2:127.0.0.1:6828/649501065,v1:127.0.0.1:6829/649501065] exists,up 19bc3996-2f0b-4229-b0a7-8841a8c4d243 2024-09-16T04:03:47.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:03:47.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 4 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/4 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:03:47.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:03:47.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/4 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:03:47.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0e46a116-adf5-4a20-a215-ffe22dd6150c 2024-09-16T04:03:47.254 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 0e46a116-adf5-4a20-a215-ffe22dd6150c 2024-09-16T04:03:47.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 0e46a116-adf5-4a20-a215-ffe22dd6150c' 2024-09-16T04:03:47.254 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:03:47.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAjrudmjtQ5EBAAcpDGtw3mo1LcSNfL/um3dQ== 2024-09-16T04:03:47.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAjrudmjtQ5EBAAcpDGtw3mo1LcSNfL/um3dQ=="}' 2024-09-16T04:03:47.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0e46a116-adf5-4a20-a215-ffe22dd6150c -i td/osd-backfill-space/4/new.json 2024-09-16T04:03:47.829 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:03:47.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/4/new.json 2024-09-16T04:03:47.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAjrudmjtQ5EBAAcpDGtw3mo1LcSNfL/um3dQ== --osd-uuid 0e46a116-adf5-4a20-a215-ffe22dd6150c 2024-09-16T04:03:47.878 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:47.877+0000 7f64ce40b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:47.880 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:47.878+0000 7f64ce40b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:47.881 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:47.880+0000 7f64ce40b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:47.882 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:47.880+0000 7f64ce40b640 -1 bdev(0x55aa24827c00 td/osd-backfill-space/4/block) open stat got: (1) Operation not permitted 2024-09-16T04:03:47.882 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:47.880+0000 7f64ce40b640 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2024-09-16T04:03:53.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2024-09-16T04:03:53.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:03:53.610 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T04:03:53.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T04:03:53.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:03:54.193 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T04:03:54.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T04:03:54.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:03:54.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:03:54.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:03:54.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:03:54.228 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:54.225+0000 7f6d5c929640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:54.230 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:54.227+0000 7f6d5c929640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:54.231 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:54.228+0000 7f6d5c929640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:03:54.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T04:03:54.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:03:54.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T04:03:54.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:03:54.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:03:54.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:54.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:03:54.650 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:03:54.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:54.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:03:55.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:55.584 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:55.581+0000 7f6d5c929640 -1 Falling back to public interface 2024-09-16T04:03:56.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:56.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:56.085 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:03:56.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:03:56.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:56.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:03:56.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:57.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:57.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:57.561 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:03:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:03:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:03:58.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:03:58.617 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:03:58.614+0000 7f6d5c929640 -1 osd.4 0 log_to_monitors true 2024-09-16T04:03:59.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:03:59.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:03:59.006 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:03:59.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:03:59.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:03:59.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:03:59.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:00.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:00.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:00.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:04:00.458 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:04:00.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:00.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:00.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:01.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:01.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:01.895 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:04:01.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:04:01.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:01.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:02.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:03.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:03.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:03.493 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:04:03.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:04:03.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:03.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:03.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:04.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:04.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:04.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:04:04.940 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:04:04.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:04.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:05.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:06.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:06.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:06.440 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:04:06.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:04:06.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:06.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:06.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:07.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:07.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:07.896 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:04:07.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:04:07.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:07.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:08.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:09.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:09.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:09.429 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:04:09.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:04:09.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:09.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:09.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:10.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:10.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:10.919 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:04:10.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:04:10.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:10.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:11.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:12.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:12.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:12.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:04:12.450 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:04:12.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:12.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:12.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:13.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:13.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:13.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:04:13.916 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:04:13.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:13.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:14.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:15.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:15.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:15.737 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:04:15.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:04:15.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:15.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:16.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:17.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:17.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:17.537 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:04:17.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:04:17.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:17.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:18.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:19.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:19.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:19.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:04:19.241 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:04:19.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:19.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:19.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:20.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:20.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:20.917 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:04:20.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:04:20.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:20.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:21.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:22.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:22.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:22.408 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:04:22.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:04:22.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:22.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:04:22.878 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1164136921,v1:127.0.0.1:6835/1164136921] [v2:127.0.0.1:6836/1164136921,v1:127.0.0.1:6837/1164136921] exists,up 0e46a116-adf5-4a20-a215-ffe22dd6150c 2024-09-16T04:04:22.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:04:22.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:04:22.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:04:22.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:04:22.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 5 2024-09-16T04:04:22.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:04:22.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:04:22.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T04:04:22.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:04:22.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/5 2024-09-16T04:04:22.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:04:22.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:04:22.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:04:22.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:04:22.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/5' 2024-09-16T04:04:22.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/5/journal' 2024-09-16T04:04:22.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:04:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:04:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:04:22.891 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:04:22.891 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:04:22.891 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:04:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:04:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:04:22.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:04:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:04:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:04:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:04:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:04:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:04:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:04:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:04:22.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:04:22.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:04:22.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:04:22.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:04:22.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:04:22.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/5 2024-09-16T04:04:22.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:04:22.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=41575b5f-cb2d-4a44-b8f7-1557666effa8 2024-09-16T04:04:22.895 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 41575b5f-cb2d-4a44-b8f7-1557666effa8 2024-09-16T04:04:22.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 41575b5f-cb2d-4a44-b8f7-1557666effa8' 2024-09-16T04:04:22.896 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:04:22.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBGrudmfSveNRAAhkTx2eyaTmgJCPQ0BRex+Q== 2024-09-16T04:04:22.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBGrudmfSveNRAAhkTx2eyaTmgJCPQ0BRex+Q=="}' 2024-09-16T04:04:22.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 41575b5f-cb2d-4a44-b8f7-1557666effa8 -i td/osd-backfill-space/5/new.json 2024-09-16T04:04:23.434 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:04:23.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/5/new.json 2024-09-16T04:04:23.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBGrudmfSveNRAAhkTx2eyaTmgJCPQ0BRex+Q== --osd-uuid 41575b5f-cb2d-4a44-b8f7-1557666effa8 2024-09-16T04:04:23.483 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:23.481+0000 7faa7c9a2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:23.484 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:23.483+0000 7faa7c9a2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:23.485 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:23.484+0000 7faa7c9a2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:23.486 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:23.484+0000 7faa7c9a2640 -1 bdev(0x562477907c00 td/osd-backfill-space/5/block) open stat got: (1) Operation not permitted 2024-09-16T04:04:23.486 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:23.484+0000 7faa7c9a2640 -1 bluestore(td/osd-backfill-space/5) _read_fsid unparsable uuid 2024-09-16T04:04:29.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/5/keyring 2024-09-16T04:04:29.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:04:29.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T04:04:29.182 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T04:04:29.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:04:29.758 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T04:04:29.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T04:04:29.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:04:29.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:04:29.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:04:29.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:04:29.793 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:29.791+0000 7fd56f945640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:29.795 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:29.793+0000 7fd56f945640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:29.796 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:29.794+0000 7fd56f945640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:30.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T04:04:30.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:04:30.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T04:04:30.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:04:30.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:04:30.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:30.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:04:30.206 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:04:30.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:30.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:30.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:31.426 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:31.424+0000 7fd56f945640 -1 Falling back to public interface 2024-09-16T04:04:31.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:31.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:31.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:04:31.666 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:04:31.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:31.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:32.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:33.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:33.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:33.125 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:04:33.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:04:33.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:33.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:33.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:34.179 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:34.178+0000 7fd56f945640 -1 osd.5 0 log_to_monitors true 2024-09-16T04:04:34.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:34.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:34.575 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:04:34.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:04:34.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:34.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:35.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:36.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:36.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:36.010 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:04:36.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:04:36.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:36.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:36.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:37.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:37.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:37.568 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:04:37.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:04:37.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:37.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:38.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:39.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:39.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:39.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:04:39.029 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:04:39.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:39.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:39.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:40.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:40.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:40.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:04:40.450 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:04:40.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:40.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:40.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:41.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:41.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:41.966 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:04:41.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:04:41.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:41.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:42.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:43.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:43.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:43.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:04:43.401 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:04:43.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:43.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:43.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:44.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:44.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:44.823 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:04:44.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:04:44.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:44.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:45.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:46.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:46.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:46.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:04:46.298 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:04:46.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:46.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:46.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:47.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:47.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:47.878 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:04:47.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:04:47.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:47.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:49.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:50.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:50.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:50.240 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:04:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:04:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:50.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:51.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:51.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:51.948 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:04:51.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:04:51.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:51.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:52.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:53.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:53.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:53.776 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:04:53.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:04:53.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:53.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:54.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:55.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:55.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:55.661 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:04:55.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:04:55.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:55.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:56.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:04:57.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:04:57.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:04:57.312 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:04:57.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:04:57.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:04:57.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:04:57.797 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/1008000708,v1:127.0.0.1:6843/1008000708] [v2:127.0.0.1:6844/1008000708,v1:127.0.0.1:6845/1008000708] exists,up 41575b5f-cb2d-4a44-b8f7-1557666effa8 2024-09-16T04:04:57.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:04:57.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:04:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:04:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:04:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 6 2024-09-16T04:04:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:04:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:04:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2024-09-16T04:04:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:04:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/6 2024-09-16T04:04:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:04:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:04:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:04:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/6' 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/6/journal' 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:04:57.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/6 2024-09-16T04:04:57.804 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:04:57.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=87ad2598-8852-4146-9c67-aebfcb326022 2024-09-16T04:04:57.805 INFO:tasks.workunit.client.0.smithi026.stdout:add osd6 87ad2598-8852-4146-9c67-aebfcb326022 2024-09-16T04:04:57.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 87ad2598-8852-4146-9c67-aebfcb326022' 2024-09-16T04:04:57.805 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:04:57.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBprudmjyoTMRAA4YuEOamNJz+FXPhOYDJ78Q== 2024-09-16T04:04:57.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBprudmjyoTMRAA4YuEOamNJz+FXPhOYDJ78Q=="}' 2024-09-16T04:04:57.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 87ad2598-8852-4146-9c67-aebfcb326022 -i td/osd-backfill-space/6/new.json 2024-09-16T04:04:58.389 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:04:58.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/6/new.json 2024-09-16T04:04:58.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/6 --osd-journal=td/osd-backfill-space/6/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBprudmjyoTMRAA4YuEOamNJz+FXPhOYDJ78Q== --osd-uuid 87ad2598-8852-4146-9c67-aebfcb326022 2024-09-16T04:04:58.439 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:58.436+0000 7fd6b8815640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:58.447 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:58.444+0000 7fd6b8815640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:58.448 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:58.445+0000 7fd6b8815640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:04:58.448 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:58.445+0000 7fd6b8815640 -1 bdev(0x55b85fa83c00 td/osd-backfill-space/6/block) open stat got: (1) Operation not permitted 2024-09-16T04:04:58.448 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:04:58.446+0000 7fd6b8815640 -1 bluestore(td/osd-backfill-space/6) _read_fsid unparsable uuid 2024-09-16T04:05:04.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/6/keyring 2024-09-16T04:05:04.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:05:04.530 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd6 key to auth repository 2024-09-16T04:05:04.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2024-09-16T04:05:04.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:05:05.106 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.6 2024-09-16T04:05:05.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2024-09-16T04:05:05.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/6 --osd-journal=td/osd-backfill-space/6/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:05:05.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:05:05.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:05:05.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:05:05.141 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:05.138+0000 7f893c902640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:05.143 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:05.141+0000 7f893c902640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:05.144 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:05.142+0000 7f893c902640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:05.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2024-09-16T04:05:05.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:05:05.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2024-09-16T04:05:05.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:05:05.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:05:05.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:05.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:05:05.598 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:05:05.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:05.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:06.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:06.265 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:06.263+0000 7f893c902640 -1 Falling back to public interface 2024-09-16T04:05:07.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:07.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:07.041 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:05:07.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:05:07.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:07.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:07.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:08.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:08.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:08.464 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:05:08.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:05:08.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:08.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:08.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:09.102 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:09.099+0000 7f893c902640 -1 osd.6 0 log_to_monitors true 2024-09-16T04:05:09.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:09.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:09.886 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:05:09.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:05:09.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:09.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:10.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:11.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:11.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:11.478 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:05:11.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:05:11.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:11.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:11.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:12.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:12.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:12.919 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:05:12.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:05:12.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:12.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:13.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:14.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:14.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:14.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:05:14.378 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:05:14.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:14.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:14.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:15.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:15.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:05:15.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:05:15.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:15.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:16.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:17.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:17.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:17.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:05:17.235 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:05:17.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:17.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:17.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:18.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:18.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:18.692 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:05:18.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:05:18.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:18.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:19.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:20.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:20.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:20.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:05:20.172 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:05:20.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:20.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:20.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:21.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:21.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:21.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:05:21.595 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:05:21.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:21.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:22.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:23.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:23.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:23.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:05:23.402 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:05:23.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:23.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:24.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:25.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:25.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:25.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:05:25.330 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:05:25.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:25.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:26.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:27.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:27.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:27.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:05:27.168 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:05:27.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:27.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:28.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:29.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:29.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:29.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:05:29.374 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:05:29.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:29.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:29.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:30.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:30.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:30.882 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:05:30.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:05:30.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:30.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:31.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:32.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:32.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:32.522 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:05:32.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:05:32.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:32.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:33.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:34.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:34.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:34.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:05:34.150 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:05:34.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:34.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2024-09-16T04:05:34.599 INFO:tasks.workunit.client.0.smithi026.stdout:osd.6 up in weight 1 up_from 35 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/472387471,v1:127.0.0.1:6851/472387471] [v2:127.0.0.1:6852/472387471,v1:127.0.0.1:6853/472387471] exists,up 87ad2598-8852-4146-9c67-aebfcb326022 2024-09-16T04:05:34.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:05:34.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:05:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:05:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:05:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 7 2024-09-16T04:05:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:05:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:05:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=7 2024-09-16T04:05:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:05:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/7 2024-09-16T04:05:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:05:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:05:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/7' 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/7/journal' 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:05:34.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/7 2024-09-16T04:05:34.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:05:34.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4559d40b-b04e-4bda-a81a-aa2e8b09490c 2024-09-16T04:05:34.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd7 4559d40b-b04e-4bda-a81a-aa2e8b09490c' 2024-09-16T04:05:34.607 INFO:tasks.workunit.client.0.smithi026.stdout:add osd7 4559d40b-b04e-4bda-a81a-aa2e8b09490c 2024-09-16T04:05:34.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:05:34.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCOrudmlBNOJRAAQe/940Bs4kvLW2kDnRZetQ== 2024-09-16T04:05:34.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCOrudmlBNOJRAAQe/940Bs4kvLW2kDnRZetQ=="}' 2024-09-16T04:05:34.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4559d40b-b04e-4bda-a81a-aa2e8b09490c -i td/osd-backfill-space/7/new.json 2024-09-16T04:05:35.161 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:05:35.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/7/new.json 2024-09-16T04:05:35.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 7 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/7 --osd-journal=td/osd-backfill-space/7/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCOrudmlBNOJRAAQe/940Bs4kvLW2kDnRZetQ== --osd-uuid 4559d40b-b04e-4bda-a81a-aa2e8b09490c 2024-09-16T04:05:35.210 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:35.208+0000 7f2a7ccb4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:35.212 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:35.210+0000 7f2a7ccb4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:35.212 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:35.211+0000 7f2a7ccb4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:35.213 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:35.211+0000 7f2a7ccb4640 -1 bdev(0x563633e03c00 td/osd-backfill-space/7/block) open stat got: (1) Operation not permitted 2024-09-16T04:05:35.213 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:35.211+0000 7f2a7ccb4640 -1 bluestore(td/osd-backfill-space/7) _read_fsid unparsable uuid 2024-09-16T04:05:41.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/7/keyring 2024-09-16T04:05:41.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:05:41.136 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd7 key to auth repository 2024-09-16T04:05:41.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd7 key to auth repository 2024-09-16T04:05:41.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:05:41.706 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.7 2024-09-16T04:05:41.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.7 2024-09-16T04:05:41.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 7 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/7 --osd-journal=td/osd-backfill-space/7/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:05:41.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:05:41.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:05:41.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:05:41.741 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:41.739+0000 7fe50e840640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:41.743 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:41.741+0000 7fe50e840640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:41.744 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:41.742+0000 7fe50e840640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:05:42.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 7 2024-09-16T04:05:42.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:05:42.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=7 2024-09-16T04:05:42.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:05:42.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:05:42.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:42.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:05:42.219 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:05:42.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:42.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:05:42.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:43.084 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:43.082+0000 7fe50e840640 -1 Falling back to public interface 2024-09-16T04:05:43.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:43.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:43.670 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:05:43.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:05:43.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:43.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:05:44.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:45.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:45.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:45.123 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:05:45.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:05:45.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:45.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:05:45.501 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:05:45.499+0000 7fe50e840640 -1 osd.7 0 log_to_monitors true 2024-09-16T04:05:45.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:46.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:46.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:46.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:05:46.553 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:05:46.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:46.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:05:46.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:48.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:48.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:48.000 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:05:48.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:05:48.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:48.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:05:48.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:49.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:49.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:49.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:05:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:05:49.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:49.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:05:49.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:50.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:50.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:50.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:05:50.908 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:05:50.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:50.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:05:51.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:52.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:52.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:52.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:05:52.425 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:05:52.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:52.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:05:52.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:53.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:53.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:53.883 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:05:53.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:05:53.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:53.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:05:54.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:55.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:55.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:55.341 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:05:55.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:05:55.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:55.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:05:55.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:56.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:56.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:56.847 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:05:56.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:05:56.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:56.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:05:57.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:58.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:58.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:58.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:05:58.329 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:05:58.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:58.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:05:58.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:05:59.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:05:59.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:05:59.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:05:59.923 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:05:59.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:05:59.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:06:00.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:01.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:01.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:01.739 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:06:01.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:06:01.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:01.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:06:02.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:03.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:03.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:03.345 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:06:03.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:06:03.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:03.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:06:03.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:04.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:04.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:04.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:06:04.965 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:06:04.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:04.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:06:05.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:06.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:06.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:06.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:06:06.498 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:06:06.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:06.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:06:07.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:08.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:08.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:08.488 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:06:08.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:06:08.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:08.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2024-09-16T04:06:09.017 INFO:tasks.workunit.client.0.smithi026.stdout:osd.7 up in weight 1 up_from 40 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/2166741082,v1:127.0.0.1:6859/2166741082] [v2:127.0.0.1:6860/2166741082,v1:127.0.0.1:6861/2166741082] exists,up 4559d40b-b04e-4bda-a81a-aa2e8b09490c 2024-09-16T04:06:09.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:06:09.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:06:09.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:06:09.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:06:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 8 2024-09-16T04:06:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:06:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:06:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=8 2024-09-16T04:06:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:06:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/8 2024-09-16T04:06:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:06:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:06:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:06:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:06:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/8' 2024-09-16T04:06:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/8/journal' 2024-09-16T04:06:09.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:06:09.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:06:09.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:06:09.023 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:06:09.023 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:06:09.023 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:06:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:06:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:06:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:06:09.024 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:06:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:06:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:06:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:06:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:06:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:06:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:06:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:06:09.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:06:09.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:06:09.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:06:09.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:06:09.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:06:09.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/8 2024-09-16T04:06:09.025 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:06:09.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ce979294-7ab7-4fd5-96c5-a54980e10a13 2024-09-16T04:06:09.026 INFO:tasks.workunit.client.0.smithi026.stdout:add osd8 ce979294-7ab7-4fd5-96c5-a54980e10a13 2024-09-16T04:06:09.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd8 ce979294-7ab7-4fd5-96c5-a54980e10a13' 2024-09-16T04:06:09.026 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:06:09.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCxrudmDcqPAhAAUtS4BO8BXMsahEmeTTihag== 2024-09-16T04:06:09.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCxrudmDcqPAhAAUtS4BO8BXMsahEmeTTihag=="}' 2024-09-16T04:06:09.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ce979294-7ab7-4fd5-96c5-a54980e10a13 -i td/osd-backfill-space/8/new.json 2024-09-16T04:06:09.648 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:06:09.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/8/new.json 2024-09-16T04:06:09.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 8 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/8 --osd-journal=td/osd-backfill-space/8/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCxrudmDcqPAhAAUtS4BO8BXMsahEmeTTihag== --osd-uuid ce979294-7ab7-4fd5-96c5-a54980e10a13 2024-09-16T04:06:09.696 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:09.694+0000 7f5dca0e6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:09.718 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:09.716+0000 7f5dca0e6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:09.720 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:09.717+0000 7f5dca0e6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:09.720 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:09.717+0000 7f5dca0e6640 -1 bdev(0x56197f14fc00 td/osd-backfill-space/8/block) open stat got: (1) Operation not permitted 2024-09-16T04:06:09.720 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:09.717+0000 7f5dca0e6640 -1 bluestore(td/osd-backfill-space/8) _read_fsid unparsable uuid 2024-09-16T04:06:15.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/8/keyring 2024-09-16T04:06:15.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:06:15.595 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd8 key to auth repository 2024-09-16T04:06:15.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd8 key to auth repository 2024-09-16T04:06:15.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:06:16.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.8 2024-09-16T04:06:16.171 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.8 2024-09-16T04:06:16.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 8 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/8 --osd-journal=td/osd-backfill-space/8/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:06:16.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:06:16.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:06:16.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:06:16.205 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:16.202+0000 7f1677bc3640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:16.207 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:16.204+0000 7f1677bc3640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:16.208 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:16.206+0000 7f1677bc3640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:16.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 8 2024-09-16T04:06:16.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:06:16.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=8 2024-09-16T04:06:16.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:06:16.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:06:16.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:16.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:06:16.595 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:06:16.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:16.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:17.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:17.580 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:17.578+0000 7f1677bc3640 -1 Falling back to public interface 2024-09-16T04:06:18.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:18.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:18.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:06:18.029 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:06:18.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:18.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:18.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:19.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:19.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:19.490 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:06:19.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:06:19.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:19.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:19.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:20.352 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:20.351+0000 7f1677bc3640 -1 osd.8 0 log_to_monitors true 2024-09-16T04:06:20.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:20.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:20.914 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:06:20.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:06:20.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:20.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:21.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:22.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:22.550 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:06:22.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:22.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:06:22.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:22.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:22.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:23.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:23.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:23.971 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:06:23.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:06:23.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:23.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:24.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:25.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:25.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:25.402 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:06:25.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:06:25.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:25.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:25.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:26.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:26.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:26.915 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:06:26.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:06:26.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:26.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:27.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:28.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:28.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:28.426 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:06:28.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:06:28.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:28.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:28.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:29.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:29.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:29.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:06:29.921 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:06:29.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:29.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:30.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:31.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:31.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:31.379 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:06:31.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:06:31.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:31.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:31.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:32.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:32.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:32.844 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:06:32.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:06:32.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:32.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:33.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:34.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:34.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:34.793 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:06:34.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:06:34.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:34.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:35.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:36.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:36.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:36.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:06:36.866 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:06:36.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:36.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:37.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:38.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:38.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:38.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:06:38.569 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:06:38.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:38.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:39.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:40.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:40.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:40.407 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:06:40.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:06:40.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:40.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:41.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:42.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:42.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:42.263 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:06:42.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:06:42.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:42.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:43.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:44.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:44.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:44.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:06:44.012 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:06:44.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:44.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2024-09-16T04:06:44.468 INFO:tasks.workunit.client.0.smithi026.stdout:osd.8 up in weight 1 up_from 45 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/735852477,v1:127.0.0.1:6867/735852477] [v2:127.0.0.1:6868/735852477,v1:127.0.0.1:6869/735852477] exists,up ce979294-7ab7-4fd5-96c5-a54980e10a13 2024-09-16T04:06:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:06:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:06:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:06:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:06:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 9 2024-09-16T04:06:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:06:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:06:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=9 2024-09-16T04:06:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:06:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/9 2024-09-16T04:06:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:06:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/9' 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/9/journal' 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:06:44.474 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:06:44.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:06:44.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:06:44.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:06:44.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:06:44.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:06:44.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:06:44.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:06:44.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:06:44.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:06:44.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:06:44.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:06:44.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:06:44.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:06:44.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/9 2024-09-16T04:06:44.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:06:44.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0f0bff93-07f0-411f-9174-d748a67f6e78 2024-09-16T04:06:44.476 INFO:tasks.workunit.client.0.smithi026.stdout:add osd9 0f0bff93-07f0-411f-9174-d748a67f6e78 2024-09-16T04:06:44.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd9 0f0bff93-07f0-411f-9174-d748a67f6e78' 2024-09-16T04:06:44.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:06:44.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDUrudmrEZ7HRAABy2zf26krQx89HYdOfRQlg== 2024-09-16T04:06:44.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDUrudmrEZ7HRAABy2zf26krQx89HYdOfRQlg=="}' 2024-09-16T04:06:44.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0f0bff93-07f0-411f-9174-d748a67f6e78 -i td/osd-backfill-space/9/new.json 2024-09-16T04:06:45.037 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:06:45.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/9/new.json 2024-09-16T04:06:45.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 9 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/9 --osd-journal=td/osd-backfill-space/9/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDUrudmrEZ7HRAABy2zf26krQx89HYdOfRQlg== --osd-uuid 0f0bff93-07f0-411f-9174-d748a67f6e78 2024-09-16T04:06:45.085 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:45.083+0000 7f27aa702640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:45.087 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:45.085+0000 7f27aa702640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:45.088 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:45.086+0000 7f27aa702640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:45.088 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:45.087+0000 7f27aa702640 -1 bdev(0x561de8f69c00 td/osd-backfill-space/9/block) open stat got: (1) Operation not permitted 2024-09-16T04:06:45.088 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:45.087+0000 7f27aa702640 -1 bluestore(td/osd-backfill-space/9) _read_fsid unparsable uuid 2024-09-16T04:06:51.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/9/keyring 2024-09-16T04:06:51.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:06:51.369 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd9 key to auth repository 2024-09-16T04:06:51.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd9 key to auth repository 2024-09-16T04:06:51.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/9/keyring auth add osd.9 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:06:51.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.9 2024-09-16T04:06:51.940 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.9 2024-09-16T04:06:51.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 9 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/9 --osd-journal=td/osd-backfill-space/9/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:06:51.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:06:51.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:06:51.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:06:51.974 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:51.973+0000 7f07e11db640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:52.009 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:52.007+0000 7f07e11db640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:52.010 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:52.008+0000 7f07e11db640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:06:52.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 9 2024-09-16T04:06:52.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:06:52.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2024-09-16T04:06:52.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:06:52.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:06:52.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:52.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:06:52.380 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:06:52.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:52.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:06:52.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:53.101 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:53.100+0000 7f07e11db640 -1 Falling back to public interface 2024-09-16T04:06:53.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:53.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:53.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:06:53.824 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:06:53.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:53.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:06:54.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:55.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:55.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:55.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:06:55.284 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:06:55.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:55.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:06:55.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:56.305 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:06:56.304+0000 7f07e11db640 -1 osd.9 0 log_to_monitors true 2024-09-16T04:06:56.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:56.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:56.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:06:56.745 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:06:56.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:56.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:06:57.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:58.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:58.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:58.301 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:06:58.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:06:58.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:58.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:06:58.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:06:59.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:06:59.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:06:59.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:06:59.754 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:06:59.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:06:59.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:00.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:01.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:01.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:01.280 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:07:01.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:07:01.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:01.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:01.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:02.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:02.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:02.793 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:07:02.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:07:02.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:02.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:03.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:04.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:04.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:04.305 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:07:04.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:07:04.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:04.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:04.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:05.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:05.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:05.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:07:05.744 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:07:05.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:05.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:06.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:07.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:07.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:07.225 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:07:07.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:07:07.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:07.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:07.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:08.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:08.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:08.669 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:07:08.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:07:08.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:08.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:09.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:10.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:10.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:10.095 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:07:10.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:07:10.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:10.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:10.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:11.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:11.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:11.549 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:07:11.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:07:11.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:11.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:12.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:13.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:13.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:13.204 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:07:13.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:07:13.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:13.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:14.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:15.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:15.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:15.031 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:07:15.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:07:15.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:15.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:15.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:16.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:16.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:16.845 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:07:16.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:07:16.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:16.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:17.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:18.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:18.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:18.289 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:07:18.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:07:18.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:18.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:19.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:20.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:20.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:20.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:07:20.179 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:07:20.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:20.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2024-09-16T04:07:20.694 INFO:tasks.workunit.client.0.smithi026.stdout:osd.9 up in weight 1 up_from 50 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6874/347112678,v1:127.0.0.1:6875/347112678] [v2:127.0.0.1:6876/347112678,v1:127.0.0.1:6877/347112678] exists,up 0f0bff93-07f0-411f-9174-d748a67f6e78 2024-09-16T04:07:20.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:07:20.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:07:20.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:07:20.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:07:20.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 10 2024-09-16T04:07:20.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:07:20.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:07:20.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=10 2024-09-16T04:07:20.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:07:20.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/10 2024-09-16T04:07:20.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:07:20.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:07:20.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:07:20.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:07:20.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/10' 2024-09-16T04:07:20.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/10/journal' 2024-09-16T04:07:20.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:07:20.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:07:20.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:07:20.700 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:07:20.700 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:07:20.700 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:07:20.700 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:07:20.700 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:20.701 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:07:20.701 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:07:20.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:07:20.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:07:20.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:07:20.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:07:20.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:07:20.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:07:20.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:07:20.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:07:20.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:07:20.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:07:20.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:07:20.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:07:20.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/10 2024-09-16T04:07:20.702 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:07:20.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=08da01f4-0b37-4423-ae51-8ec5221ebcd0 2024-09-16T04:07:20.703 INFO:tasks.workunit.client.0.smithi026.stdout:add osd10 08da01f4-0b37-4423-ae51-8ec5221ebcd0 2024-09-16T04:07:20.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd10 08da01f4-0b37-4423-ae51-8ec5221ebcd0' 2024-09-16T04:07:20.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:07:20.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD4rudmH9nnKhAAWN6XPMFUxKl5y405TrVbKw== 2024-09-16T04:07:20.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD4rudmH9nnKhAAWN6XPMFUxKl5y405TrVbKw=="}' 2024-09-16T04:07:20.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 08da01f4-0b37-4423-ae51-8ec5221ebcd0 -i td/osd-backfill-space/10/new.json 2024-09-16T04:07:21.205 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:07:21.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/10/new.json 2024-09-16T04:07:21.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 10 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/10 --osd-journal=td/osd-backfill-space/10/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD4rudmH9nnKhAAWN6XPMFUxKl5y405TrVbKw== --osd-uuid 08da01f4-0b37-4423-ae51-8ec5221ebcd0 2024-09-16T04:07:21.253 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:21.251+0000 7f9c3ca16640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:21.279 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:21.276+0000 7f9c3ca16640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:21.280 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:21.277+0000 7f9c3ca16640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:21.280 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:21.278+0000 7f9c3ca16640 -1 bdev(0x55c543cb3c00 td/osd-backfill-space/10/block) open stat got: (1) Operation not permitted 2024-09-16T04:07:21.280 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:21.278+0000 7f9c3ca16640 -1 bluestore(td/osd-backfill-space/10) _read_fsid unparsable uuid 2024-09-16T04:07:27.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/10/keyring 2024-09-16T04:07:27.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:07:27.475 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd10 key to auth repository 2024-09-16T04:07:27.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd10 key to auth repository 2024-09-16T04:07:27.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/10/keyring auth add osd.10 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:07:28.052 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.10 2024-09-16T04:07:28.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.10 2024-09-16T04:07:28.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 10 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/10 --osd-journal=td/osd-backfill-space/10/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:07:28.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:07:28.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:07:28.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:07:28.087 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:28.085+0000 7efe79558640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:28.089 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:28.087+0000 7efe79558640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:28.090 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:28.088+0000 7efe79558640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:28.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 10 2024-09-16T04:07:28.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:07:28.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=10 2024-09-16T04:07:28.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:07:28.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:07:28.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:28.484 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:07:28.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:07:28.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:28.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:28.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:28.957 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:28.956+0000 7efe79558640 -1 Falling back to public interface 2024-09-16T04:07:29.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:29.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:29.936 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:07:29.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:07:29.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:29.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:30.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:31.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:31.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:31.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:07:31.396 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:07:31.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:31.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:31.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:32.276 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:32.274+0000 7efe79558640 -1 osd.10 0 log_to_monitors true 2024-09-16T04:07:32.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:32.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:32.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:07:32.824 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:07:32.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:32.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:33.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:34.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:34.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:34.381 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:07:34.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:07:34.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:34.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:34.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:35.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:35.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:35.832 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:07:35.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:07:35.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:35.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:36.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:37.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:37.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:37.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:07:37.282 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:07:37.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:37.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:37.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:38.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:38.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:38.808 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:07:38.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:07:38.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:38.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:39.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:40.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:40.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:40.347 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:07:40.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:07:40.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:40.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:40.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:41.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:41.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:41.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:07:41.781 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:07:41.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:41.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:42.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:43.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:43.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:43.202 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:07:43.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:07:43.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:43.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:43.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:44.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:44.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:44.765 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:07:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:07:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:45.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:46.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:46.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:46.210 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:07:46.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:07:46.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:46.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:47.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:48.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:48.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:48.444 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:07:48.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:07:48.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:48.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:49.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:50.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:50.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:50.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:07:50.013 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:07:50.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:50.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:50.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:51.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:51.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:51.944 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:07:51.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:07:51.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:51.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:53.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:54.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:54.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:54.225 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:07:54.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:07:54.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:54.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:54.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:07:55.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:07:55.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:07:55.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:07:55.960 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:07:55.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:07:55.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.10 up' 2024-09-16T04:07:56.408 INFO:tasks.workunit.client.0.smithi026.stdout:osd.10 up in weight 1 up_from 55 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6882/156638619,v1:127.0.0.1:6883/156638619] [v2:127.0.0.1:6884/156638619,v1:127.0.0.1:6885/156638619] exists,up 08da01f4-0b37-4423-ae51-8ec5221ebcd0 2024-09-16T04:07:56.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:07:56.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:07:56.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:07:56.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:07:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 11 2024-09-16T04:07:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:07:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:07:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=11 2024-09-16T04:07:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:07:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/11 2024-09-16T04:07:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:07:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:07:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:07:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:07:56.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/11' 2024-09-16T04:07:56.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/11/journal' 2024-09-16T04:07:56.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:07:56.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:07:56.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:07:56.414 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:07:56.414 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:07:56.414 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:07:56.414 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:07:56.414 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:07:56.414 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:07:56.414 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/11 2024-09-16T04:07:56.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:07:56.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f84ef8ef-c986-4db2-a3f2-e70817cfde57 2024-09-16T04:07:56.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd11 f84ef8ef-c986-4db2-a3f2-e70817cfde57' 2024-09-16T04:07:56.416 INFO:tasks.workunit.client.0.smithi026.stdout:add osd11 f84ef8ef-c986-4db2-a3f2-e70817cfde57 2024-09-16T04:07:56.416 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:07:56.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAcr+dmNXrbGRAAo/CnY0xnpPhGc7tmeo9HqA== 2024-09-16T04:07:56.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAcr+dmNXrbGRAAo/CnY0xnpPhGc7tmeo9HqA=="}' 2024-09-16T04:07:56.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f84ef8ef-c986-4db2-a3f2-e70817cfde57 -i td/osd-backfill-space/11/new.json 2024-09-16T04:07:57.161 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:07:57.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/11/new.json 2024-09-16T04:07:57.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 11 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/11 --osd-journal=td/osd-backfill-space/11/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAcr+dmNXrbGRAAo/CnY0xnpPhGc7tmeo9HqA== --osd-uuid f84ef8ef-c986-4db2-a3f2-e70817cfde57 2024-09-16T04:07:57.211 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:57.209+0000 7f8313613640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:57.277 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:57.275+0000 7f8313613640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:57.278 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:57.277+0000 7f8313613640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:07:57.279 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:57.277+0000 7f8313613640 -1 bdev(0x55756e699c00 td/osd-backfill-space/11/block) open stat got: (1) Operation not permitted 2024-09-16T04:07:57.279 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:07:57.277+0000 7f8313613640 -1 bluestore(td/osd-backfill-space/11) _read_fsid unparsable uuid 2024-09-16T04:08:03.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/11/keyring 2024-09-16T04:08:03.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:08:03.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd11 key to auth repository 2024-09-16T04:08:03.183 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd11 key to auth repository 2024-09-16T04:08:03.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/11/keyring auth add osd.11 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:08:03.758 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.11 2024-09-16T04:08:03.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.11 2024-09-16T04:08:03.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 11 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/11 --osd-journal=td/osd-backfill-space/11/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:08:03.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:08:03.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:08:03.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:08:03.793 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:03.791+0000 7fd990a60640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:03.795 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:03.794+0000 7fd990a60640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:03.796 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:03.795+0000 7fd990a60640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:04.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 11 2024-09-16T04:08:04.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:08:04.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=11 2024-09-16T04:08:04.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:08:04.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:08:04.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:04.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:08:04.200 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:08:04.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:04.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:04.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:05.395 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:05.393+0000 7fd990a60640 -1 Falling back to public interface 2024-09-16T04:08:05.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:05.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:05.613 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:08:05.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:08:05.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:05.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:06.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:07.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:07.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:07.045 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:08:07.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:08:07.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:07.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:07.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:08.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:08.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:08.530 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:08:08.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:08:08.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:08.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:08.609 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:08.607+0000 7fd990a60640 -1 osd.11 0 log_to_monitors true 2024-09-16T04:08:08.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:09.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:09.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:09.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:08:09.957 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:08:09.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:09.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:10.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:11.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:11.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:11.555 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:08:11.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:08:11.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:11.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:11.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:12.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:12.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:12.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:08:12.996 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:08:12.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:12.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:13.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:14.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:14.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:14.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:08:14.553 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:08:14.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:14.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:14.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:15.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:15.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:15.996 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:08:15.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:08:15.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:15.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:16.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:17.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:17.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:17.532 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:08:17.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:08:17.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:17.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:18.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:19.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:19.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:19.002 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:08:19.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:08:19.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:19.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:19.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:20.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:20.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:20.548 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:08:20.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:08:20.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:20.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:21.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:22.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:22.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:22.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:08:22.147 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:08:22.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:22.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:23.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:24.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:24.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:24.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:08:24.438 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:08:24.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:24.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:25.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:26.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:26.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:26.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:08:26.340 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:08:26.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:26.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:27.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:28.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:28.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:28.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:08:28.066 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:08:28.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:28.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:28.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:29.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:29.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:29.806 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:08:29.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:08:29.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:29.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:30.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:31.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:31.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:31.656 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:08:31.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:08:31.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:31.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:32.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:33.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:33.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:33.267 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:08:33.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:08:33.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:33.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.11 up' 2024-09-16T04:08:33.738 INFO:tasks.workunit.client.0.smithi026.stdout:osd.11 up in weight 1 up_from 60 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6890/1269279511,v1:127.0.0.1:6891/1269279511] [v2:127.0.0.1:6892/1269279511,v1:127.0.0.1:6893/1269279511] exists,up f84ef8ef-c986-4db2-a3f2-e70817cfde57 2024-09-16T04:08:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:08:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:08:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:08:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:08:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 12 2024-09-16T04:08:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:08:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:08:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=12 2024-09-16T04:08:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:08:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/12 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/12' 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/12/journal' 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:08:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:08:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:08:33.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:08:33.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/12 2024-09-16T04:08:33.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:08:33.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d3d297e8-aa5c-4bc7-a46b-a74c0b1b218b 2024-09-16T04:08:33.746 INFO:tasks.workunit.client.0.smithi026.stdout:add osd12 d3d297e8-aa5c-4bc7-a46b-a74c0b1b218b 2024-09-16T04:08:33.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd12 d3d297e8-aa5c-4bc7-a46b-a74c0b1b218b' 2024-09-16T04:08:33.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:08:33.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBBr+dmTi2PLRAAtJBV1yAKvZQQ/XANsWnKwQ== 2024-09-16T04:08:33.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBBr+dmTi2PLRAAtJBV1yAKvZQQ/XANsWnKwQ=="}' 2024-09-16T04:08:33.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d3d297e8-aa5c-4bc7-a46b-a74c0b1b218b -i td/osd-backfill-space/12/new.json 2024-09-16T04:08:34.264 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:08:34.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/12/new.json 2024-09-16T04:08:34.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 12 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/12 --osd-journal=td/osd-backfill-space/12/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBBr+dmTi2PLRAAtJBV1yAKvZQQ/XANsWnKwQ== --osd-uuid d3d297e8-aa5c-4bc7-a46b-a74c0b1b218b 2024-09-16T04:08:34.313 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:34.311+0000 7f858de0e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:34.315 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:34.313+0000 7f858de0e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:34.316 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:34.314+0000 7f858de0e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:34.316 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:34.315+0000 7f858de0e640 -1 bdev(0x557982739c00 td/osd-backfill-space/12/block) open stat got: (1) Operation not permitted 2024-09-16T04:08:34.317 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:34.315+0000 7f858de0e640 -1 bluestore(td/osd-backfill-space/12) _read_fsid unparsable uuid 2024-09-16T04:08:41.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/12/keyring 2024-09-16T04:08:41.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:08:41.033 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd12 key to auth repository 2024-09-16T04:08:41.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd12 key to auth repository 2024-09-16T04:08:41.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/12/keyring auth add osd.12 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:08:41.642 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.12 2024-09-16T04:08:41.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.12 2024-09-16T04:08:41.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 12 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/12 --osd-journal=td/osd-backfill-space/12/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:08:41.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:08:41.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:08:41.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:08:41.677 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:41.675+0000 7fe276cd6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:41.691 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:41.690+0000 7fe276cd6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:41.692 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:41.691+0000 7fe276cd6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:08:42.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 12 2024-09-16T04:08:42.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:08:42.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=12 2024-09-16T04:08:42.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:08:42.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:08:42.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:42.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:08:42.089 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:08:42.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:42.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:08:42.547 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:42.546+0000 7fe276cd6640 -1 Falling back to public interface 2024-09-16T04:08:42.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:43.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:43.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:43.556 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:08:43.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:08:43.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:43.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:08:44.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:45.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:45.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:45.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:08:45.010 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:08:45.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:45.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:08:45.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:45.520 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:08:45.518+0000 7fe276cd6640 -1 osd.12 0 log_to_monitors true 2024-09-16T04:08:46.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:46.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:46.432 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:08:46.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:08:46.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:46.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:08:46.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:47.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:47.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:47.922 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:08:47.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:08:47.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:47.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:08:48.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:49.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:49.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:49.490 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:08:49.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:08:49.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:49.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:08:50.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:51.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:51.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:51.075 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:08:51.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:08:51.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:51.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:08:51.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:52.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:52.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:52.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:08:52.506 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:08:52.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:52.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:08:53.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:54.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:54.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:54.089 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:08:54.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:08:54.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:54.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:08:54.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:55.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:55.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:55.538 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:08:55.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:08:55.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:55.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:08:56.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:57.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:57.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:57.122 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:08:57.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:08:57.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:57.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:08:57.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:58.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:58.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:58.546 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:08:58.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:08:58.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:58.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:08:58.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:08:59.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:08:59.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:08:59.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:08:59.987 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:08:59.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:08:59.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:09:01.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:02.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:02.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:02.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:09:02.172 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:09:02.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:02.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:09:02.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:03.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:03.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:03.867 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:09:03.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:09:03.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:03.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:09:04.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:05.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:05.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:05.619 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:09:05.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:09:05.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:05.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:09:06.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:07.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:07.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:07.339 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:09:07.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:09:07.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:07.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:09:08.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:09.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:09.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:09.438 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:09:09.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:09:09.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:09.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.12 up' 2024-09-16T04:09:09.923 INFO:tasks.workunit.client.0.smithi026.stdout:osd.12 up in weight 1 up_from 65 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6898/562054760,v1:127.0.0.1:6899/562054760] [v2:127.0.0.1:6900/562054760,v1:127.0.0.1:6901/562054760] exists,up d3d297e8-aa5c-4bc7-a46b-a74c0b1b218b 2024-09-16T04:09:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:09:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:09:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:09:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:09:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 13 2024-09-16T04:09:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:09:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:09:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=13 2024-09-16T04:09:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:09:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/13 2024-09-16T04:09:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/13' 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/13/journal' 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:09:09.928 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:09:09.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:09:09.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/13 2024-09-16T04:09:09.930 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:09:09.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=75b2920c-e559-4550-a71b-aba73cf084d1 2024-09-16T04:09:09.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd13 75b2920c-e559-4550-a71b-aba73cf084d1' 2024-09-16T04:09:09.930 INFO:tasks.workunit.client.0.smithi026.stdout:add osd13 75b2920c-e559-4550-a71b-aba73cf084d1 2024-09-16T04:09:09.930 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:09:09.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBlr+dmEImKOBAALFMKgchEBitcjdtg6S2oFA== 2024-09-16T04:09:09.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBlr+dmEImKOBAALFMKgchEBitcjdtg6S2oFA=="}' 2024-09-16T04:09:09.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 75b2920c-e559-4550-a71b-aba73cf084d1 -i td/osd-backfill-space/13/new.json 2024-09-16T04:09:10.447 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:09:10.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/13/new.json 2024-09-16T04:09:10.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 13 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/13 --osd-journal=td/osd-backfill-space/13/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBlr+dmEImKOBAALFMKgchEBitcjdtg6S2oFA== --osd-uuid 75b2920c-e559-4550-a71b-aba73cf084d1 2024-09-16T04:09:10.496 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:10.494+0000 7f9f4a0b4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:10.567 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:10.565+0000 7f9f4a0b4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:10.568 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:10.566+0000 7f9f4a0b4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:10.568 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:10.567+0000 7f9f4a0b4640 -1 bdev(0x55c5aa37dc00 td/osd-backfill-space/13/block) open stat got: (1) Operation not permitted 2024-09-16T04:09:10.569 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:10.567+0000 7f9f4a0b4640 -1 bluestore(td/osd-backfill-space/13) _read_fsid unparsable uuid 2024-09-16T04:09:17.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/13/keyring 2024-09-16T04:09:17.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:09:17.285 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd13 key to auth repository 2024-09-16T04:09:17.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd13 key to auth repository 2024-09-16T04:09:17.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/13/keyring auth add osd.13 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:09:17.894 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.13 2024-09-16T04:09:17.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.13 2024-09-16T04:09:17.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 13 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/13 --osd-journal=td/osd-backfill-space/13/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:09:17.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:09:17.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:09:17.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:09:17.929 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:17.927+0000 7fc76e81e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:17.961 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:17.959+0000 7fc76e81e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:17.961 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:17.960+0000 7fc76e81e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:18.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 13 2024-09-16T04:09:18.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:09:18.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=13 2024-09-16T04:09:18.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:09:18.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:09:18.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:18.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:09:18.376 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:09:18.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:18.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:18.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:19.329 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:19.327+0000 7fc76e81e640 -1 Falling back to public interface 2024-09-16T04:09:19.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:19.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:19.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:09:19.794 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:09:19.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:19.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:20.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:21.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:21.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:21.247 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:09:21.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:09:21.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:21.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:21.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:22.035 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:22.033+0000 7fc76e81e640 -1 osd.13 0 log_to_monitors true 2024-09-16T04:09:22.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:22.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:22.819 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:09:22.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:09:22.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:22.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:23.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:24.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:24.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:24.317 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:09:24.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:09:24.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:24.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:25.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:25.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:25.747 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:09:25.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:09:25.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:25.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:26.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:27.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:27.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:27.171 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:09:27.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:09:27.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:27.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:27.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:28.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:28.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:28.679 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:09:28.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:09:28.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:28.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:29.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:30.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:30.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:30.245 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:09:30.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:09:30.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:30.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:30.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:31.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:31.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:31.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:09:31.795 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:09:31.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:31.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:32.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:33.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:33.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:33.313 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:09:33.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:09:33.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:33.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:33.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:34.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:34.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:34.816 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:09:34.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:09:34.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:34.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:35.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:36.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:36.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:36.462 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:09:36.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:09:36.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:36.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:37.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:38.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:38.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:38.254 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:09:38.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:09:38.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:38.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:38.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:39.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:39.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:39.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:09:39.927 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:09:39.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:39.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:40.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:41.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:41.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:41.625 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:09:41.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:09:41.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:41.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:42.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:43.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:43.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:43.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:09:43.287 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:09:43.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:43.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:43.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:44.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:44.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:44.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:09:44.887 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:09:44.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:44.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:45.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:46.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:46.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:46.686 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:09:46.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:09:46.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:46.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.13 up' 2024-09-16T04:09:47.136 INFO:tasks.workunit.client.0.smithi026.stdout:osd.13 up in weight 1 up_from 70 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6906/296355386,v1:127.0.0.1:6907/296355386] [v2:127.0.0.1:6908/296355386,v1:127.0.0.1:6909/296355386] exists,up 75b2920c-e559-4550-a71b-aba73cf084d1 2024-09-16T04:09:47.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:09:47.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:09:47.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:09:47.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:09:47.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 14 2024-09-16T04:09:47.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:09:47.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:09:47.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=14 2024-09-16T04:09:47.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:09:47.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/14 2024-09-16T04:09:47.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:09:47.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:09:47.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:09:47.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:09:47.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/14' 2024-09-16T04:09:47.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/14/journal' 2024-09-16T04:09:47.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:09:47.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:09:47.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:09:47.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:09:47.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:09:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:09:47.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:09:47.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:09:47.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:09:47.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/14 2024-09-16T04:09:47.145 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:09:47.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=98ac0f36-9108-4f9e-bb18-a16673cf197f 2024-09-16T04:09:47.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd14 98ac0f36-9108-4f9e-bb18-a16673cf197f' 2024-09-16T04:09:47.146 INFO:tasks.workunit.client.0.smithi026.stdout:add osd14 98ac0f36-9108-4f9e-bb18-a16673cf197f 2024-09-16T04:09:47.146 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:09:47.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCLr+dmYTqsCRAAMp2xNFcQPBu2Wu5hsUoWYQ== 2024-09-16T04:09:47.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCLr+dmYTqsCRAAMp2xNFcQPBu2Wu5hsUoWYQ=="}' 2024-09-16T04:09:47.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 98ac0f36-9108-4f9e-bb18-a16673cf197f -i td/osd-backfill-space/14/new.json 2024-09-16T04:09:47.634 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:09:47.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/14/new.json 2024-09-16T04:09:47.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 14 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/14 --osd-journal=td/osd-backfill-space/14/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCLr+dmYTqsCRAAMp2xNFcQPBu2Wu5hsUoWYQ== --osd-uuid 98ac0f36-9108-4f9e-bb18-a16673cf197f 2024-09-16T04:09:47.683 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:47.681+0000 7efdbefbf640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:47.687 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:47.686+0000 7efdbefbf640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:47.688 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:47.687+0000 7efdbefbf640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:47.689 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:47.687+0000 7efdbefbf640 -1 bdev(0x55ec68ba7c00 td/osd-backfill-space/14/block) open stat got: (1) Operation not permitted 2024-09-16T04:09:47.689 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:47.687+0000 7efdbefbf640 -1 bluestore(td/osd-backfill-space/14) _read_fsid unparsable uuid 2024-09-16T04:09:53.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/14/keyring 2024-09-16T04:09:53.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:09:53.853 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd14 key to auth repository 2024-09-16T04:09:53.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd14 key to auth repository 2024-09-16T04:09:53.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/14/keyring auth add osd.14 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:09:54.427 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.14 2024-09-16T04:09:54.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.14 2024-09-16T04:09:54.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 14 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/14 --osd-journal=td/osd-backfill-space/14/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:09:54.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:09:54.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:09:54.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:09:54.462 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:54.460+0000 7f191d620640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:54.464 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:54.462+0000 7f191d620640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:54.465 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:54.464+0000 7f191d620640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:09:54.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 14 2024-09-16T04:09:54.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:09:54.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=14 2024-09-16T04:09:54.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:09:54.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:09:54.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:54.927 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:09:54.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:09:54.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:54.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:09:55.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:55.815 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:55.813+0000 7f191d620640 -1 Falling back to public interface 2024-09-16T04:09:56.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:56.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:56.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:09:56.372 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:09:56.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:56.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:09:56.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:57.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:57.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:57.799 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:09:57.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:09:57.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:57.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:09:58.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:09:58.302 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:09:58.300+0000 7f191d620640 -1 osd.14 0 log_to_monitors true 2024-09-16T04:09:59.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:09:59.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:09:59.217 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:09:59.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:09:59.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:09:59.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:09:59.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:00.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:00.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:00.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:10:00.705 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:10:00.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:00.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:01.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:02.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:02.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:02.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:10:02.189 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:10:02.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:02.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:02.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:03.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:03.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:03.627 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:10:03.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:10:03.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:03.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:04.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:05.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:05.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:05.057 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:10:05.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:10:05.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:05.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:05.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:06.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:06.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:06.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:10:06.679 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:10:06.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:06.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:07.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:08.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:08.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:08.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:10:08.218 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:10:08.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:08.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:08.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:09.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:09.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:09.642 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:10:09.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:10:09.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:09.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:10.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:11.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:11.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:11.066 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:10:11.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:10:11.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:11.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:11.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:12.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:12.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:12.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:10:12.921 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:10:12.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:12.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:13.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:14.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:14.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:14.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:10:14.812 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:10:14.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:14.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:15.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:16.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:16.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:16.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:10:16.899 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:10:16.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:16.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:17.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:18.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:18.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:18.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:10:18.519 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:10:18.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:18.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:19.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:20.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:20.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:20.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:10:20.383 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:10:20.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:20.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:20.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:21.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:21.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:21.860 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:10:21.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:10:21.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:21.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.14 up' 2024-09-16T04:10:22.304 INFO:tasks.workunit.client.0.smithi026.stdout:osd.14 up in weight 1 up_from 75 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6914/2937263631,v1:127.0.0.1:6915/2937263631] [v2:127.0.0.1:6916/2937263631,v1:127.0.0.1:6917/2937263631] exists,up 98ac0f36-9108-4f9e-bb18-a16673cf197f 2024-09-16T04:10:22.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 15 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=15 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/15 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:10:22.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:10:22.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/15' 2024-09-16T04:10:22.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/15/journal' 2024-09-16T04:10:22.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:10:22.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:10:22.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:10:22.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:10:22.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:10:22.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:10:22.309 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:10:22.309 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:10:22.309 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:10:22.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:10:22.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:10:22.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:10:22.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:10:22.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:10:22.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:10:22.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:10:22.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:10:22.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:10:22.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:10:22.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:10:22.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:10:22.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:10:22.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/15 2024-09-16T04:10:22.311 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:10:22.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f330a52d-da2e-4c35-8067-c36a02f923aa 2024-09-16T04:10:22.311 INFO:tasks.workunit.client.0.smithi026.stdout:add osd15 f330a52d-da2e-4c35-8067-c36a02f923aa 2024-09-16T04:10:22.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd15 f330a52d-da2e-4c35-8067-c36a02f923aa' 2024-09-16T04:10:22.312 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:10:22.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCur+dmPf6rExAACRTjChNRskWCMjlr2Pt4dA== 2024-09-16T04:10:22.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCur+dmPf6rExAACRTjChNRskWCMjlr2Pt4dA=="}' 2024-09-16T04:10:22.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f330a52d-da2e-4c35-8067-c36a02f923aa -i td/osd-backfill-space/15/new.json 2024-09-16T04:10:22.957 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:10:22.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/15/new.json 2024-09-16T04:10:22.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 15 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/15 --osd-journal=td/osd-backfill-space/15/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCur+dmPf6rExAACRTjChNRskWCMjlr2Pt4dA== --osd-uuid f330a52d-da2e-4c35-8067-c36a02f923aa 2024-09-16T04:10:23.005 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:23.003+0000 7f655b41a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:23.006 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:23.005+0000 7f655b41a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:23.008 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:23.006+0000 7f655b41a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:23.008 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:23.006+0000 7f655b41a640 -1 bdev(0x556d502a5c00 td/osd-backfill-space/15/block) open stat got: (1) Operation not permitted 2024-09-16T04:10:23.008 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:23.006+0000 7f655b41a640 -1 bluestore(td/osd-backfill-space/15) _read_fsid unparsable uuid 2024-09-16T04:10:29.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/15/keyring 2024-09-16T04:10:29.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:10:29.669 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd15 key to auth repository 2024-09-16T04:10:29.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd15 key to auth repository 2024-09-16T04:10:29.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/15/keyring auth add osd.15 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:10:30.245 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.15 2024-09-16T04:10:30.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.15 2024-09-16T04:10:30.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 15 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/15 --osd-journal=td/osd-backfill-space/15/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:10:30.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:10:30.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:10:30.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:10:30.280 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:30.278+0000 7f30a1520640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:30.282 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:30.280+0000 7f30a1520640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:30.283 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:30.281+0000 7f30a1520640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:30.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 15 2024-09-16T04:10:30.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:10:30.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=15 2024-09-16T04:10:30.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:10:30.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:10:30.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:30.717 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:10:30.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:10:30.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:30.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:31.130 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:31.129+0000 7f30a1520640 -1 Falling back to public interface 2024-09-16T04:10:31.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:32.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:32.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:32.186 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:10:32.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:10:32.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:32.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:32.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:33.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:33.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:33.619 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:10:33.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:10:33.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:33.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:33.875 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:33.872+0000 7f30a1520640 -1 osd.15 0 log_to_monitors true 2024-09-16T04:10:34.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:35.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:35.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:35.076 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:10:35.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:10:35.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:35.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:35.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:36.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:36.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:36.499 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:10:36.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:10:36.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:36.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:37.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:38.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:38.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:38.099 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:10:38.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:10:38.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:38.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:38.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:39.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:39.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:39.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:10:39.522 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:10:39.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:39.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:40.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:41.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:41.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:41.127 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:10:41.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:10:41.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:41.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:41.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:42.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:42.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:42.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:10:42.667 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:10:42.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:42.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:43.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:44.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:44.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:44.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:10:44.143 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:10:44.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:44.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:44.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:45.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:45.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:45.575 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:10:45.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:10:45.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:45.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:46.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:47.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:47.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:47.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:10:47.130 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:10:47.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:47.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:47.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:48.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:48.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:48.953 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:10:48.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:10:48.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:48.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:50.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:51.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:51.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:51.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:10:51.074 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:10:51.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:51.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:51.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:52.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:52.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:52.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:10:52.927 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:10:52.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:52.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:53.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:54.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:54.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:54.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:10:54.690 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:10:54.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:54.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:55.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:56.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:56.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:56.647 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:10:56.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:10:56.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:56.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:57.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:10:58.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:10:58.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:10:58.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:10:58.248 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:10:58.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:10:58.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.15 up' 2024-09-16T04:10:58.712 INFO:tasks.workunit.client.0.smithi026.stdout:osd.15 up in weight 1 up_from 80 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6922/1858650673,v1:127.0.0.1:6923/1858650673] [v2:127.0.0.1:6924/1858650673,v1:127.0.0.1:6925/1858650673] exists,up f330a52d-da2e-4c35-8067-c36a02f923aa 2024-09-16T04:10:58.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:10:58.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:10:58.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:10:58.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:10:58.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 16 2024-09-16T04:10:58.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:10:58.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=16 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/16 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/16' 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/16/journal' 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:10:58.717 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:10:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:10:58.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:10:58.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:10:58.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:10:58.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:10:58.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/16 2024-09-16T04:10:58.719 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:10:58.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=fa3d7d3f-df95-423c-89eb-1add89a260a1 2024-09-16T04:10:58.719 INFO:tasks.workunit.client.0.smithi026.stdout:add osd16 fa3d7d3f-df95-423c-89eb-1add89a260a1 2024-09-16T04:10:58.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd16 fa3d7d3f-df95-423c-89eb-1add89a260a1' 2024-09-16T04:10:58.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:10:58.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDSr+dmKVr9KxAA/4M17pcUvubNSKcrMBVI/w== 2024-09-16T04:10:58.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDSr+dmKVr9KxAA/4M17pcUvubNSKcrMBVI/w=="}' 2024-09-16T04:10:58.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new fa3d7d3f-df95-423c-89eb-1add89a260a1 -i td/osd-backfill-space/16/new.json 2024-09-16T04:10:59.349 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:10:59.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/16/new.json 2024-09-16T04:10:59.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 16 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/16 --osd-journal=td/osd-backfill-space/16/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDSr+dmKVr9KxAA/4M17pcUvubNSKcrMBVI/w== --osd-uuid fa3d7d3f-df95-423c-89eb-1add89a260a1 2024-09-16T04:10:59.397 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:59.396+0000 7fbe71885640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:59.431 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:59.429+0000 7fbe71885640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:59.432 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:59.430+0000 7fbe71885640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:10:59.433 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:59.431+0000 7fbe71885640 -1 bdev(0x559e9d0e7c00 td/osd-backfill-space/16/block) open stat got: (1) Operation not permitted 2024-09-16T04:10:59.433 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:10:59.431+0000 7fbe71885640 -1 bluestore(td/osd-backfill-space/16) _read_fsid unparsable uuid 2024-09-16T04:11:05.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/16/keyring 2024-09-16T04:11:05.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:11:05.565 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd16 key to auth repository 2024-09-16T04:11:05.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd16 key to auth repository 2024-09-16T04:11:05.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/16/keyring auth add osd.16 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:11:06.135 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.16 2024-09-16T04:11:06.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.16 2024-09-16T04:11:06.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 16 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/16 --osd-journal=td/osd-backfill-space/16/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:11:06.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:11:06.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:11:06.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:11:06.169 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:06.168+0000 7f8592e18640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:06.174 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:06.172+0000 7f8592e18640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:06.175 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:06.173+0000 7f8592e18640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:06.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 16 2024-09-16T04:11:06.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:11:06.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=16 2024-09-16T04:11:06.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:11:06.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:11:06.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:06.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:11:06.637 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:11:06.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:06.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:07.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:07.763 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:07.761+0000 7f8592e18640 -1 Falling back to public interface 2024-09-16T04:11:08.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:08.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:08.074 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:11:08.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:11:08.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:08.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:08.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:09.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:09.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:09.527 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:11:09.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:11:09.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:09.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:09.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:10.751 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:10.749+0000 7f8592e18640 -1 osd.16 0 log_to_monitors true 2024-09-16T04:11:10.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:10.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:10.981 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:11:10.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:11:10.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:10.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:11.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:12.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:12.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:12.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:11:12.473 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:11:12.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:12.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:13.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:14.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:14.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:14.109 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:11:14.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:11:14.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:14.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:14.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:15.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:15.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:11:15.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:11:15.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:15.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:16.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:17.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:17.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:17.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:11:17.252 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:11:17.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:17.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:17.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:18.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:18.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:18.816 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:11:18.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:11:18.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:18.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:19.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:20.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:20.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:20.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:11:20.246 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:11:20.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:20.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:20.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:21.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:21.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:21.830 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:11:21.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:11:21.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:21.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:22.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:23.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:23.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:23.271 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:11:23.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:11:23.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:23.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:23.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:24.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:24.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:24.700 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:11:24.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:11:24.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:24.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:25.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:26.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:26.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:26.854 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:11:26.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:11:26.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:26.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:27.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:28.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:28.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:28.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:11:28.661 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:11:28.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:28.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:29.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:30.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:30.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:30.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:11:30.497 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:11:30.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:30.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:31.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:32.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:32.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:32.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:11:32.421 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:11:32.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:32.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:33.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:34.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:34.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:34.300 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:11:34.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:11:34.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:34.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:34.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:35.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:35.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:35.859 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:11:35.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:11:35.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:35.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.16 up' 2024-09-16T04:11:36.302 INFO:tasks.workunit.client.0.smithi026.stdout:osd.16 up in weight 1 up_from 85 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6930/422939494,v1:127.0.0.1:6931/422939494] [v2:127.0.0.1:6932/422939494,v1:127.0.0.1:6933/422939494] exists,up fa3d7d3f-df95-423c-89eb-1add89a260a1 2024-09-16T04:11:36.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:11:36.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:11:36.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:11:36.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:11:36.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 17 2024-09-16T04:11:36.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:11:36.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:11:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=17 2024-09-16T04:11:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:11:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/17 2024-09-16T04:11:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:11:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:11:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:11:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:11:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/17' 2024-09-16T04:11:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/17/journal' 2024-09-16T04:11:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:11:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:11:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:11:36.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:11:36.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:11:36.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:11:36.309 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:11:36.309 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:11:36.309 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:11:36.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:11:36.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:11:36.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:11:36.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:11:36.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:11:36.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:11:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:11:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:11:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:11:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:11:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:11:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:11:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:11:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/17 2024-09-16T04:11:36.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:11:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0a2281b8-2c44-41a9-99ef-27aac696faec 2024-09-16T04:11:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd17 0a2281b8-2c44-41a9-99ef-27aac696faec' 2024-09-16T04:11:36.311 INFO:tasks.workunit.client.0.smithi026.stdout:add osd17 0a2281b8-2c44-41a9-99ef-27aac696faec 2024-09-16T04:11:36.311 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:11:36.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD4r+dmvBWPExAAxR+cqUiQxKtUusPnDlqemg== 2024-09-16T04:11:36.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD4r+dmvBWPExAAxR+cqUiQxKtUusPnDlqemg=="}' 2024-09-16T04:11:36.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0a2281b8-2c44-41a9-99ef-27aac696faec -i td/osd-backfill-space/17/new.json 2024-09-16T04:11:36.806 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:11:36.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/17/new.json 2024-09-16T04:11:36.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 17 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/17 --osd-journal=td/osd-backfill-space/17/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD4r+dmvBWPExAAxR+cqUiQxKtUusPnDlqemg== --osd-uuid 0a2281b8-2c44-41a9-99ef-27aac696faec 2024-09-16T04:11:36.854 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:36.853+0000 7f6e42014640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:36.856 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:36.855+0000 7f6e42014640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:36.857 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:36.856+0000 7f6e42014640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:36.858 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:36.856+0000 7f6e42014640 -1 bdev(0x55a429919c00 td/osd-backfill-space/17/block) open stat got: (1) Operation not permitted 2024-09-16T04:11:36.858 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:36.856+0000 7f6e42014640 -1 bluestore(td/osd-backfill-space/17) _read_fsid unparsable uuid 2024-09-16T04:11:43.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/17/keyring 2024-09-16T04:11:43.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:11:43.405 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd17 key to auth repository 2024-09-16T04:11:43.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd17 key to auth repository 2024-09-16T04:11:43.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/17/keyring auth add osd.17 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:11:43.995 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.17 2024-09-16T04:11:43.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.17 2024-09-16T04:11:43.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 17 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/17 --osd-journal=td/osd-backfill-space/17/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:11:43.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:11:43.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:11:43.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:11:44.030 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:44.027+0000 7f74c8117640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:44.032 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:44.029+0000 7f74c8117640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:44.033 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:44.030+0000 7f74c8117640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:11:44.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 17 2024-09-16T04:11:44.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:11:44.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=17 2024-09-16T04:11:44.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:11:44.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:11:44.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:44.405 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:11:44.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:11:44.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:44.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:11:44.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:45.384 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:45.381+0000 7f74c8117640 -1 Falling back to public interface 2024-09-16T04:11:45.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:45.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:45.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:11:45.837 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:11:45.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:45.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:11:46.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:47.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:47.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:47.298 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:11:47.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:11:47.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:47.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:11:47.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:48.202 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:11:48.199+0000 7f74c8117640 -1 osd.17 0 log_to_monitors true 2024-09-16T04:11:48.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:48.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:48.727 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:11:48.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:11:48.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:48.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:11:49.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:50.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:50.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:50.199 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:11:50.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:11:50.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:50.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:11:50.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:51.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:51.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:51.625 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:11:51.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:11:51.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:51.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:11:52.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:53.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:53.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:53.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:11:53.208 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:11:53.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:53.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:11:53.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:54.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:54.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:54.716 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:11:54.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:11:54.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:54.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:11:55.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:56.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:56.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:56.188 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:11:56.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:11:56.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:56.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:11:56.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:57.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:57.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:57.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:11:57.615 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:11:57.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:57.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:11:58.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:11:59.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:11:59.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:11:59.138 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:11:59.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:11:59.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:11:59.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:11:59.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:00.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:00.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:00.696 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:12:00.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:12:00.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:00.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:12:01.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:02.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:02.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:02.354 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:12:02.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:12:02.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:02.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:12:02.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:03.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:03.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:03.993 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:12:03.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:12:03.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:03.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:12:04.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:05.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:05.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:05.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:12:05.549 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:12:05.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:05.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:12:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:07.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:07.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:07.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:12:07.217 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:12:07.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:07.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:12:08.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:09.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:09.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:09.021 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:12:09.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:12:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:09.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:12:09.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:10.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:10.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:10.615 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:12:10.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:12:10.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:10.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:12:11.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:12.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:12.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:12.722 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:12:12.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:12:12.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:12.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.17 up' 2024-09-16T04:12:13.204 INFO:tasks.workunit.client.0.smithi026.stdout:osd.17 up in weight 1 up_from 90 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6938/259050906,v1:127.0.0.1:6939/259050906] [v2:127.0.0.1:6940/259050906,v1:127.0.0.1:6941/259050906] exists,up 0a2281b8-2c44-41a9-99ef-27aac696faec 2024-09-16T04:12:13.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:12:13.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:12:13.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:12:13.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:12:13.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 18 2024-09-16T04:12:13.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:12:13.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:12:13.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=18 2024-09-16T04:12:13.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:12:13.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/18 2024-09-16T04:12:13.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:12:13.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:12:13.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:12:13.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:12:13.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/18' 2024-09-16T04:12:13.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/18/journal' 2024-09-16T04:12:13.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:12:13.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:12:13.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:12:13.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:12:13.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:12:13.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:12:13.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:12:13.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:12:13.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:12:13.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/18 2024-09-16T04:12:13.211 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:12:13.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=91536842-2832-4718-89de-7f159b7c42ce 2024-09-16T04:12:13.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd18 91536842-2832-4718-89de-7f159b7c42ce' 2024-09-16T04:12:13.212 INFO:tasks.workunit.client.0.smithi026.stdout:add osd18 91536842-2832-4718-89de-7f159b7c42ce 2024-09-16T04:12:13.212 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:12:13.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAdsOdmC1+6DRAAYcEWl6bErkefrPblR2W0FA== 2024-09-16T04:12:13.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAdsOdmC1+6DRAAYcEWl6bErkefrPblR2W0FA=="}' 2024-09-16T04:12:13.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 91536842-2832-4718-89de-7f159b7c42ce -i td/osd-backfill-space/18/new.json 2024-09-16T04:12:13.757 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:12:13.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/18/new.json 2024-09-16T04:12:13.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 18 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/18 --osd-journal=td/osd-backfill-space/18/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAdsOdmC1+6DRAAYcEWl6bErkefrPblR2W0FA== --osd-uuid 91536842-2832-4718-89de-7f159b7c42ce 2024-09-16T04:12:13.806 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:13.804+0000 7fdc774eb640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:13.887 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:13.886+0000 7fdc774eb640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:13.889 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:13.887+0000 7fdc774eb640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:13.889 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:13.887+0000 7fdc774eb640 -1 bdev(0x5573c2b93c00 td/osd-backfill-space/18/block) open stat got: (1) Operation not permitted 2024-09-16T04:12:13.889 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:13.887+0000 7fdc774eb640 -1 bluestore(td/osd-backfill-space/18) _read_fsid unparsable uuid 2024-09-16T04:12:20.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/18/keyring 2024-09-16T04:12:20.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:12:20.673 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd18 key to auth repository 2024-09-16T04:12:20.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd18 key to auth repository 2024-09-16T04:12:20.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/18/keyring auth add osd.18 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:12:21.243 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.18 2024-09-16T04:12:21.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.18 2024-09-16T04:12:21.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 18 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/18 --osd-journal=td/osd-backfill-space/18/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:12:21.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:12:21.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:12:21.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:12:21.277 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:21.276+0000 7f2fd4bbd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:21.289 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:21.287+0000 7f2fd4bbd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:21.290 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:21.289+0000 7f2fd4bbd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:21.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 18 2024-09-16T04:12:21.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:12:21.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=18 2024-09-16T04:12:21.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:12:21.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:12:21.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:21.692 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:12:21.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:12:21.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:21.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:22.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:22.637 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:22.636+0000 7f2fd4bbd640 -1 Falling back to public interface 2024-09-16T04:12:23.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:23.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:23.157 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:12:23.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:12:23.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:23.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:23.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:24.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:24.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:24.581 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:12:24.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:12:24.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:24.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:25.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:25.707 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:25.705+0000 7f2fd4bbd640 -1 osd.18 0 log_to_monitors true 2024-09-16T04:12:26.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:26.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:26.044 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:12:26.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:12:26.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:26.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:26.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:27.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:27.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:27.591 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:12:27.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:12:27.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:27.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:28.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:29.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:29.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:29.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:12:29.139 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:12:29.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:29.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:29.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:30.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:30.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:30.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:12:30.609 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:12:30.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:30.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:31.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:32.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:32.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:32.067 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:12:32.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:12:32.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:32.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:32.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:33.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:33.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:33.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:12:33.629 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:12:33.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:33.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:34.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:35.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:35.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:35.055 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:12:35.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:12:35.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:35.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:35.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:36.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:36.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:36.628 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:12:36.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:12:36.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:36.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:37.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:38.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:38.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:38.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:12:38.068 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:12:38.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:38.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:38.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:39.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:39.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:39.646 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:12:39.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:12:39.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:39.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:40.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:41.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:41.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:41.523 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:12:41.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:12:41.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:41.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:42.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:43.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:43.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:43.341 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:12:43.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:12:43.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:43.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:43.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:44.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:44.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:44.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:12:44.904 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:12:44.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:44.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:45.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:46.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:46.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:46.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:12:46.451 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:12:46.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:46.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:47.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:48.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:48.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:48.002 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:12:48.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:12:48.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:48.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:48.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:49.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:12:49.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:49.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:12:49.756 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:12:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.18 up' 2024-09-16T04:12:50.234 INFO:tasks.workunit.client.0.smithi026.stdout:osd.18 up in weight 1 up_from 95 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6946/1882508478,v1:127.0.0.1:6947/1882508478] [v2:127.0.0.1:6948/1882508478,v1:127.0.0.1:6949/1882508478] exists,up 91536842-2832-4718-89de-7f159b7c42ce 2024-09-16T04:12:50.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:12:50.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:200: TEST_backfill_test_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:202: TEST_backfill_test_multi: run_osd td/osd-backfill-space 19 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=19 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/19 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:12:50.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/19' 2024-09-16T04:12:50.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/19/journal' 2024-09-16T04:12:50.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:12:50.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:12:50.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:12:50.240 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:12:50.240 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:12:50.240 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:12:50.240 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:12:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:12:50.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:12:50.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:12:50.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/19 2024-09-16T04:12:50.242 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:12:50.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b0975744-3219-4461-9fd4-feb8e83f356f 2024-09-16T04:12:50.242 INFO:tasks.workunit.client.0.smithi026.stdout:add osd19 b0975744-3219-4461-9fd4-feb8e83f356f 2024-09-16T04:12:50.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd19 b0975744-3219-4461-9fd4-feb8e83f356f' 2024-09-16T04:12:50.243 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:12:50.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBCsOdmdpiSDxAAPomesJWjutQQbzJJM9mNDw== 2024-09-16T04:12:50.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBCsOdmdpiSDxAAPomesJWjutQQbzJJM9mNDw=="}' 2024-09-16T04:12:50.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b0975744-3219-4461-9fd4-feb8e83f356f -i td/osd-backfill-space/19/new.json 2024-09-16T04:12:50.810 INFO:tasks.workunit.client.0.smithi026.stdout:19 2024-09-16T04:12:50.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/19/new.json 2024-09-16T04:12:50.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 19 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/19 --osd-journal=td/osd-backfill-space/19/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBCsOdmdpiSDxAAPomesJWjutQQbzJJM9mNDw== --osd-uuid b0975744-3219-4461-9fd4-feb8e83f356f 2024-09-16T04:12:50.860 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:50.857+0000 7f93ca826640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:50.924 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:50.921+0000 7f93ca826640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:50.925 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:50.922+0000 7f93ca826640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:50.925 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:50.923+0000 7f93ca826640 -1 bdev(0x55b88d87bc00 td/osd-backfill-space/19/block) open stat got: (1) Operation not permitted 2024-09-16T04:12:50.925 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:50.923+0000 7f93ca826640 -1 bluestore(td/osd-backfill-space/19) _read_fsid unparsable uuid 2024-09-16T04:12:57.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/19/keyring 2024-09-16T04:12:57.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:12:57.837 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd19 key to auth repository 2024-09-16T04:12:57.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd19 key to auth repository 2024-09-16T04:12:57.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/19/keyring auth add osd.19 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:12:58.411 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.19 2024-09-16T04:12:58.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.19 2024-09-16T04:12:58.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 19 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/19 --osd-journal=td/osd-backfill-space/19/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:12:58.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:12:58.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:12:58.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:12:58.446 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:58.443+0000 7fb6aa00b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:58.474 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:58.471+0000 7fb6aa00b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:58.475 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:58.472+0000 7fb6aa00b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:12:58.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 19 2024-09-16T04:12:58.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:12:58.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=19 2024-09-16T04:12:58.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:12:58.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:12:58.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:12:58.871 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:12:58.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:12:58.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:12:58.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:12:59.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:12:59.825 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:12:59.822+0000 7fb6aa00b640 -1 Falling back to public interface 2024-09-16T04:13:00.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:00.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:00.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:13:00.323 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:13:00.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:00.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:00.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:01.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:01.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:01.756 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:13:01.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:13:01.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:01.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:02.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:02.764 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:13:02.762+0000 7fb6aa00b640 -1 osd.19 0 log_to_monitors true 2024-09-16T04:13:03.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:03.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:03.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:13:03.190 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:13:03.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:03.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:03.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:04.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:04.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:04.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:13:04.620 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:13:04.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:04.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:05.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:06.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:06.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:06.079 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:13:06.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:13:06.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:06.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:06.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:07.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:07.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:07.583 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:13:07.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:13:07.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:07.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:08.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:09.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:09.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:09.139 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:13:09.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:13:09.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:09.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:09.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:10.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:10.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:10.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:13:10.576 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:13:10.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:10.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:11.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:12.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:12.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:12.061 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:13:12.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:13:12.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:12.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:12.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:13.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:13.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:13.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:13:13.605 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:13:13.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:13.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:14.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:15.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:15.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:15.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:13:15.056 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:13:15.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:15.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:15.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:16.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:16.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:16.508 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:13:16.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:13:16.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:16.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:17.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:18.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:18.369 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:13:18.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:18.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:13:18.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:18.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:19.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:20.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:20.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:20.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:13:20.162 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:13:20.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:20.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:20.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:21.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:21.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:21.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:13:21.925 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:13:21.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:21.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:22.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:23.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:23.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:23.692 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:13:23.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:13:23.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:23.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:24.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:25.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:25.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:25.343 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:13:25.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:13:25.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:25.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:25.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:13:26.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:13:26.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:13:26.871 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:13:26.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:13:26.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:13:26.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.19 up' 2024-09-16T04:13:27.359 INFO:tasks.workunit.client.0.smithi026.stdout:osd.19 up in weight 1 up_from 100 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6954/4692123,v1:127.0.0.1:6955/4692123] [v2:127.0.0.1:6956/4692123,v1:127.0.0.1:6957/4692123] exists,up b0975744-3219-4461-9fd4-feb8e83f356f 2024-09-16T04:13:27.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:13:27.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:13:27.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:13:27.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:205: TEST_backfill_test_multi: ceph osd set-backfillfull-ratio .85 2024-09-16T04:13:28.155 INFO:tasks.workunit.client.0.smithi026.stderr:osd set-backfillfull-ratio 0.85 2024-09-16T04:13:28.168 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:13:28.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:13:28.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test1 1 1 2024-09-16T04:13:28.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test1 1 1 2024-09-16T04:13:29.080 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' already exists 2024-09-16T04:13:29.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:13:30.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test1 size 1 --yes-i-really-mean-it 2024-09-16T04:13:31.626 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 1 2024-09-16T04:13:31.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:13:31.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test2 1 1 2024-09-16T04:13:31.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test2 1 1 2024-09-16T04:13:32.566 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' already exists 2024-09-16T04:13:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:13:33.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test2 size 1 --yes-i-really-mean-it 2024-09-16T04:13:34.576 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 2 size to 1 2024-09-16T04:13:34.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:13:34.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test3 1 1 2024-09-16T04:13:34.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test3 1 1 2024-09-16T04:13:36.016 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test3' already exists 2024-09-16T04:13:36.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:13:37.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test3 size 1 --yes-i-really-mean-it 2024-09-16T04:13:38.016 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 3 size to 1 2024-09-16T04:13:38.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:13:38.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test4 1 1 2024-09-16T04:13:38.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test4 1 1 2024-09-16T04:13:38.992 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test4' already exists 2024-09-16T04:13:39.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:13:40.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test4 size 1 --yes-i-really-mean-it 2024-09-16T04:13:41.139 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 4 size to 1 2024-09-16T04:13:41.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:13:41.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test5 1 1 2024-09-16T04:13:41.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test5 1 1 2024-09-16T04:13:42.536 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test5' already exists 2024-09-16T04:13:42.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:13:43.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test5 size 1 --yes-i-really-mean-it 2024-09-16T04:13:44.653 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 5 size to 1 2024-09-16T04:13:44.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:13:44.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test6 1 1 2024-09-16T04:13:44.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test6 1 1 2024-09-16T04:13:45.205 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test6' already exists 2024-09-16T04:13:45.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:13:46.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test6 size 1 --yes-i-really-mean-it 2024-09-16T04:13:47.503 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 6 size to 1 2024-09-16T04:13:47.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:13:47.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test7 1 1 2024-09-16T04:13:47.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test7 1 1 2024-09-16T04:13:49.029 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test7' already exists 2024-09-16T04:13:49.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:13:50.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test7 size 1 --yes-i-really-mean-it 2024-09-16T04:13:51.010 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 7 size to 1 2024-09-16T04:13:51.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:207: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:13:51.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:209: TEST_backfill_test_multi: create_pool test8 1 1 2024-09-16T04:13:51.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test8 1 1 2024-09-16T04:13:52.028 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test8' already exists 2024-09-16T04:13:52.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:13:53.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:210: TEST_backfill_test_multi: ceph osd pool set test8 size 1 --yes-i-really-mean-it 2024-09-16T04:13:54.003 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 8 size to 1 2024-09-16T04:13:54.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:213: TEST_backfill_test_multi: wait_for_clean 2024-09-16T04:13:54.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T04:13:54.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T04:13:54.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T04:13:54.016 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T04:13:54.017 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:13:54.017 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:13:54.017 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:13:54.017 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:13:54.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:13:54.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T04:13:54.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T04:13:54.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T04:13:54.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T04:13:54.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:13:54.113 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:13:54.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:13:54.605 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:13:54.605 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:13:54.605 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:13:54.605 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T04:13:54.605 INFO:tasks.workunit.client.0.smithi026.stderr:5 2024-09-16T04:13:54.605 INFO:tasks.workunit.client.0.smithi026.stderr:6 2024-09-16T04:13:54.605 INFO:tasks.workunit.client.0.smithi026.stderr:7 2024-09-16T04:13:54.605 INFO:tasks.workunit.client.0.smithi026.stderr:8 2024-09-16T04:13:54.605 INFO:tasks.workunit.client.0.smithi026.stderr:9 2024-09-16T04:13:54.605 INFO:tasks.workunit.client.0.smithi026.stderr:10 2024-09-16T04:13:54.606 INFO:tasks.workunit.client.0.smithi026.stderr:11 2024-09-16T04:13:54.606 INFO:tasks.workunit.client.0.smithi026.stderr:12 2024-09-16T04:13:54.606 INFO:tasks.workunit.client.0.smithi026.stderr:13 2024-09-16T04:13:54.606 INFO:tasks.workunit.client.0.smithi026.stderr:14 2024-09-16T04:13:54.606 INFO:tasks.workunit.client.0.smithi026.stderr:15 2024-09-16T04:13:54.606 INFO:tasks.workunit.client.0.smithi026.stderr:16 2024-09-16T04:13:54.606 INFO:tasks.workunit.client.0.smithi026.stderr:17 2024-09-16T04:13:54.606 INFO:tasks.workunit.client.0.smithi026.stderr:18 2024-09-16T04:13:54.606 INFO:tasks.workunit.client.0.smithi026.stderr:19' 2024-09-16T04:13:54.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:13:54.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:54.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:13:54.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836628 2024-09-16T04:13:54.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836628 2024-09-16T04:13:54.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628' 2024-09-16T04:13:54.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:54.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:13:54.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673101 2024-09-16T04:13:54.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673101 2024-09-16T04:13:54.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101' 2024-09-16T04:13:54.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:54.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:13:55.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509579 2024-09-16T04:13:55.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509579 2024-09-16T04:13:55.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579' 2024-09-16T04:13:55.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:55.077 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:13:55.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899346047 2024-09-16T04:13:55.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899346047 2024-09-16T04:13:55.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047' 2024-09-16T04:13:55.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:55.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:13:55.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182519 2024-09-16T04:13:55.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182519 2024-09-16T04:13:55.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519' 2024-09-16T04:13:55.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:55.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T04:13:55.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018992 2024-09-16T04:13:55.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018992 2024-09-16T04:13:55.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992' 2024-09-16T04:13:55.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:55.539 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2024-09-16T04:13:55.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=150323855469 2024-09-16T04:13:55.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 150323855469 2024-09-16T04:13:55.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469' 2024-09-16T04:13:55.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:55.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2024-09-16T04:13:55.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=171798691938 2024-09-16T04:13:55.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 171798691938 2024-09-16T04:13:55.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938' 2024-09-16T04:13:55.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:55.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2024-09-16T04:13:55.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=193273528415 2024-09-16T04:13:55.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 193273528415 2024-09-16T04:13:55.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938 8-193273528415' 2024-09-16T04:13:55.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:55.912 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2024-09-16T04:13:56.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=214748364888 2024-09-16T04:13:56.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 214748364888 2024-09-16T04:13:56.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938 8-193273528415 9-214748364888' 2024-09-16T04:13:56.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:56.036 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2024-09-16T04:13:56.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=236223201357 2024-09-16T04:13:56.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 236223201357 2024-09-16T04:13:56.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938 8-193273528415 9-214748364888 10-236223201357' 2024-09-16T04:13:56.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:56.161 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.11 flush_pg_stats 2024-09-16T04:13:56.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=257698037831 2024-09-16T04:13:56.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 257698037831 2024-09-16T04:13:56.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938 8-193273528415 9-214748364888 10-236223201357 11-257698037831' 2024-09-16T04:13:56.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:56.285 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.12 flush_pg_stats 2024-09-16T04:13:56.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=279172874303 2024-09-16T04:13:56.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 279172874303 2024-09-16T04:13:56.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938 8-193273528415 9-214748364888 10-236223201357 11-257698037831 12-279172874303' 2024-09-16T04:13:56.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:56.409 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.13 flush_pg_stats 2024-09-16T04:13:56.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=300647710775 2024-09-16T04:13:56.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 300647710775 2024-09-16T04:13:56.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938 8-193273528415 9-214748364888 10-236223201357 11-257698037831 12-279172874303 13-300647710775' 2024-09-16T04:13:56.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:56.533 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.14 flush_pg_stats 2024-09-16T04:13:56.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=322122547249 2024-09-16T04:13:56.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 322122547249 2024-09-16T04:13:56.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938 8-193273528415 9-214748364888 10-236223201357 11-257698037831 12-279172874303 13-300647710775 14-322122547249' 2024-09-16T04:13:56.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:56.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.15 flush_pg_stats 2024-09-16T04:13:56.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=343597383723 2024-09-16T04:13:56.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 343597383723 2024-09-16T04:13:56.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938 8-193273528415 9-214748364888 10-236223201357 11-257698037831 12-279172874303 13-300647710775 14-322122547249 15-343597383723' 2024-09-16T04:13:56.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:56.785 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.16 flush_pg_stats 2024-09-16T04:13:56.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=365072220193 2024-09-16T04:13:56.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 365072220193 2024-09-16T04:13:56.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938 8-193273528415 9-214748364888 10-236223201357 11-257698037831 12-279172874303 13-300647710775 14-322122547249 15-343597383723 16-365072220193' 2024-09-16T04:13:56.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:56.910 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.17 flush_pg_stats 2024-09-16T04:13:57.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=386547056666 2024-09-16T04:13:57.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 386547056666 2024-09-16T04:13:57.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938 8-193273528415 9-214748364888 10-236223201357 11-257698037831 12-279172874303 13-300647710775 14-322122547249 15-343597383723 16-365072220193 17-386547056666' 2024-09-16T04:13:57.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:57.034 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.18 flush_pg_stats 2024-09-16T04:13:57.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=408021893141 2024-09-16T04:13:57.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 408021893141 2024-09-16T04:13:57.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938 8-193273528415 9-214748364888 10-236223201357 11-257698037831 12-279172874303 13-300647710775 14-322122547249 15-343597383723 16-365072220193 17-386547056666 18-408021893141' 2024-09-16T04:13:57.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:13:57.157 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.19 flush_pg_stats 2024-09-16T04:13:57.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=429496729612 2024-09-16T04:13:57.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 429496729612 2024-09-16T04:13:57.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836628 1-42949673101 2-64424509579 3-85899346047 4-107374182519 5-128849018992 6-150323855469 7-171798691938 8-193273528415 9-214748364888 10-236223201357 11-257698037831 12-279172874303 13-300647710775 14-322122547249 15-343597383723 16-365072220193 17-386547056666 18-408021893141 19-429496729612' 2024-09-16T04:13:57.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:13:57.281 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836628 2024-09-16T04:13:57.281 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:13:57.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:13:57.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836628 2024-09-16T04:13:57.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:13:57.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836628 2024-09-16T04:13:57.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836628' 2024-09-16T04:13:57.284 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836628 2024-09-16T04:13:57.284 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:13:57.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836628 -lt 21474836628 2024-09-16T04:13:57.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:13:57.701 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673101 2024-09-16T04:13:57.701 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:13:57.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:13:57.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673101 2024-09-16T04:13:57.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:13:57.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673101 2024-09-16T04:13:57.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673101' 2024-09-16T04:13:57.704 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673101 2024-09-16T04:13:57.705 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:13:58.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673102 -lt 42949673101 2024-09-16T04:13:58.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:13:58.155 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509579 2024-09-16T04:13:58.156 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:13:58.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:13:58.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509579 2024-09-16T04:13:58.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:13:58.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509579 2024-09-16T04:13:58.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509579' 2024-09-16T04:13:58.159 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509579 2024-09-16T04:13:58.159 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:13:58.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509579 -lt 64424509579 2024-09-16T04:13:58.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:13:58.623 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899346047 2024-09-16T04:13:58.623 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:13:58.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:13:58.624 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899346047 2024-09-16T04:13:58.624 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:13:58.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899346047 2024-09-16T04:13:58.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899346047' 2024-09-16T04:13:58.625 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899346047 2024-09-16T04:13:58.626 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:13:59.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899346048 -lt 85899346047 2024-09-16T04:13:59.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:13:59.100 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182519 2024-09-16T04:13:59.100 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:13:59.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:13:59.102 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182519 2024-09-16T04:13:59.102 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:13:59.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182519 2024-09-16T04:13:59.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182519' 2024-09-16T04:13:59.103 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182519 2024-09-16T04:13:59.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:13:59.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182520 -lt 107374182519 2024-09-16T04:13:59.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:13:59.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018992 2024-09-16T04:13:59.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:13:59.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T04:13:59.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018992 2024-09-16T04:13:59.538 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:13:59.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018992 2024-09-16T04:13:59.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018992' 2024-09-16T04:13:59.539 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018992 2024-09-16T04:13:59.539 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T04:13:59.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018993 -lt 128849018992 2024-09-16T04:13:59.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:13:59.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 6-150323855469 2024-09-16T04:13:59.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:13:59.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=6 2024-09-16T04:13:59.981 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 6-150323855469 2024-09-16T04:13:59.981 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:13:59.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=150323855469 2024-09-16T04:13:59.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.6 seq 150323855469' 2024-09-16T04:13:59.983 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.6 seq 150323855469 2024-09-16T04:13:59.983 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 6 2024-09-16T04:14:00.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 150323855469 -lt 150323855469 2024-09-16T04:14:00.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:00.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 7-171798691938 2024-09-16T04:14:00.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:00.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=7 2024-09-16T04:14:00.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 7-171798691938 2024-09-16T04:14:00.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:00.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=171798691938 2024-09-16T04:14:00.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.7 seq 171798691938' 2024-09-16T04:14:00.426 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.7 seq 171798691938 2024-09-16T04:14:00.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 7 2024-09-16T04:14:00.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 171798691939 -lt 171798691938 2024-09-16T04:14:00.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:00.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 8-193273528415 2024-09-16T04:14:00.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:00.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=8 2024-09-16T04:14:00.839 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 8-193273528415 2024-09-16T04:14:00.839 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:00.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=193273528415 2024-09-16T04:14:00.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.8 seq 193273528415' 2024-09-16T04:14:00.840 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.8 seq 193273528415 2024-09-16T04:14:00.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 8 2024-09-16T04:14:01.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 193273528416 -lt 193273528415 2024-09-16T04:14:01.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:01.326 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 9-214748364888 2024-09-16T04:14:01.326 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:01.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=9 2024-09-16T04:14:01.327 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 9-214748364888 2024-09-16T04:14:01.327 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:01.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=214748364888 2024-09-16T04:14:01.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.9 seq 214748364888' 2024-09-16T04:14:01.329 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.9 seq 214748364888 2024-09-16T04:14:01.329 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 9 2024-09-16T04:14:01.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 214748364888 -lt 214748364888 2024-09-16T04:14:01.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:01.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 10-236223201357 2024-09-16T04:14:01.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:01.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=10 2024-09-16T04:14:01.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 10-236223201357 2024-09-16T04:14:01.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:01.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=236223201357 2024-09-16T04:14:01.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.10 seq 236223201357' 2024-09-16T04:14:01.782 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.10 seq 236223201357 2024-09-16T04:14:01.782 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 10 2024-09-16T04:14:02.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 236223201357 -lt 236223201357 2024-09-16T04:14:02.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:02.224 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 11-257698037831 2024-09-16T04:14:02.224 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:02.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=11 2024-09-16T04:14:02.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 11-257698037831 2024-09-16T04:14:02.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:02.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=257698037831 2024-09-16T04:14:02.227 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.11 seq 257698037831 2024-09-16T04:14:02.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.11 seq 257698037831' 2024-09-16T04:14:02.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 11 2024-09-16T04:14:02.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 257698037832 -lt 257698037831 2024-09-16T04:14:02.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:02.643 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 12-279172874303 2024-09-16T04:14:02.643 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:02.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=12 2024-09-16T04:14:02.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 12-279172874303 2024-09-16T04:14:02.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:02.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=279172874303 2024-09-16T04:14:02.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.12 seq 279172874303' 2024-09-16T04:14:02.646 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.12 seq 279172874303 2024-09-16T04:14:02.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 12 2024-09-16T04:14:03.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 279172874304 -lt 279172874303 2024-09-16T04:14:03.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:03.308 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 13-300647710775 2024-09-16T04:14:03.308 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:03.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=13 2024-09-16T04:14:03.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 13-300647710775 2024-09-16T04:14:03.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:03.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=300647710775 2024-09-16T04:14:03.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.13 seq 300647710775' 2024-09-16T04:14:03.311 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.13 seq 300647710775 2024-09-16T04:14:03.312 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 13 2024-09-16T04:14:03.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 300647710777 -lt 300647710775 2024-09-16T04:14:03.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:03.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 14-322122547249 2024-09-16T04:14:03.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:03.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=14 2024-09-16T04:14:03.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 14-322122547249 2024-09-16T04:14:03.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:03.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=322122547249 2024-09-16T04:14:03.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.14 seq 322122547249' 2024-09-16T04:14:03.758 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.14 seq 322122547249 2024-09-16T04:14:03.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 14 2024-09-16T04:14:04.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 322122547251 -lt 322122547249 2024-09-16T04:14:04.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:04.207 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 15-343597383723 2024-09-16T04:14:04.207 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:04.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=15 2024-09-16T04:14:04.209 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 15-343597383723 2024-09-16T04:14:04.209 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:04.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=343597383723 2024-09-16T04:14:04.210 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.15 seq 343597383723 2024-09-16T04:14:04.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.15 seq 343597383723' 2024-09-16T04:14:04.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 15 2024-09-16T04:14:04.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 343597383724 -lt 343597383723 2024-09-16T04:14:04.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:04.691 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 16-365072220193 2024-09-16T04:14:04.691 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:04.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=16 2024-09-16T04:14:04.692 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 16-365072220193 2024-09-16T04:14:04.692 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:04.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=365072220193 2024-09-16T04:14:04.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.16 seq 365072220193' 2024-09-16T04:14:04.693 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.16 seq 365072220193 2024-09-16T04:14:04.694 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 16 2024-09-16T04:14:05.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 365072220194 -lt 365072220193 2024-09-16T04:14:05.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:05.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 17-386547056666 2024-09-16T04:14:05.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:05.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=17 2024-09-16T04:14:05.161 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 17-386547056666 2024-09-16T04:14:05.162 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:05.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=386547056666 2024-09-16T04:14:05.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.17 seq 386547056666' 2024-09-16T04:14:05.163 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.17 seq 386547056666 2024-09-16T04:14:05.163 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 17 2024-09-16T04:14:05.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 386547056668 -lt 386547056666 2024-09-16T04:14:05.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:05.593 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 18-408021893141 2024-09-16T04:14:05.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:05.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=18 2024-09-16T04:14:05.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 18-408021893141 2024-09-16T04:14:05.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:05.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=408021893141 2024-09-16T04:14:05.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.18 seq 408021893141' 2024-09-16T04:14:05.596 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.18 seq 408021893141 2024-09-16T04:14:05.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 18 2024-09-16T04:14:06.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 408021893142 -lt 408021893141 2024-09-16T04:14:06.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:14:06.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 19-429496729612 2024-09-16T04:14:06.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:14:06.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=19 2024-09-16T04:14:06.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 19-429496729612 2024-09-16T04:14:06.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:14:06.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=429496729612 2024-09-16T04:14:06.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.19 seq 429496729612' 2024-09-16T04:14:06.032 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.19 seq 429496729612 2024-09-16T04:14:06.033 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 19 2024-09-16T04:14:06.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 429496729614 -lt 429496729612 2024-09-16T04:14:06.473 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T04:14:06.474 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:14:06.474 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:14:07.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 8 == 0 2024-09-16T04:14:07.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:14:07.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:14:07.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:14:07.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:14:07.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:14:07.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:14:07.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:14:07.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=8 2024-09-16T04:14:07.451 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:14:07.451 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:14:07.452 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:14:08.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 8 = 8 2024-09-16T04:14:08.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T04:14:08.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T04:14:08.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:215: TEST_backfill_test_multi: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=4 2024-09-16T04:14:08.014 INFO:tasks.workunit.client.0.smithi026.stderr:4+0 records in 2024-09-16T04:14:08.014 INFO:tasks.workunit.client.0.smithi026.stderr:4+0 records out 2024-09-16T04:14:08.015 INFO:tasks.workunit.client.0.smithi026.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 7.0415e-05 s, 58.2 MB/s 2024-09-16T04:14:08.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: seq 1 600 2024-09-16T04:14:08.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:08.016 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:08.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:08.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:14:08.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:08.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:14:08.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:08.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:14:08.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:08.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:14:08.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:08.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:14:08.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:08.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:14:08.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:08.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:14:08.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:08.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:14:08.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:08.947 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:08.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:08.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:14:09.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:09.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:14:09.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:09.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:14:09.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:09.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:14:09.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:09.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:14:09.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:09.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:14:09.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:09.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:14:09.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:09.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:14:09.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:09.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:09.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:09.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:14:09.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:09.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:14:09.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:09.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:14:09.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:09.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:14:10.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:10.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:14:10.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:10.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:14:10.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:10.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:14:10.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:10.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:14:10.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:10.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:10.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:10.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:14:10.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:10.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:14:10.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:10.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:14:10.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:10.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:14:10.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:10.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:14:10.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:10.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:14:10.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:10.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:14:10.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:10.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:14:11.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:11.034 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:11.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:11.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:14:11.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:11.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:14:11.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:14:11.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:11.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:14:11.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:11.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:14:11.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:11.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:14:11.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:11.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:14:11.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:11.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:14:11.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:11.812 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:11.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:11.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:14:11.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:11.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:14:11.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:11.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:14:12.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:12.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:14:12.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:12.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:14:12.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:12.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:14:12.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:12.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:14:12.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:12.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:14:12.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:12.484 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:12.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:12.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:14:12.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:12.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:14:12.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:12.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:14:12.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:12.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:14:12.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:12.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:14:12.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:12.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:14:13.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:13.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:14:13.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:13.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:14:13.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:13.196 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:13.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:13.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:14:13.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:13.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:14:13.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:13.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:14:13.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:13.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:14:13.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:13.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:14:13.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:13.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:14:13.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:13.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:14:13.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:13.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:14:13.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:13.977 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:13.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:13.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:14:14.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:14.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:14:14.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:14.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:14:14.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:14.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:14:14.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:14.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:14:14.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:14.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:14:14.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:14.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:14:14.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:14.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:14:14.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:14.680 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:14.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:14.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:14:14.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:14.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:14:14.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:14.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:14:14.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:14.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:14:15.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:15.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:14:15.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:15.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:14:15.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:15.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:14:15.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:15.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:14:15.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:15.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:15.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:15.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:14:15.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:15.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:14:15.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:15.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:14:15.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:15.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:14:15.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:15.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:14:15.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:15.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:14:15.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:15.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:14:16.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:16.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:14:16.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:16.096 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:16.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:16.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:14:16.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:16.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:14:16.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:16.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:14:16.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:16.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:14:16.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:16.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:14:16.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:16.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:14:16.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:16.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:14:16.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:16.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:14:16.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:16.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:16.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:16.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:14:16.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:16.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:14:16.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:16.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:14:17.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:17.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:14:17.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:17.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:14:17.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:17.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:14:17.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:17.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:14:17.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:17.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:14:17.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:17.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:17.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:17.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:14:17.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:17.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:14:17.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:17.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:14:17.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:17.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:14:17.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:17.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:14:17.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:17.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:14:18.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:18.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:14:18.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:18.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:14:18.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:18.251 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:18.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:18.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:14:18.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:18.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:14:18.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:18.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:14:18.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:18.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:14:18.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:18.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:14:18.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:18.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:14:18.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:18.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:14:18.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:18.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:14:18.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:18.932 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:18.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:18.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:14:19.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:19.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:14:19.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:19.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:14:19.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:19.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:14:19.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:19.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:14:19.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:19.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:14:19.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:19.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:14:19.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:19.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:14:19.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:19.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:19.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:19.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:14:19.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:19.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:14:19.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:19.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:14:19.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:19.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:14:19.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:19.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:14:20.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:20.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:14:20.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:20.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:14:20.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:20.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:14:20.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:20.321 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:20.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:20.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:14:20.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:20.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:14:20.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:20.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:14:20.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:20.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:14:20.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:20.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:14:20.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:20.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:14:20.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:20.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:14:20.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:20.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:14:21.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:21.034 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:21.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:21.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:14:21.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:21.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:14:21.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:21.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:14:21.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:21.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:14:21.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:21.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:14:21.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:21.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:14:21.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:21.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:14:21.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:21.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:14:21.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:21.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:21.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:21.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:14:21.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:21.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:14:21.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:21.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:14:22.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:22.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:14:22.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:22.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:14:22.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:22.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:14:22.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:22.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:14:22.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:22.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:14:22.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:22.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:22.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:22.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:14:22.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:22.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:14:22.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:22.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:14:22.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:22.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:14:22.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:22.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:14:22.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:22.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:14:22.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:22.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:14:23.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:23.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:14:23.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:23.112 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:23.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:23.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:14:23.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:23.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:14:23.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:23.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:14:23.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:23.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:14:23.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:23.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:14:23.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:23.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:14:23.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:23.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:14:23.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:23.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:14:23.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:23.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:23.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:23.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:14:23.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:23.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:14:24.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:24.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:14:24.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:24.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:14:24.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:24.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:14:24.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:24.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:14:24.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:24.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:14:24.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:24.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:14:24.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:24.604 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:24.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:24.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:14:24.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:24.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:14:24.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:24.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:14:24.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:24.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:14:24.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:24.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:14:25.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:25.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:14:25.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:25.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:14:25.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:25.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:14:25.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:25.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:25.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:25.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:14:25.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:25.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:14:25.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:25.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:14:25.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:25.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:14:25.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:25.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:14:25.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:25.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:14:25.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:25.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:14:25.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:25.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:14:26.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:26.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:26.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:26.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:14:26.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:26.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:14:26.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:26.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:14:26.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:26.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:14:26.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:26.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:14:26.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:26.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:14:26.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:26.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:14:26.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:26.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:14:26.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:26.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:26.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:26.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:14:26.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:26.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:14:26.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:26.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:14:27.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:27.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:14:27.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:27.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:14:27.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:27.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:14:27.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:27.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:14:27.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:27.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:14:27.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:27.469 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:27.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:27.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:14:27.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:27.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:14:27.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:27.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:14:27.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:27.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:14:27.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:27.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:14:27.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:27.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:14:28.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:28.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:14:28.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:28.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:14:28.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:28.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:28.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:28.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:14:28.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:28.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:14:28.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:28.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:14:28.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:28.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:14:28.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:28.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:14:28.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:28.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:14:28.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:28.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:14:28.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:28.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:14:28.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:28.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:28.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:28.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:14:28.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:28.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:14:29.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:29.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:14:29.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:29.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:14:29.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:29.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:14:29.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:29.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:14:29.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:29.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:14:29.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:29.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:14:29.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:29.682 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:29.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:29.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:14:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:14:29.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:29.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:14:29.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:29.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:14:30.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:30.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:14:30.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:30.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:14:30.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:30.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:14:30.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:30.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:14:30.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:30.378 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:30.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:30.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:14:30.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:30.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:14:30.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:30.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:14:30.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:30.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:14:30.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:30.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:14:30.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:30.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:14:30.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:30.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:14:31.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:31.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:14:31.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:31.115 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:31.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:31.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:14:31.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:31.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:14:31.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:31.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:14:31.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:31.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:14:31.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:31.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:14:31.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:31.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:14:31.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:31.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:14:31.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:31.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:14:31.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:31.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:31.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:31.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:14:31.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:31.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:14:32.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:32.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:14:32.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:32.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:14:32.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:32.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:14:32.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:32.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:14:32.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:32.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:14:32.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:32.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:14:32.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:32.540 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:32.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:32.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:14:32.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:32.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:14:32.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:32.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:14:32.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:32.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:14:32.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:32.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:14:32.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:32.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:14:33.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:33.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:14:33.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:33.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:14:33.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:33.235 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:33.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:33.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:14:33.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:33.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:14:33.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:33.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:14:33.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:33.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:14:33.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:33.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:14:33.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:33.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:14:33.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:33.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:14:33.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:33.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:14:34.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:34.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:34.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:34.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:14:34.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:34.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:14:34.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:34.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:14:34.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:34.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:14:34.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:34.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:14:35.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:35.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:14:35.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:35.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:14:35.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:35.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:14:35.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:35.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:35.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:35.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:14:35.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:35.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:14:35.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:35.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:14:35.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:35.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:14:35.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:35.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:14:35.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:35.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:14:35.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:35.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:14:35.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:35.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:14:36.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:36.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:36.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:36.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:14:36.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:36.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:14:36.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:36.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:14:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:36.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:14:36.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:36.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:14:36.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:36.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:14:36.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:36.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:14:36.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:36.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:14:36.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:36.769 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:36.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:36.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:14:36.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:36.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:14:36.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:36.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:14:37.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:37.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:14:37.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:37.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:14:37.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:37.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:14:37.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:37.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:14:37.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:37.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:14:37.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:37.451 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:37.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:37.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:14:37.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:37.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:14:37.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:37.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:14:37.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:37.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:14:37.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:37.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:14:37.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:37.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:14:38.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:38.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:14:38.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:38.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:14:38.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:38.199 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:38.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:38.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:14:38.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:38.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:14:38.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:38.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:14:38.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:38.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:14:38.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:38.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:14:38.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:38.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:14:38.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:38.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:14:38.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:38.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:14:38.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:38.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:38.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:38.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:14:38.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:38.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:14:39.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:39.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:14:39.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:39.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:14:39.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:39.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:14:39.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:39.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:14:39.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:39.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:14:39.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:39.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:14:39.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:39.677 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:39.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:39.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:14:39.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:39.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:14:39.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:39.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:14:39.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:39.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:14:40.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:40.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:14:40.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:40.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:14:40.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:40.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:14:40.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:40.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:14:40.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:40.364 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:40.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:40.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:14:40.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:40.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:14:40.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:40.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:14:40.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:40.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:14:40.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:40.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:14:40.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:40.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:14:40.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:40.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:14:40.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:40.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:14:41.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:41.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:41.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:41.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:14:41.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:41.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:14:41.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:41.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:14:41.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:41.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:14:41.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:41.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:14:41.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:41.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:14:41.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:41.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:14:41.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:41.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:14:41.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:41.806 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:41.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:41.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:14:41.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:41.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:14:41.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:41.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:14:42.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:42.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:14:42.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:42.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:14:42.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:42.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:14:42.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:42.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:14:42.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:42.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:14:42.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:42.484 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:42.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:42.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:14:42.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:42.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:14:42.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:42.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:14:42.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:42.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:14:42.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:42.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:14:42.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:42.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:14:43.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:43.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:14:43.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:43.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:14:43.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:43.197 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:43.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:43.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:14:43.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:43.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:14:43.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:43.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:14:43.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:43.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:14:43.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:43.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:14:43.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:43.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:14:43.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:43.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:14:43.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:43.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:14:43.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:43.926 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:43.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:43.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:14:44.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:44.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:14:44.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:44.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:14:44.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:44.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:14:44.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:44.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:14:44.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:44.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:14:44.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:44.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:14:44.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:44.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:14:44.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:44.638 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:44.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:44.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:14:44.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:44.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:14:44.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:44.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:14:44.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:44.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:14:44.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:44.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:14:45.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:45.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:14:45.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:45.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:14:45.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:45.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:14:45.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:45.376 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:45.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:45.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:14:45.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:45.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:14:45.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:45.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:14:45.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:45.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:14:45.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:45.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:14:45.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:45.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:14:45.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:45.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:14:46.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:46.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:14:46.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:46.097 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:46.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:46.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:14:46.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:46.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:14:46.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:46.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:14:46.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:46.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:14:46.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:46.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:14:46.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:46.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:14:46.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:46.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:14:46.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:46.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:14:46.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:46.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:46.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:46.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:14:46.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:46.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:14:46.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:46.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:14:47.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:47.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:14:47.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:47.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:14:47.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:47.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:14:47.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:47.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:14:47.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:47.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:14:47.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:47.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:47.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:47.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:14:47.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:47.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:14:47.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:47.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:14:47.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:47.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:14:47.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:47.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:14:47.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:47.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:14:48.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:48.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:14:48.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:48.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:14:48.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:48.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:48.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:48.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:14:48.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:48.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:14:48.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:48.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:14:48.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:48.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:14:48.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:48.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:14:48.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:48.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:14:48.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:48.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:14:48.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:48.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:14:49.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:49.021 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:49.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:49.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:14:49.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:49.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:14:49.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:49.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:14:49.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:49.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:14:49.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:49.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:14:49.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:49.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:14:49.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:49.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:14:49.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:49.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:14:49.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:49.751 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:49.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:49.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:14:49.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:49.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:14:49.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:49.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:14:50.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:50.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:14:50.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:50.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:14:50.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:50.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:14:50.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:50.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:14:50.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:50.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:14:50.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:50.471 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:50.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:50.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:14:50.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:50.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:14:50.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:50.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:14:50.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:50.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:14:50.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:50.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:14:50.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:50.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:14:51.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:51.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:14:51.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:51.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:14:51.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:51.216 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:51.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:51.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:14:51.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:51.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:14:51.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:51.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:14:51.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:51.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:14:51.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:51.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:14:51.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:51.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:14:51.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:51.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:14:51.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:51.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:14:51.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:51.982 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:51.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:51.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:14:52.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:52.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:14:52.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:52.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:14:52.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:52.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:14:52.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:52.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:14:52.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:52.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:14:52.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:52.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:14:52.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:52.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:14:52.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:52.685 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:52.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:52.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:14:52.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:52.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:14:52.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:52.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:14:52.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:52.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:14:53.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:53.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:14:53.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:53.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:14:53.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:53.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:14:53.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:53.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:14:53.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:53.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:53.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:53.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:14:53.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:53.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:14:53.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:53.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:14:53.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:53.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:14:53.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:53.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:14:53.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:53.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:14:53.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:53.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:14:54.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:54.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:14:54.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:54.126 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:54.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:54.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:14:54.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:54.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:14:54.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:54.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:14:54.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:54.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:14:54.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:54.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:14:54.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:54.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:14:54.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:54.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:14:54.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:54.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:14:54.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:54.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:54.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:54.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:14:54.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:54.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:14:55.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:55.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:14:55.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:55.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:14:55.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:55.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:14:55.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:55.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:14:55.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:55.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:14:55.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:55.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:14:55.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:55.635 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:55.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:55.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:14:55.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:55.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:14:55.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:55.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:14:55.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:55.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:14:55.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:55.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:14:56.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:56.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:14:56.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:56.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:14:56.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:56.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:14:56.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:56.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:56.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:56.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:14:56.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:56.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:14:56.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:56.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:14:56.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:56.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:14:56.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:56.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:14:56.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:56.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:14:56.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:56.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:14:56.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:56.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:14:56.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:56.992 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:56.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:56.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:14:57.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:57.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:14:57.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:57.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:14:57.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:57.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:14:57.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:57.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:14:57.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:57.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:14:57.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:57.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:14:57.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:57.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:14:57.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:57.730 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:57.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:57.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:14:57.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:57.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:14:57.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:57.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:14:57.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:57.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:14:58.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:58.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:14:58.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:58.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:14:58.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:58.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:14:58.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:58.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:14:58.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:58.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:58.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:58.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:14:58.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:58.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:14:58.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:58.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:14:58.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:58.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:14:58.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:58.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:14:58.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:58.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:14:58.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:58.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:14:59.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:59.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:14:59.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:59.112 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:59.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:59.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:14:59.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:59.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:14:59.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:59.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:14:59.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:59.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:14:59.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:59.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:14:59.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:59.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:14:59.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:59.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:14:59.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:59.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:14:59.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:14:59.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:14:59.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:59.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:14:59.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:14:59.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:15:00.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:00.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:15:00.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:00.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:15:00.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:00.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:15:00.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:00.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:15:00.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:00.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:15:00.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:00.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:15:00.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:00.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:00.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:00.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:15:00.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:00.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:15:00.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:00.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:15:00.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:00.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:15:00.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:00.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:15:01.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:01.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:15:01.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:01.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:15:01.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:01.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:15:01.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:01.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:01.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:01.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:15:01.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:01.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:15:01.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:01.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:15:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:01.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:15:01.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:01.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:15:01.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:01.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:15:01.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:01.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:15:01.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:01.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:15:02.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:02.054 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:02.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:02.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:15:02.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:02.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:15:02.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:02.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:15:02.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:02.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:15:02.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:02.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:15:02.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:02.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:15:02.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:02.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:15:02.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:02.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:15:02.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:02.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:02.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:02.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:15:02.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:02.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:15:02.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:02.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:15:03.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:03.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:15:03.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:03.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:15:03.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:03.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:15:03.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:03.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:15:03.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:03.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:15:03.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:03.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:03.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:03.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:15:03.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:03.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:15:03.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:03.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:15:03.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:03.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:15:03.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:03.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:15:03.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:03.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:15:03.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:03.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:15:04.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:04.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:15:04.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:04.149 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:04.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:04.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:15:04.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:04.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:15:04.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:04.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:15:04.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:04.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:15:04.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:04.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:15:04.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:04.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:15:04.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:04.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:15:04.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:04.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:15:04.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:04.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:04.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:04.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:15:04.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:04.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:15:05.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:05.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:15:05.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:05.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:15:05.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:05.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:15:05.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:05.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:15:05.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:05.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:15:05.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:05.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:15:05.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:05.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:05.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:05.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:15:06.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:06.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:15:06.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:06.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:15:06.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:06.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:15:06.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:06.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:15:06.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:06.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:15:06.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:06.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:15:06.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:06.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:15:06.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:06.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:06.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:06.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:15:06.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:06.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:15:07.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:07.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:15:07.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:07.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:15:07.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:07.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:15:07.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:07.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:15:07.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:07.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:15:07.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:07.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:15:07.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:07.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:07.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:07.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:15:07.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:07.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:15:07.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:07.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:15:07.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:07.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:15:07.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:07.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:15:08.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:08.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:15:08.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:08.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:15:08.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:08.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:15:08.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:08.312 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:08.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:08.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:15:08.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:08.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:15:08.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:08.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:15:08.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:08.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:15:08.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:08.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:15:08.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:08.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:15:08.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:08.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:15:08.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:08.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:15:09.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:09.041 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:09.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:09.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:15:09.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:09.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:15:09.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:09.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:15:09.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:09.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:15:09.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:09.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:15:09.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:09.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:15:09.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:09.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:15:09.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:09.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:15:09.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:09.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:09.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:09.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:15:09.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:09.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:15:09.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:09.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:15:09.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:09.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:15:10.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:10.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:15:10.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:10.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:15:10.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:10.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:15:10.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:10.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:15:10.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:10.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:10.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:10.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:15:10.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:10.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:15:10.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:10.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:15:10.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:10.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:15:10.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:10.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:15:10.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:10.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:15:10.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:10.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:15:11.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:11.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:15:11.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:11.102 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:11.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:11.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:15:11.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:11.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:15:11.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:11.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:15:11.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:11.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:15:11.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:11.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:15:11.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:11.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:15:11.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:11.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:15:11.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:11.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:15:11.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:11.907 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:11.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:11.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:15:11.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:11.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:15:12.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:12.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:15:12.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:12.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:15:12.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:12.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:15:12.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:12.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:15:12.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:12.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:15:12.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:12.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:15:12.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:12.614 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:12.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:12.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:15:12.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:12.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:15:12.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:12.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:15:12.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:12.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:15:12.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:12.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:15:13.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:13.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:15:13.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:13.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:15:13.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:13.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:15:13.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:13.298 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:13.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:13.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:15:13.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:13.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:15:13.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:13.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:15:13.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:13.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:15:13.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:13.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:15:13.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:13.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:15:13.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:13.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:15:13.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:13.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:15:14.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:14.044 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:14.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:14.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:15:14.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:14.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:15:14.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:14.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:15:14.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:14.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:15:14.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:14.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:15:14.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:14.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:15:14.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:14.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:15:14.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:14.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:15:14.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:14.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:14.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:14.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:15:14.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:14.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:15:14.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:14.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:15:15.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:15.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:15:15.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:15.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:15:15.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:15.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:15:15.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:15.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:15:15.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:15.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:15:15.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:15.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:15.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:15.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:15:15.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:15.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:15:15.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:15.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:15:15.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:15.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:15:15.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:15.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:15:15.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:15.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:15:15.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:15.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:15:16.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:16.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:15:16.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:16.155 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:16.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:16.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:15:16.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:16.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:15:16.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:16.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:15:16.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:16.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:15:16.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:16.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:15:16.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:16.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:15:16.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:16.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:15:16.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:16.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:15:16.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:16.976 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:16.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:16.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:15:17.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:17.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:15:17.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:17.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:15:17.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:17.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:15:17.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:17.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:15:17.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:17.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:15:17.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:17.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:15:17.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:17.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:15:17.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:17.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:17.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:17.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:15:17.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:17.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:15:17.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:17.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:15:17.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:17.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:15:18.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:18.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:15:18.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:18.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:15:18.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:18.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:15:18.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:18.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:15:18.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:18.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:18.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:18.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:15:18.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:18.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:15:18.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:18.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:15:18.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:18.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:15:18.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:18.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:15:18.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:18.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:15:18.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:18.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:15:19.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:19.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:15:19.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:19.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:19.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:19.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:15:19.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:19.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:15:19.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:19.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:15:19.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:19.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:15:19.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:19.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:15:19.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:19.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:15:19.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:19.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:15:19.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:19.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:15:19.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:19.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:19.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:19.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:15:19.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:19.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:15:19.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:19.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:15:20.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:20.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:15:20.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:20.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:15:20.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:20.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:15:20.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:20.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:15:20.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:20.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:15:20.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:20.486 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:20.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:20.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:15:20.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:20.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:15:20.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:20.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:15:20.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:20.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:15:20.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:20.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:15:20.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:20.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:15:21.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:21.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:15:21.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:21.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:15:21.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:21.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:21.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:21.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:15:21.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:21.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:15:21.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:21.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:15:21.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:21.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:15:21.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:21.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:15:21.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:21.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:15:21.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:21.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:15:21.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:21.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:15:21.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:21.978 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:21.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:21.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:15:22.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:22.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:15:22.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:22.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:15:22.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:22.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:15:22.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:22.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:15:22.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:22.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:15:22.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:22.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:15:22.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:22.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:15:22.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:22.673 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:22.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:22.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:15:22.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:22.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:15:22.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:22.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:15:22.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:22.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:15:22.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:22.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:15:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:15:23.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:23.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:15:23.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:23.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:15:23.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:23.327 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:23.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:23.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:15:23.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:23.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:15:23.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:23.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:15:23.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:23.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:15:23.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:23.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:15:23.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:23.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:15:23.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:23.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:15:23.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:23.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:15:24.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:24.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:24.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:24.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:15:24.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:24.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:15:24.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:24.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:15:24.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:24.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:15:24.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:24.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:15:24.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:24.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:15:24.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:24.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:15:24.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:24.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:15:24.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:24.709 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:24.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:24.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:15:24.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:24.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:15:24.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:24.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:15:24.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:24.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:15:25.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:25.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:15:25.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:25.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:15:25.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:25.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:15:25.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:25.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:15:25.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:25.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:25.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:25.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:15:25.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:25.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:15:25.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:25.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:15:25.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:25.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:15:25.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:25.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:15:25.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:25.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:15:25.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:25.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:15:26.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:26.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:15:26.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:26.100 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:26.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:26.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:15:26.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:26.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:15:26.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:26.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:15:26.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:26.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:15:26.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:26.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:15:26.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:26.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:15:26.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:26.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:15:26.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:26.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:15:26.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:26.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:26.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:26.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:15:26.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:26.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:15:27.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:27.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:15:27.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:27.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:15:27.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:27.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:15:27.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:27.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:15:27.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:27.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:15:27.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:27.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:15:27.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:27.533 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:27.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:27.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:15:27.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:27.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:15:27.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:27.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:15:27.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:27.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:15:27.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:27.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:15:27.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:27.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:15:28.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:28.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:15:28.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:28.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:15:28.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:28.177 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:28.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:28.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:15:28.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:28.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:15:28.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:28.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:15:28.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:28.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:15:28.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:28.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:15:28.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:28.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:15:28.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:28.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:15:28.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:28.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:15:28.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:28.882 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:28.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:28.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:15:28.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:28.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:15:29.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:29.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:15:29.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:29.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:15:29.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:29.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:15:29.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:29.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:15:29.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:29.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:15:29.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:29.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:15:29.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:29.543 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:29.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:29.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:15:29.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:29.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:15:29.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:29.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:15:29.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:29.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:15:29.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:29.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:15:29.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:29.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:15:30.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:30.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:15:30.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:30.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:15:30.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:30.189 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:30.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:30.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:15:30.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:30.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:15:30.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:30.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:15:30.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:30.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:15:30.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:30.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:15:30.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:30.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:15:30.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:30.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:15:30.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:30.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:15:30.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:30.850 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:30.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:30.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:15:30.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:30.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:15:31.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:31.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:15:31.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:31.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:15:31.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:31.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:15:31.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:31.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:15:31.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:31.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:15:31.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:31.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:15:31.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:31.462 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:31.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:31.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:15:31.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:31.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:15:31.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:31.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:15:31.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:31.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:15:31.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:31.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:15:31.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:31.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:15:32.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:32.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:15:32.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:32.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:15:32.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:32.191 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:32.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:32.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:15:32.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:32.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:15:32.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:32.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:15:32.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:32.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:15:32.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:32.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:15:32.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:32.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:15:32.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:32.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:15:32.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:32.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:15:32.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:32.844 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:32.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:32.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:15:32.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:32.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:15:33.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:33.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:15:33.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:33.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:15:33.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:33.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:15:33.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:33.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:15:33.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:33.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:15:33.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:33.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:15:33.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:33.514 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:33.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:33.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:15:33.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:33.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:15:33.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:33.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:15:33.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:33.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:15:33.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:33.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:15:33.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:33.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:15:34.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:34.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:15:34.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:34.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:15:34.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:34.168 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:34.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:34.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:15:34.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:34.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:15:34.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:34.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:15:34.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:34.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:15:34.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:34.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:15:34.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:34.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:15:34.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:34.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:15:34.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:34.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:15:34.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:34.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:34.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:34.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:15:34.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:34.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:15:35.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:35.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:15:35.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:35.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:15:35.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:35.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:15:35.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:35.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:15:35.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:35.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:15:35.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:35.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:15:35.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:35.499 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:35.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:35.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:15:35.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:35.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:15:35.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:35.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:15:35.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:35.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:15:35.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:35.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:15:35.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:35.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:15:36.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:36.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:15:36.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:36.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:15:36.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:36.144 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:36.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:36.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:15:36.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:36.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:15:36.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:36.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:15:36.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:36.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:15:36.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:36.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:15:36.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:36.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:15:36.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:36.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:15:36.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:36.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:15:37.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:37.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:37.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:37.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:15:37.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:37.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:15:37.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:37.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:15:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:37.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:15:37.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:37.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:15:37.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:37.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:15:37.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:37.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:15:37.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:37.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:15:38.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:38.011 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:38.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:38.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:15:38.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:38.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:15:38.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:38.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:15:38.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:38.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:15:38.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:38.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:15:38.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:38.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:15:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:15:38.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:38.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:15:38.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:38.681 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:38.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:38.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:15:38.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:38.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:15:38.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:38.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:15:38.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:38.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:15:39.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:39.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:15:39.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:39.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:15:39.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:39.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:15:39.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:39.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:15:39.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:39.301 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:39.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:39.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:15:39.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:39.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:15:39.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:39.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:15:39.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:39.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:15:39.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:39.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:15:39.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:39.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:15:39.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:39.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:15:39.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:39.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:15:40.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:40.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:40.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:15:40.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:15:40.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:15:40.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:15:40.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:15:40.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:15:40.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:15:40.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:15:40.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:40.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:40.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:15:40.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:15:40.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:15:40.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:15:40.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:40.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:15:41.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:15:41.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:15:41.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:15:41.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:41.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:41.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:15:41.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:15:41.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:15:41.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:15:41.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:15:41.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:15:41.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:15:41.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:15:41.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:41.906 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:41.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:15:41.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:41.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:15:42.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:42.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:15:42.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:42.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:15:42.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:42.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:15:42.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:42.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:15:42.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:42.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:15:42.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:42.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:15:42.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:42.542 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:42.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:42.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:15:42.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:42.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:15:42.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:42.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:15:42.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:42.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:15:42.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:42.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:15:42.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:42.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:15:43.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:43.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:15:43.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:43.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:15:43.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:43.137 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:43.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:43.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:15:43.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:43.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:15:43.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:43.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:15:43.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:43.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:15:43.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:43.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:15:43.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:43.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:15:43.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:43.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:15:43.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:43.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:15:43.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:43.926 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:43.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:43.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:15:44.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:15:44.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:15:44.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:15:44.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:15:44.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:15:44.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:15:44.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:15:44.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:44.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:44.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:15:44.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:15:44.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:15:44.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:15:44.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:15:44.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:44.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:15:45.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:15:45.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:15:45.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:45.148 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:45.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:15:45.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:15:45.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:15:45.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:15:45.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:15:45.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:15:45.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:15:45.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:15:45.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:45.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:45.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:15:45.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:15:45.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:45.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:15:46.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:15:46.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:15:46.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:15:46.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:15:46.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:15:46.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:46.370 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:46.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:15:46.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:15:46.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:15:46.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:15:46.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:15:46.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:15:46.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:15:46.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:15:46.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:46.973 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:46.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:46.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:15:47.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:47.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:15:47.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:47.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:15:47.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:47.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:15:47.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:47.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:15:47.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:47.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:15:47.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:47.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:15:47.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:47.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:15:47.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:47.644 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:47.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:47.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:15:47.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:47.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:15:47.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:47.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:15:47.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:47.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:15:47.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:47.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:15:48.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:15:48.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:15:48.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:15:48.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:48.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:48.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:15:48.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:15:48.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:15:48.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:15:48.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:15:48.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:15:48.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:15:48.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:15:48.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:48.883 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:48.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:15:48.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:48.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:15:49.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:15:49.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:15:49.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:15:49.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:15:49.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:15:49.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:15:49.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:49.464 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:49.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:15:49.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:15:49.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:15:49.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:15:49.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:15:49.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:15:49.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:15:49.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:49.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:15:50.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:50.063 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:50.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:15:50.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:15:50.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:15:50.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:15:50.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:15:50.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:15:50.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:15:50.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:15:50.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:50.700 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:50.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:15:50.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:15:50.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:15:50.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:15:50.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:50.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:15:51.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:51.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:15:51.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:51.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:15:51.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:51.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:15:51.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:51.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:51.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:51.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:15:51.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:51.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:15:51.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:51.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:15:51.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:51.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:15:51.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:51.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:15:51.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:51.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:15:51.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:51.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:15:51.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:51.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:15:51.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:51.989 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:51.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:51.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:15:52.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:52.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:15:52.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:52.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:15:52.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:52.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:15:52.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:52.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:15:52.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:52.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:15:52.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:52.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:15:52.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:52.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:15:52.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:52.559 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:52.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:52.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:15:52.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:52.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:15:52.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:52.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:15:52.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:52.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:15:52.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:52.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:15:53.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:15:53.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:15:53.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:15:53.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:53.245 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:53.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:15:53.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:15:53.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:15:53.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:15:53.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:15:53.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:15:53.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:15:53.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:15:53.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:53.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:53.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:15:53.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:53.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:15:54.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:15:54.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:15:54.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:15:54.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:15:54.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:15:54.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:15:54.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:54.431 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:54.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:15:54.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:15:54.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:15:54.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:15:54.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:15:54.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:15:54.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:15:54.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:54.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:15:55.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:55.062 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:55.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:15:55.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:15:55.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:15:55.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:15:55.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:15:55.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:15:55.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:15:55.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:15:55.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:55.679 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:55.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:15:55.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:15:55.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:15:55.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:15:55.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:55.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:15:56.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:15:56.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:15:56.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:15:56.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:56.243 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:56.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:15:56.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:15:56.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:15:56.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:15:56.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:15:56.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:15:56.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:15:56.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:15:56.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:56.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:56.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:15:56.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:56.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:15:57.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:15:57.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:15:57.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:15:57.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:15:57.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:15:57.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:15:57.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:57.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:57.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:15:57.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:15:57.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:15:57.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:15:57.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:15:57.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:15:57.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:57.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:15:58.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:15:58.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:58.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:58.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:15:58.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:15:58.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:15:58.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:15:58.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:15:58.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:15:58.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:15:58.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:15:58.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:58.722 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:58.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:15:58.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:15:58.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:15:58.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:15:58.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:58.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:15:59.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:15:59.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:15:59.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:15:59.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:59.283 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:59.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:15:59.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:15:59.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:15:59.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:15:59.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:15:59.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:15:59.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:15:59.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:15:59.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:15:59.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:15:59.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:15:59.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:15:59.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:16:00.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:16:00.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:16:00.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:16:00.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:16:00.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:16:00.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:16:00.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:00.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:00.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:16:00.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:16:00.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:16:00.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:16:00.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:16:00.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:16:00.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:00.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:16:01.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:16:01.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:01.100 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:01.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:16:01.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:16:01.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:16:01.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:16:01.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:16:01.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:16:01.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:16:01.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:16:01.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:01.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:01.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:16:01.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:16:01.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:16:01.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:01.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:16:02.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:02.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:16:02.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:02.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:16:02.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:02.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:16:02.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:02.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:16:02.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:02.331 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:02.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:02.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:16:02.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:02.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:16:02.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:02.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:16:02.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:02.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:16:02.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:02.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:16:02.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:02.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:16:02.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:02.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:16:02.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:02.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:16:03.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:03.085 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:03.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:16:03.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:16:03.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:16:03.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:16:03.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:16:03.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:16:03.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:16:03.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:16:03.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:03.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:03.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:16:03.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:16:03.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:16:03.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:16:03.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:03.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:16:04.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:16:04.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:16:04.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:16:04.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:04.265 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:04.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:16:04.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:16:04.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:16:04.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:16:04.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:16:04.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:16:04.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:16:04.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:16:04.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:04.918 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:04.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:16:04.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:04.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:16:05.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:05.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:16:05.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:05.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:16:05.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:05.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:16:05.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:05.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:16:05.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:05.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:16:05.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:05.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:16:05.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:05.589 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:05.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:05.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:16:05.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:05.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:16:05.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:05.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:16:05.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:05.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:16:05.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:05.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:16:05.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:05.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:16:06.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:16:06.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:16:06.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:06.166 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:06.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:16:06.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:16:06.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:16:06.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:16:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:16:06.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:16:06.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:16:06.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:16:06.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:06.777 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:06.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:16:06.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:16:06.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:06.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:16:07.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:16:07.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:16:07.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:16:07.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:16:07.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:16:07.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:07.396 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:07.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:16:07.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:16:07.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:16:07.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:16:07.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:16:07.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:16:07.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:16:07.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:07.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:16:08.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:08.410 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:08.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:08.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:16:08.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:08.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:16:08.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:08.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:16:08.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:08.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:16:08.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:08.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:16:08.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:08.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:16:09.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:16:09.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:16:09.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:09.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:09.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:16:09.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:16:09.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:16:09.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:16:09.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:16:09.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:16:09.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:16:09.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:16:09.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:09.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:09.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:16:09.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:16:09.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:09.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:16:10.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:16:10.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:16:10.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:16:10.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:16:10.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:16:10.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:10.401 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:10.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:16:10.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:16:10.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:16:10.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:16:10.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:16:10.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:16:10.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:16:10.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:10.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:16:11.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:11.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:11.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:16:11.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:16:11.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:16:11.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:16:11.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:16:11.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:16:11.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:16:11.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:16:11.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:11.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:11.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:16:11.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:16:11.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:16:11.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:16:11.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:11.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:16:12.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:16:12.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:16:12.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:16:12.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:12.260 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:12.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:16:12.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:16:12.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:16:12.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:16:12.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:16:12.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:16:12.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:16:12.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:16:12.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:12.879 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:12.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:16:12.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:12.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:16:13.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:16:13.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:16:13.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:16:13.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:16:13.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:16:13.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:16:13.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:13.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:13.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:16:13.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:16:13.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:16:13.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:16:13.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:16:13.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:16:13.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:13.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:16:14.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:16:14.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:14.094 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:14.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:16:14.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:16:14.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:16:14.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:16:14.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:16:14.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:16:14.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:16:14.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:16:14.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:14.696 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:14.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:16:14.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:16:14.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:16:14.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:16:14.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:14.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:16:15.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:16:15.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:16:15.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:16:15.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:15.257 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:15.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:16:15.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:16:15.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:16:15.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:16:15.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:16:15.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:16:15.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:16:15.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:16:15.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:15.927 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:15.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:16:15.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:15.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:16:16.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:16:16.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:16:16.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:16:16.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:16:16.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:16:16.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:16:16.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:16.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:16.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:16:16.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:16:16.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:16:16.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:16:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:16:16.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:16:16.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:16.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:16:17.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:16:17.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:17.107 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:17.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:16:17.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:16:17.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:16:17.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:16:17.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:16:17.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:16:17.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:16:17.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:16:17.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:17.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:17.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:16:17.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:16:17.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:16:17.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:17.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:16:18.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:16:18.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:16:18.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:16:18.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:16:18.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:18.288 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:18.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:16:18.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:16:18.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:16:18.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:16:18.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:16:18.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:16:18.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:16:18.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:16:18.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:18.916 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:18.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:16:18.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:18.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:16:19.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:16:19.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:16:19.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:16:19.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:16:19.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:16:19.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:16:19.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:19.473 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:19.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:16:19.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:16:19.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:16:19.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:16:19.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:16:19.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:16:19.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:16:19.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:19.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:16:20.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:20.063 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:20.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:16:20.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:16:20.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:16:20.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:16:20.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:16:20.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:16:20.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:16:20.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:16:20.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:20.624 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:20.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:16:20.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:16:20.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:16:20.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:16:20.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:20.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:16:21.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:16:21.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:16:21.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:16:21.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:21.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:21.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:16:21.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:16:21.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:16:21.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:16:21.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:16:21.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:16:21.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:16:21.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:16:21.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:21.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:21.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:16:21.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:16:21.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:21.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:16:22.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:16:22.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:16:22.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:16:22.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:16:22.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:16:22.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:22.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:22.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:16:22.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:16:22.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:16:22.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:16:22.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:16:22.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:16:22.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:16:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:16:22.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:22.960 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:22.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:22.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:16:23.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:16:23.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:16:23.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:16:23.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:16:23.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:16:23.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:16:23.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:16:23.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:23.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:23.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:16:23.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:16:23.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:16:23.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:16:23.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:16:23.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:23.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:16:24.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:16:24.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:16:24.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:24.183 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:24.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:16:24.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:16:24.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:16:24.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:16:24.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:16:24.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:16:24.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:16:24.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:16:24.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:24.752 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:24.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:16:24.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:16:24.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:16:24.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:24.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:16:25.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:16:25.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:16:25.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:16:25.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:16:25.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:25.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:25.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj201 td/osd-backfill-space/datafile 2024-09-16T04:16:25.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj201 td/osd-backfill-space/datafile 2024-09-16T04:16:25.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj201 td/osd-backfill-space/datafile 2024-09-16T04:16:25.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj201 td/osd-backfill-space/datafile 2024-09-16T04:16:25.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj201 td/osd-backfill-space/datafile 2024-09-16T04:16:25.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj201 td/osd-backfill-space/datafile 2024-09-16T04:16:25.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj201 td/osd-backfill-space/datafile 2024-09-16T04:16:25.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj201 td/osd-backfill-space/datafile 2024-09-16T04:16:25.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:25.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:25.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:25.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj202 td/osd-backfill-space/datafile 2024-09-16T04:16:25.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj202 td/osd-backfill-space/datafile 2024-09-16T04:16:26.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj202 td/osd-backfill-space/datafile 2024-09-16T04:16:26.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj202 td/osd-backfill-space/datafile 2024-09-16T04:16:26.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj202 td/osd-backfill-space/datafile 2024-09-16T04:16:26.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj202 td/osd-backfill-space/datafile 2024-09-16T04:16:26.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj202 td/osd-backfill-space/datafile 2024-09-16T04:16:26.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj202 td/osd-backfill-space/datafile 2024-09-16T04:16:26.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:26.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:26.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj203 td/osd-backfill-space/datafile 2024-09-16T04:16:26.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj203 td/osd-backfill-space/datafile 2024-09-16T04:16:26.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj203 td/osd-backfill-space/datafile 2024-09-16T04:16:26.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj203 td/osd-backfill-space/datafile 2024-09-16T04:16:26.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj203 td/osd-backfill-space/datafile 2024-09-16T04:16:26.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj203 td/osd-backfill-space/datafile 2024-09-16T04:16:26.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:26.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj203 td/osd-backfill-space/datafile 2024-09-16T04:16:27.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj203 td/osd-backfill-space/datafile 2024-09-16T04:16:27.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:27.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:27.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj204 td/osd-backfill-space/datafile 2024-09-16T04:16:27.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj204 td/osd-backfill-space/datafile 2024-09-16T04:16:27.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj204 td/osd-backfill-space/datafile 2024-09-16T04:16:27.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj204 td/osd-backfill-space/datafile 2024-09-16T04:16:27.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj204 td/osd-backfill-space/datafile 2024-09-16T04:16:27.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj204 td/osd-backfill-space/datafile 2024-09-16T04:16:27.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj204 td/osd-backfill-space/datafile 2024-09-16T04:16:27.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj204 td/osd-backfill-space/datafile 2024-09-16T04:16:27.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:27.700 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:27.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj205 td/osd-backfill-space/datafile 2024-09-16T04:16:27.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj205 td/osd-backfill-space/datafile 2024-09-16T04:16:27.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj205 td/osd-backfill-space/datafile 2024-09-16T04:16:27.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj205 td/osd-backfill-space/datafile 2024-09-16T04:16:27.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:27.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj205 td/osd-backfill-space/datafile 2024-09-16T04:16:28.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj205 td/osd-backfill-space/datafile 2024-09-16T04:16:28.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj205 td/osd-backfill-space/datafile 2024-09-16T04:16:28.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj205 td/osd-backfill-space/datafile 2024-09-16T04:16:28.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:28.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:28.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj206 td/osd-backfill-space/datafile 2024-09-16T04:16:28.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj206 td/osd-backfill-space/datafile 2024-09-16T04:16:28.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj206 td/osd-backfill-space/datafile 2024-09-16T04:16:28.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj206 td/osd-backfill-space/datafile 2024-09-16T04:16:28.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj206 td/osd-backfill-space/datafile 2024-09-16T04:16:28.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj206 td/osd-backfill-space/datafile 2024-09-16T04:16:28.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj206 td/osd-backfill-space/datafile 2024-09-16T04:16:28.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj206 td/osd-backfill-space/datafile 2024-09-16T04:16:28.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:28.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:28.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj207 td/osd-backfill-space/datafile 2024-09-16T04:16:28.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj207 td/osd-backfill-space/datafile 2024-09-16T04:16:28.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:28.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj207 td/osd-backfill-space/datafile 2024-09-16T04:16:29.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj207 td/osd-backfill-space/datafile 2024-09-16T04:16:29.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj207 td/osd-backfill-space/datafile 2024-09-16T04:16:29.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj207 td/osd-backfill-space/datafile 2024-09-16T04:16:29.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj207 td/osd-backfill-space/datafile 2024-09-16T04:16:29.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj207 td/osd-backfill-space/datafile 2024-09-16T04:16:29.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:29.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:29.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj208 td/osd-backfill-space/datafile 2024-09-16T04:16:29.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj208 td/osd-backfill-space/datafile 2024-09-16T04:16:29.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj208 td/osd-backfill-space/datafile 2024-09-16T04:16:29.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj208 td/osd-backfill-space/datafile 2024-09-16T04:16:29.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj208 td/osd-backfill-space/datafile 2024-09-16T04:16:29.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj208 td/osd-backfill-space/datafile 2024-09-16T04:16:29.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj208 td/osd-backfill-space/datafile 2024-09-16T04:16:29.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:29.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj208 td/osd-backfill-space/datafile 2024-09-16T04:16:30.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:30.051 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:30.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj209 td/osd-backfill-space/datafile 2024-09-16T04:16:30.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj209 td/osd-backfill-space/datafile 2024-09-16T04:16:30.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj209 td/osd-backfill-space/datafile 2024-09-16T04:16:30.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj209 td/osd-backfill-space/datafile 2024-09-16T04:16:30.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj209 td/osd-backfill-space/datafile 2024-09-16T04:16:30.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj209 td/osd-backfill-space/datafile 2024-09-16T04:16:30.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj209 td/osd-backfill-space/datafile 2024-09-16T04:16:30.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj209 td/osd-backfill-space/datafile 2024-09-16T04:16:30.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:30.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:30.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj210 td/osd-backfill-space/datafile 2024-09-16T04:16:30.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj210 td/osd-backfill-space/datafile 2024-09-16T04:16:30.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj210 td/osd-backfill-space/datafile 2024-09-16T04:16:30.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj210 td/osd-backfill-space/datafile 2024-09-16T04:16:30.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj210 td/osd-backfill-space/datafile 2024-09-16T04:16:30.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:30.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj210 td/osd-backfill-space/datafile 2024-09-16T04:16:31.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj210 td/osd-backfill-space/datafile 2024-09-16T04:16:31.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj210 td/osd-backfill-space/datafile 2024-09-16T04:16:31.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:31.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:31.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj211 td/osd-backfill-space/datafile 2024-09-16T04:16:31.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj211 td/osd-backfill-space/datafile 2024-09-16T04:16:31.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj211 td/osd-backfill-space/datafile 2024-09-16T04:16:31.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj211 td/osd-backfill-space/datafile 2024-09-16T04:16:31.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj211 td/osd-backfill-space/datafile 2024-09-16T04:16:31.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj211 td/osd-backfill-space/datafile 2024-09-16T04:16:31.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj211 td/osd-backfill-space/datafile 2024-09-16T04:16:31.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj211 td/osd-backfill-space/datafile 2024-09-16T04:16:31.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:31.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:31.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj212 td/osd-backfill-space/datafile 2024-09-16T04:16:31.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj212 td/osd-backfill-space/datafile 2024-09-16T04:16:31.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj212 td/osd-backfill-space/datafile 2024-09-16T04:16:31.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:31.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj212 td/osd-backfill-space/datafile 2024-09-16T04:16:32.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj212 td/osd-backfill-space/datafile 2024-09-16T04:16:32.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj212 td/osd-backfill-space/datafile 2024-09-16T04:16:32.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj212 td/osd-backfill-space/datafile 2024-09-16T04:16:32.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj212 td/osd-backfill-space/datafile 2024-09-16T04:16:32.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:32.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:32.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj213 td/osd-backfill-space/datafile 2024-09-16T04:16:32.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj213 td/osd-backfill-space/datafile 2024-09-16T04:16:32.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj213 td/osd-backfill-space/datafile 2024-09-16T04:16:32.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj213 td/osd-backfill-space/datafile 2024-09-16T04:16:32.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj213 td/osd-backfill-space/datafile 2024-09-16T04:16:32.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj213 td/osd-backfill-space/datafile 2024-09-16T04:16:32.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj213 td/osd-backfill-space/datafile 2024-09-16T04:16:32.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj213 td/osd-backfill-space/datafile 2024-09-16T04:16:32.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:32.883 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:32.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj214 td/osd-backfill-space/datafile 2024-09-16T04:16:32.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:32.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj214 td/osd-backfill-space/datafile 2024-09-16T04:16:33.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj214 td/osd-backfill-space/datafile 2024-09-16T04:16:33.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj214 td/osd-backfill-space/datafile 2024-09-16T04:16:33.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj214 td/osd-backfill-space/datafile 2024-09-16T04:16:33.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj214 td/osd-backfill-space/datafile 2024-09-16T04:16:33.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj214 td/osd-backfill-space/datafile 2024-09-16T04:16:33.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj214 td/osd-backfill-space/datafile 2024-09-16T04:16:33.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:33.410 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:33.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj215 td/osd-backfill-space/datafile 2024-09-16T04:16:33.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj215 td/osd-backfill-space/datafile 2024-09-16T04:16:33.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj215 td/osd-backfill-space/datafile 2024-09-16T04:16:33.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj215 td/osd-backfill-space/datafile 2024-09-16T04:16:33.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj215 td/osd-backfill-space/datafile 2024-09-16T04:16:33.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj215 td/osd-backfill-space/datafile 2024-09-16T04:16:33.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj215 td/osd-backfill-space/datafile 2024-09-16T04:16:33.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:33.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj215 td/osd-backfill-space/datafile 2024-09-16T04:16:34.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:34.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:34.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj216 td/osd-backfill-space/datafile 2024-09-16T04:16:34.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj216 td/osd-backfill-space/datafile 2024-09-16T04:16:34.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj216 td/osd-backfill-space/datafile 2024-09-16T04:16:34.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj216 td/osd-backfill-space/datafile 2024-09-16T04:16:34.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj216 td/osd-backfill-space/datafile 2024-09-16T04:16:34.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj216 td/osd-backfill-space/datafile 2024-09-16T04:16:34.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj216 td/osd-backfill-space/datafile 2024-09-16T04:16:34.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj216 td/osd-backfill-space/datafile 2024-09-16T04:16:34.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:34.700 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:34.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj217 td/osd-backfill-space/datafile 2024-09-16T04:16:34.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj217 td/osd-backfill-space/datafile 2024-09-16T04:16:34.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj217 td/osd-backfill-space/datafile 2024-09-16T04:16:34.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj217 td/osd-backfill-space/datafile 2024-09-16T04:16:34.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:34.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj217 td/osd-backfill-space/datafile 2024-09-16T04:16:35.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj217 td/osd-backfill-space/datafile 2024-09-16T04:16:35.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj217 td/osd-backfill-space/datafile 2024-09-16T04:16:35.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj217 td/osd-backfill-space/datafile 2024-09-16T04:16:35.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:35.260 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:35.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj218 td/osd-backfill-space/datafile 2024-09-16T04:16:35.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj218 td/osd-backfill-space/datafile 2024-09-16T04:16:35.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj218 td/osd-backfill-space/datafile 2024-09-16T04:16:35.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj218 td/osd-backfill-space/datafile 2024-09-16T04:16:35.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj218 td/osd-backfill-space/datafile 2024-09-16T04:16:35.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj218 td/osd-backfill-space/datafile 2024-09-16T04:16:35.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj218 td/osd-backfill-space/datafile 2024-09-16T04:16:35.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj218 td/osd-backfill-space/datafile 2024-09-16T04:16:35.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:35.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:35.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj219 td/osd-backfill-space/datafile 2024-09-16T04:16:35.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj219 td/osd-backfill-space/datafile 2024-09-16T04:16:35.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:35.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj219 td/osd-backfill-space/datafile 2024-09-16T04:16:36.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj219 td/osd-backfill-space/datafile 2024-09-16T04:16:36.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj219 td/osd-backfill-space/datafile 2024-09-16T04:16:36.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj219 td/osd-backfill-space/datafile 2024-09-16T04:16:36.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj219 td/osd-backfill-space/datafile 2024-09-16T04:16:36.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj219 td/osd-backfill-space/datafile 2024-09-16T04:16:36.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:36.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:36.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj220 td/osd-backfill-space/datafile 2024-09-16T04:16:36.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj220 td/osd-backfill-space/datafile 2024-09-16T04:16:36.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj220 td/osd-backfill-space/datafile 2024-09-16T04:16:36.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj220 td/osd-backfill-space/datafile 2024-09-16T04:16:36.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj220 td/osd-backfill-space/datafile 2024-09-16T04:16:36.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj220 td/osd-backfill-space/datafile 2024-09-16T04:16:36.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj220 td/osd-backfill-space/datafile 2024-09-16T04:16:36.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj220 td/osd-backfill-space/datafile 2024-09-16T04:16:36.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:36.951 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:36.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:36.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj221 td/osd-backfill-space/datafile 2024-09-16T04:16:37.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj221 td/osd-backfill-space/datafile 2024-09-16T04:16:37.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj221 td/osd-backfill-space/datafile 2024-09-16T04:16:37.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj221 td/osd-backfill-space/datafile 2024-09-16T04:16:37.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj221 td/osd-backfill-space/datafile 2024-09-16T04:16:37.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj221 td/osd-backfill-space/datafile 2024-09-16T04:16:37.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj221 td/osd-backfill-space/datafile 2024-09-16T04:16:37.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj221 td/osd-backfill-space/datafile 2024-09-16T04:16:37.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:37.546 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:37.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj222 td/osd-backfill-space/datafile 2024-09-16T04:16:37.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj222 td/osd-backfill-space/datafile 2024-09-16T04:16:37.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj222 td/osd-backfill-space/datafile 2024-09-16T04:16:37.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj222 td/osd-backfill-space/datafile 2024-09-16T04:16:37.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj222 td/osd-backfill-space/datafile 2024-09-16T04:16:37.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj222 td/osd-backfill-space/datafile 2024-09-16T04:16:37.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:37.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj222 td/osd-backfill-space/datafile 2024-09-16T04:16:38.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj222 td/osd-backfill-space/datafile 2024-09-16T04:16:38.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:38.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:38.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj223 td/osd-backfill-space/datafile 2024-09-16T04:16:38.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj223 td/osd-backfill-space/datafile 2024-09-16T04:16:38.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj223 td/osd-backfill-space/datafile 2024-09-16T04:16:38.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj223 td/osd-backfill-space/datafile 2024-09-16T04:16:38.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj223 td/osd-backfill-space/datafile 2024-09-16T04:16:38.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj223 td/osd-backfill-space/datafile 2024-09-16T04:16:38.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj223 td/osd-backfill-space/datafile 2024-09-16T04:16:38.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj223 td/osd-backfill-space/datafile 2024-09-16T04:16:38.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:38.701 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:38.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj224 td/osd-backfill-space/datafile 2024-09-16T04:16:38.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj224 td/osd-backfill-space/datafile 2024-09-16T04:16:38.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj224 td/osd-backfill-space/datafile 2024-09-16T04:16:38.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj224 td/osd-backfill-space/datafile 2024-09-16T04:16:38.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:38.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj224 td/osd-backfill-space/datafile 2024-09-16T04:16:39.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:39.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj224 td/osd-backfill-space/datafile 2024-09-16T04:16:39.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:39.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj224 td/osd-backfill-space/datafile 2024-09-16T04:16:39.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:39.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj224 td/osd-backfill-space/datafile 2024-09-16T04:16:39.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:39.236 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:39.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:39.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj225 td/osd-backfill-space/datafile 2024-09-16T04:16:39.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:39.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj225 td/osd-backfill-space/datafile 2024-09-16T04:16:40.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj225 td/osd-backfill-space/datafile 2024-09-16T04:16:40.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj225 td/osd-backfill-space/datafile 2024-09-16T04:16:40.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj225 td/osd-backfill-space/datafile 2024-09-16T04:16:40.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj225 td/osd-backfill-space/datafile 2024-09-16T04:16:40.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj225 td/osd-backfill-space/datafile 2024-09-16T04:16:40.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj225 td/osd-backfill-space/datafile 2024-09-16T04:16:40.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:40.498 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:40.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj226 td/osd-backfill-space/datafile 2024-09-16T04:16:40.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj226 td/osd-backfill-space/datafile 2024-09-16T04:16:40.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj226 td/osd-backfill-space/datafile 2024-09-16T04:16:40.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj226 td/osd-backfill-space/datafile 2024-09-16T04:16:40.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj226 td/osd-backfill-space/datafile 2024-09-16T04:16:40.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj226 td/osd-backfill-space/datafile 2024-09-16T04:16:40.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:40.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj226 td/osd-backfill-space/datafile 2024-09-16T04:16:41.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj226 td/osd-backfill-space/datafile 2024-09-16T04:16:41.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:41.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:41.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj227 td/osd-backfill-space/datafile 2024-09-16T04:16:41.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj227 td/osd-backfill-space/datafile 2024-09-16T04:16:41.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj227 td/osd-backfill-space/datafile 2024-09-16T04:16:41.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj227 td/osd-backfill-space/datafile 2024-09-16T04:16:41.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj227 td/osd-backfill-space/datafile 2024-09-16T04:16:41.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj227 td/osd-backfill-space/datafile 2024-09-16T04:16:41.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj227 td/osd-backfill-space/datafile 2024-09-16T04:16:41.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj227 td/osd-backfill-space/datafile 2024-09-16T04:16:41.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:41.670 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:41.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj228 td/osd-backfill-space/datafile 2024-09-16T04:16:41.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj228 td/osd-backfill-space/datafile 2024-09-16T04:16:41.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj228 td/osd-backfill-space/datafile 2024-09-16T04:16:41.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj228 td/osd-backfill-space/datafile 2024-09-16T04:16:41.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:41.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj228 td/osd-backfill-space/datafile 2024-09-16T04:16:42.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj228 td/osd-backfill-space/datafile 2024-09-16T04:16:42.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj228 td/osd-backfill-space/datafile 2024-09-16T04:16:42.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj228 td/osd-backfill-space/datafile 2024-09-16T04:16:42.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:42.264 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:42.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj229 td/osd-backfill-space/datafile 2024-09-16T04:16:42.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj229 td/osd-backfill-space/datafile 2024-09-16T04:16:42.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj229 td/osd-backfill-space/datafile 2024-09-16T04:16:42.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj229 td/osd-backfill-space/datafile 2024-09-16T04:16:42.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj229 td/osd-backfill-space/datafile 2024-09-16T04:16:42.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj229 td/osd-backfill-space/datafile 2024-09-16T04:16:42.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj229 td/osd-backfill-space/datafile 2024-09-16T04:16:42.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj229 td/osd-backfill-space/datafile 2024-09-16T04:16:42.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:42.820 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:42.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj230 td/osd-backfill-space/datafile 2024-09-16T04:16:42.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj230 td/osd-backfill-space/datafile 2024-09-16T04:16:42.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:42.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj230 td/osd-backfill-space/datafile 2024-09-16T04:16:43.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj230 td/osd-backfill-space/datafile 2024-09-16T04:16:43.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj230 td/osd-backfill-space/datafile 2024-09-16T04:16:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj230 td/osd-backfill-space/datafile 2024-09-16T04:16:43.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj230 td/osd-backfill-space/datafile 2024-09-16T04:16:43.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj230 td/osd-backfill-space/datafile 2024-09-16T04:16:43.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:43.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:43.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj231 td/osd-backfill-space/datafile 2024-09-16T04:16:43.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj231 td/osd-backfill-space/datafile 2024-09-16T04:16:43.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj231 td/osd-backfill-space/datafile 2024-09-16T04:16:43.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj231 td/osd-backfill-space/datafile 2024-09-16T04:16:43.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj231 td/osd-backfill-space/datafile 2024-09-16T04:16:43.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj231 td/osd-backfill-space/datafile 2024-09-16T04:16:43.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj231 td/osd-backfill-space/datafile 2024-09-16T04:16:43.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj231 td/osd-backfill-space/datafile 2024-09-16T04:16:43.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:43.973 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:43.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:43.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj232 td/osd-backfill-space/datafile 2024-09-16T04:16:44.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj232 td/osd-backfill-space/datafile 2024-09-16T04:16:44.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj232 td/osd-backfill-space/datafile 2024-09-16T04:16:44.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj232 td/osd-backfill-space/datafile 2024-09-16T04:16:44.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj232 td/osd-backfill-space/datafile 2024-09-16T04:16:44.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj232 td/osd-backfill-space/datafile 2024-09-16T04:16:44.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj232 td/osd-backfill-space/datafile 2024-09-16T04:16:44.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj232 td/osd-backfill-space/datafile 2024-09-16T04:16:44.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:44.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:44.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj233 td/osd-backfill-space/datafile 2024-09-16T04:16:44.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj233 td/osd-backfill-space/datafile 2024-09-16T04:16:44.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj233 td/osd-backfill-space/datafile 2024-09-16T04:16:44.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj233 td/osd-backfill-space/datafile 2024-09-16T04:16:44.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj233 td/osd-backfill-space/datafile 2024-09-16T04:16:44.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj233 td/osd-backfill-space/datafile 2024-09-16T04:16:44.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:44.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj233 td/osd-backfill-space/datafile 2024-09-16T04:16:45.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj233 td/osd-backfill-space/datafile 2024-09-16T04:16:45.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:45.077 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:45.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj234 td/osd-backfill-space/datafile 2024-09-16T04:16:45.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj234 td/osd-backfill-space/datafile 2024-09-16T04:16:45.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj234 td/osd-backfill-space/datafile 2024-09-16T04:16:45.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj234 td/osd-backfill-space/datafile 2024-09-16T04:16:45.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj234 td/osd-backfill-space/datafile 2024-09-16T04:16:45.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj234 td/osd-backfill-space/datafile 2024-09-16T04:16:45.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj234 td/osd-backfill-space/datafile 2024-09-16T04:16:45.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj234 td/osd-backfill-space/datafile 2024-09-16T04:16:45.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:45.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:45.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj235 td/osd-backfill-space/datafile 2024-09-16T04:16:45.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj235 td/osd-backfill-space/datafile 2024-09-16T04:16:45.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj235 td/osd-backfill-space/datafile 2024-09-16T04:16:45.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj235 td/osd-backfill-space/datafile 2024-09-16T04:16:45.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:45.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj235 td/osd-backfill-space/datafile 2024-09-16T04:16:46.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj235 td/osd-backfill-space/datafile 2024-09-16T04:16:46.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj235 td/osd-backfill-space/datafile 2024-09-16T04:16:46.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj235 td/osd-backfill-space/datafile 2024-09-16T04:16:46.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:46.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:46.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj236 td/osd-backfill-space/datafile 2024-09-16T04:16:46.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj236 td/osd-backfill-space/datafile 2024-09-16T04:16:46.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj236 td/osd-backfill-space/datafile 2024-09-16T04:16:46.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj236 td/osd-backfill-space/datafile 2024-09-16T04:16:46.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj236 td/osd-backfill-space/datafile 2024-09-16T04:16:46.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj236 td/osd-backfill-space/datafile 2024-09-16T04:16:46.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj236 td/osd-backfill-space/datafile 2024-09-16T04:16:46.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj236 td/osd-backfill-space/datafile 2024-09-16T04:16:46.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:46.818 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:46.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj237 td/osd-backfill-space/datafile 2024-09-16T04:16:46.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj237 td/osd-backfill-space/datafile 2024-09-16T04:16:46.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:46.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj237 td/osd-backfill-space/datafile 2024-09-16T04:16:47.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj237 td/osd-backfill-space/datafile 2024-09-16T04:16:47.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj237 td/osd-backfill-space/datafile 2024-09-16T04:16:47.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj237 td/osd-backfill-space/datafile 2024-09-16T04:16:47.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj237 td/osd-backfill-space/datafile 2024-09-16T04:16:47.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj237 td/osd-backfill-space/datafile 2024-09-16T04:16:47.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:47.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:47.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj238 td/osd-backfill-space/datafile 2024-09-16T04:16:47.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj238 td/osd-backfill-space/datafile 2024-09-16T04:16:47.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj238 td/osd-backfill-space/datafile 2024-09-16T04:16:47.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj238 td/osd-backfill-space/datafile 2024-09-16T04:16:47.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj238 td/osd-backfill-space/datafile 2024-09-16T04:16:47.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj238 td/osd-backfill-space/datafile 2024-09-16T04:16:47.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj238 td/osd-backfill-space/datafile 2024-09-16T04:16:47.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj238 td/osd-backfill-space/datafile 2024-09-16T04:16:47.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:47.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:47.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:47.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj239 td/osd-backfill-space/datafile 2024-09-16T04:16:48.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj239 td/osd-backfill-space/datafile 2024-09-16T04:16:48.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj239 td/osd-backfill-space/datafile 2024-09-16T04:16:48.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj239 td/osd-backfill-space/datafile 2024-09-16T04:16:48.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj239 td/osd-backfill-space/datafile 2024-09-16T04:16:48.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj239 td/osd-backfill-space/datafile 2024-09-16T04:16:48.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj239 td/osd-backfill-space/datafile 2024-09-16T04:16:48.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj239 td/osd-backfill-space/datafile 2024-09-16T04:16:48.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:48.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:48.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj240 td/osd-backfill-space/datafile 2024-09-16T04:16:48.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj240 td/osd-backfill-space/datafile 2024-09-16T04:16:48.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj240 td/osd-backfill-space/datafile 2024-09-16T04:16:48.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj240 td/osd-backfill-space/datafile 2024-09-16T04:16:48.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj240 td/osd-backfill-space/datafile 2024-09-16T04:16:48.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj240 td/osd-backfill-space/datafile 2024-09-16T04:16:48.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:48.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj240 td/osd-backfill-space/datafile 2024-09-16T04:16:49.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj240 td/osd-backfill-space/datafile 2024-09-16T04:16:49.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:49.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:49.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj241 td/osd-backfill-space/datafile 2024-09-16T04:16:49.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj241 td/osd-backfill-space/datafile 2024-09-16T04:16:49.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj241 td/osd-backfill-space/datafile 2024-09-16T04:16:49.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj241 td/osd-backfill-space/datafile 2024-09-16T04:16:49.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj241 td/osd-backfill-space/datafile 2024-09-16T04:16:49.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj241 td/osd-backfill-space/datafile 2024-09-16T04:16:49.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj241 td/osd-backfill-space/datafile 2024-09-16T04:16:49.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj241 td/osd-backfill-space/datafile 2024-09-16T04:16:49.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:49.693 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:49.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj242 td/osd-backfill-space/datafile 2024-09-16T04:16:49.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj242 td/osd-backfill-space/datafile 2024-09-16T04:16:49.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj242 td/osd-backfill-space/datafile 2024-09-16T04:16:49.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj242 td/osd-backfill-space/datafile 2024-09-16T04:16:49.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:49.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj242 td/osd-backfill-space/datafile 2024-09-16T04:16:50.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj242 td/osd-backfill-space/datafile 2024-09-16T04:16:50.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj242 td/osd-backfill-space/datafile 2024-09-16T04:16:50.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj242 td/osd-backfill-space/datafile 2024-09-16T04:16:50.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:50.209 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:50.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj243 td/osd-backfill-space/datafile 2024-09-16T04:16:50.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj243 td/osd-backfill-space/datafile 2024-09-16T04:16:50.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj243 td/osd-backfill-space/datafile 2024-09-16T04:16:50.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj243 td/osd-backfill-space/datafile 2024-09-16T04:16:50.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj243 td/osd-backfill-space/datafile 2024-09-16T04:16:50.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj243 td/osd-backfill-space/datafile 2024-09-16T04:16:50.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj243 td/osd-backfill-space/datafile 2024-09-16T04:16:50.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj243 td/osd-backfill-space/datafile 2024-09-16T04:16:50.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:50.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:50.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj244 td/osd-backfill-space/datafile 2024-09-16T04:16:50.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj244 td/osd-backfill-space/datafile 2024-09-16T04:16:50.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:50.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj244 td/osd-backfill-space/datafile 2024-09-16T04:16:51.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj244 td/osd-backfill-space/datafile 2024-09-16T04:16:51.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj244 td/osd-backfill-space/datafile 2024-09-16T04:16:51.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj244 td/osd-backfill-space/datafile 2024-09-16T04:16:51.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj244 td/osd-backfill-space/datafile 2024-09-16T04:16:51.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj244 td/osd-backfill-space/datafile 2024-09-16T04:16:51.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:51.380 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:51.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj245 td/osd-backfill-space/datafile 2024-09-16T04:16:51.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj245 td/osd-backfill-space/datafile 2024-09-16T04:16:51.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj245 td/osd-backfill-space/datafile 2024-09-16T04:16:51.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj245 td/osd-backfill-space/datafile 2024-09-16T04:16:51.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj245 td/osd-backfill-space/datafile 2024-09-16T04:16:51.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj245 td/osd-backfill-space/datafile 2024-09-16T04:16:51.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj245 td/osd-backfill-space/datafile 2024-09-16T04:16:51.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj245 td/osd-backfill-space/datafile 2024-09-16T04:16:51.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:51.975 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:51.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:51.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj246 td/osd-backfill-space/datafile 2024-09-16T04:16:52.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj246 td/osd-backfill-space/datafile 2024-09-16T04:16:52.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj246 td/osd-backfill-space/datafile 2024-09-16T04:16:52.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj246 td/osd-backfill-space/datafile 2024-09-16T04:16:52.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj246 td/osd-backfill-space/datafile 2024-09-16T04:16:52.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj246 td/osd-backfill-space/datafile 2024-09-16T04:16:52.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj246 td/osd-backfill-space/datafile 2024-09-16T04:16:52.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj246 td/osd-backfill-space/datafile 2024-09-16T04:16:52.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:52.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:52.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj247 td/osd-backfill-space/datafile 2024-09-16T04:16:52.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj247 td/osd-backfill-space/datafile 2024-09-16T04:16:52.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj247 td/osd-backfill-space/datafile 2024-09-16T04:16:52.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj247 td/osd-backfill-space/datafile 2024-09-16T04:16:52.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj247 td/osd-backfill-space/datafile 2024-09-16T04:16:52.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj247 td/osd-backfill-space/datafile 2024-09-16T04:16:52.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:52.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj247 td/osd-backfill-space/datafile 2024-09-16T04:16:53.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj247 td/osd-backfill-space/datafile 2024-09-16T04:16:53.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:53.113 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:53.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj248 td/osd-backfill-space/datafile 2024-09-16T04:16:53.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj248 td/osd-backfill-space/datafile 2024-09-16T04:16:53.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj248 td/osd-backfill-space/datafile 2024-09-16T04:16:53.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj248 td/osd-backfill-space/datafile 2024-09-16T04:16:53.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj248 td/osd-backfill-space/datafile 2024-09-16T04:16:53.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj248 td/osd-backfill-space/datafile 2024-09-16T04:16:53.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj248 td/osd-backfill-space/datafile 2024-09-16T04:16:53.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj248 td/osd-backfill-space/datafile 2024-09-16T04:16:53.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:53.683 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:53.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj249 td/osd-backfill-space/datafile 2024-09-16T04:16:53.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj249 td/osd-backfill-space/datafile 2024-09-16T04:16:53.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj249 td/osd-backfill-space/datafile 2024-09-16T04:16:53.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj249 td/osd-backfill-space/datafile 2024-09-16T04:16:53.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:53.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj249 td/osd-backfill-space/datafile 2024-09-16T04:16:54.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj249 td/osd-backfill-space/datafile 2024-09-16T04:16:54.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj249 td/osd-backfill-space/datafile 2024-09-16T04:16:54.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj249 td/osd-backfill-space/datafile 2024-09-16T04:16:54.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:54.244 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:54.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj250 td/osd-backfill-space/datafile 2024-09-16T04:16:54.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj250 td/osd-backfill-space/datafile 2024-09-16T04:16:54.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj250 td/osd-backfill-space/datafile 2024-09-16T04:16:54.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj250 td/osd-backfill-space/datafile 2024-09-16T04:16:54.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj250 td/osd-backfill-space/datafile 2024-09-16T04:16:54.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj250 td/osd-backfill-space/datafile 2024-09-16T04:16:54.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj250 td/osd-backfill-space/datafile 2024-09-16T04:16:54.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj250 td/osd-backfill-space/datafile 2024-09-16T04:16:54.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:54.830 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:54.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj251 td/osd-backfill-space/datafile 2024-09-16T04:16:54.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj251 td/osd-backfill-space/datafile 2024-09-16T04:16:54.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:54.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj251 td/osd-backfill-space/datafile 2024-09-16T04:16:55.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj251 td/osd-backfill-space/datafile 2024-09-16T04:16:55.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj251 td/osd-backfill-space/datafile 2024-09-16T04:16:55.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj251 td/osd-backfill-space/datafile 2024-09-16T04:16:55.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj251 td/osd-backfill-space/datafile 2024-09-16T04:16:55.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj251 td/osd-backfill-space/datafile 2024-09-16T04:16:55.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:55.373 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:55.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj252 td/osd-backfill-space/datafile 2024-09-16T04:16:55.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj252 td/osd-backfill-space/datafile 2024-09-16T04:16:55.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj252 td/osd-backfill-space/datafile 2024-09-16T04:16:55.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj252 td/osd-backfill-space/datafile 2024-09-16T04:16:55.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj252 td/osd-backfill-space/datafile 2024-09-16T04:16:55.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj252 td/osd-backfill-space/datafile 2024-09-16T04:16:55.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj252 td/osd-backfill-space/datafile 2024-09-16T04:16:55.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj252 td/osd-backfill-space/datafile 2024-09-16T04:16:55.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:55.960 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:55.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:55.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj253 td/osd-backfill-space/datafile 2024-09-16T04:16:56.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj253 td/osd-backfill-space/datafile 2024-09-16T04:16:56.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj253 td/osd-backfill-space/datafile 2024-09-16T04:16:56.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj253 td/osd-backfill-space/datafile 2024-09-16T04:16:56.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj253 td/osd-backfill-space/datafile 2024-09-16T04:16:56.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj253 td/osd-backfill-space/datafile 2024-09-16T04:16:56.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj253 td/osd-backfill-space/datafile 2024-09-16T04:16:56.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj253 td/osd-backfill-space/datafile 2024-09-16T04:16:56.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:56.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:56.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj254 td/osd-backfill-space/datafile 2024-09-16T04:16:56.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj254 td/osd-backfill-space/datafile 2024-09-16T04:16:56.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj254 td/osd-backfill-space/datafile 2024-09-16T04:16:56.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj254 td/osd-backfill-space/datafile 2024-09-16T04:16:56.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj254 td/osd-backfill-space/datafile 2024-09-16T04:16:56.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj254 td/osd-backfill-space/datafile 2024-09-16T04:16:56.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:56.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj254 td/osd-backfill-space/datafile 2024-09-16T04:16:57.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj254 td/osd-backfill-space/datafile 2024-09-16T04:16:57.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:57.081 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:57.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj255 td/osd-backfill-space/datafile 2024-09-16T04:16:57.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj255 td/osd-backfill-space/datafile 2024-09-16T04:16:57.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj255 td/osd-backfill-space/datafile 2024-09-16T04:16:57.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj255 td/osd-backfill-space/datafile 2024-09-16T04:16:57.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj255 td/osd-backfill-space/datafile 2024-09-16T04:16:57.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj255 td/osd-backfill-space/datafile 2024-09-16T04:16:57.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj255 td/osd-backfill-space/datafile 2024-09-16T04:16:57.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj255 td/osd-backfill-space/datafile 2024-09-16T04:16:57.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:57.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:57.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj256 td/osd-backfill-space/datafile 2024-09-16T04:16:57.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj256 td/osd-backfill-space/datafile 2024-09-16T04:16:57.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj256 td/osd-backfill-space/datafile 2024-09-16T04:16:57.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj256 td/osd-backfill-space/datafile 2024-09-16T04:16:57.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:57.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj256 td/osd-backfill-space/datafile 2024-09-16T04:16:58.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj256 td/osd-backfill-space/datafile 2024-09-16T04:16:58.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj256 td/osd-backfill-space/datafile 2024-09-16T04:16:58.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj256 td/osd-backfill-space/datafile 2024-09-16T04:16:58.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:58.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:58.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj257 td/osd-backfill-space/datafile 2024-09-16T04:16:58.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj257 td/osd-backfill-space/datafile 2024-09-16T04:16:58.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj257 td/osd-backfill-space/datafile 2024-09-16T04:16:58.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj257 td/osd-backfill-space/datafile 2024-09-16T04:16:58.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj257 td/osd-backfill-space/datafile 2024-09-16T04:16:58.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj257 td/osd-backfill-space/datafile 2024-09-16T04:16:58.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj257 td/osd-backfill-space/datafile 2024-09-16T04:16:58.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj257 td/osd-backfill-space/datafile 2024-09-16T04:16:58.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:58.772 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:58.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj258 td/osd-backfill-space/datafile 2024-09-16T04:16:58.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj258 td/osd-backfill-space/datafile 2024-09-16T04:16:58.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj258 td/osd-backfill-space/datafile 2024-09-16T04:16:58.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:58.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj258 td/osd-backfill-space/datafile 2024-09-16T04:16:59.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj258 td/osd-backfill-space/datafile 2024-09-16T04:16:59.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj258 td/osd-backfill-space/datafile 2024-09-16T04:16:59.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj258 td/osd-backfill-space/datafile 2024-09-16T04:16:59.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj258 td/osd-backfill-space/datafile 2024-09-16T04:16:59.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:59.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:59.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj259 td/osd-backfill-space/datafile 2024-09-16T04:16:59.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj259 td/osd-backfill-space/datafile 2024-09-16T04:16:59.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj259 td/osd-backfill-space/datafile 2024-09-16T04:16:59.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj259 td/osd-backfill-space/datafile 2024-09-16T04:16:59.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj259 td/osd-backfill-space/datafile 2024-09-16T04:16:59.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj259 td/osd-backfill-space/datafile 2024-09-16T04:16:59.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj259 td/osd-backfill-space/datafile 2024-09-16T04:16:59.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj259 td/osd-backfill-space/datafile 2024-09-16T04:16:59.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:16:59.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:16:59.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj260 td/osd-backfill-space/datafile 2024-09-16T04:16:59.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:16:59.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj260 td/osd-backfill-space/datafile 2024-09-16T04:17:00.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj260 td/osd-backfill-space/datafile 2024-09-16T04:17:00.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj260 td/osd-backfill-space/datafile 2024-09-16T04:17:00.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj260 td/osd-backfill-space/datafile 2024-09-16T04:17:00.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj260 td/osd-backfill-space/datafile 2024-09-16T04:17:00.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj260 td/osd-backfill-space/datafile 2024-09-16T04:17:00.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj260 td/osd-backfill-space/datafile 2024-09-16T04:17:00.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:00.446 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:00.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj261 td/osd-backfill-space/datafile 2024-09-16T04:17:00.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj261 td/osd-backfill-space/datafile 2024-09-16T04:17:00.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj261 td/osd-backfill-space/datafile 2024-09-16T04:17:00.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj261 td/osd-backfill-space/datafile 2024-09-16T04:17:00.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj261 td/osd-backfill-space/datafile 2024-09-16T04:17:00.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj261 td/osd-backfill-space/datafile 2024-09-16T04:17:00.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj261 td/osd-backfill-space/datafile 2024-09-16T04:17:00.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:00.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj261 td/osd-backfill-space/datafile 2024-09-16T04:17:01.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:01.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:01.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj262 td/osd-backfill-space/datafile 2024-09-16T04:17:01.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj262 td/osd-backfill-space/datafile 2024-09-16T04:17:01.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj262 td/osd-backfill-space/datafile 2024-09-16T04:17:01.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj262 td/osd-backfill-space/datafile 2024-09-16T04:17:01.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj262 td/osd-backfill-space/datafile 2024-09-16T04:17:01.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj262 td/osd-backfill-space/datafile 2024-09-16T04:17:01.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj262 td/osd-backfill-space/datafile 2024-09-16T04:17:01.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj262 td/osd-backfill-space/datafile 2024-09-16T04:17:01.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:01.644 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:01.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj263 td/osd-backfill-space/datafile 2024-09-16T04:17:01.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj263 td/osd-backfill-space/datafile 2024-09-16T04:17:01.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj263 td/osd-backfill-space/datafile 2024-09-16T04:17:01.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj263 td/osd-backfill-space/datafile 2024-09-16T04:17:01.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj263 td/osd-backfill-space/datafile 2024-09-16T04:17:01.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:01.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj263 td/osd-backfill-space/datafile 2024-09-16T04:17:02.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj263 td/osd-backfill-space/datafile 2024-09-16T04:17:02.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj263 td/osd-backfill-space/datafile 2024-09-16T04:17:02.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:02.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:02.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj264 td/osd-backfill-space/datafile 2024-09-16T04:17:02.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj264 td/osd-backfill-space/datafile 2024-09-16T04:17:02.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj264 td/osd-backfill-space/datafile 2024-09-16T04:17:02.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj264 td/osd-backfill-space/datafile 2024-09-16T04:17:02.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj264 td/osd-backfill-space/datafile 2024-09-16T04:17:02.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj264 td/osd-backfill-space/datafile 2024-09-16T04:17:02.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj264 td/osd-backfill-space/datafile 2024-09-16T04:17:02.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj264 td/osd-backfill-space/datafile 2024-09-16T04:17:02.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:02.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:02.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj265 td/osd-backfill-space/datafile 2024-09-16T04:17:02.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj265 td/osd-backfill-space/datafile 2024-09-16T04:17:02.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj265 td/osd-backfill-space/datafile 2024-09-16T04:17:02.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:02.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj265 td/osd-backfill-space/datafile 2024-09-16T04:17:03.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj265 td/osd-backfill-space/datafile 2024-09-16T04:17:03.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj265 td/osd-backfill-space/datafile 2024-09-16T04:17:03.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj265 td/osd-backfill-space/datafile 2024-09-16T04:17:03.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj265 td/osd-backfill-space/datafile 2024-09-16T04:17:03.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:03.318 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:03.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj266 td/osd-backfill-space/datafile 2024-09-16T04:17:03.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj266 td/osd-backfill-space/datafile 2024-09-16T04:17:03.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj266 td/osd-backfill-space/datafile 2024-09-16T04:17:03.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj266 td/osd-backfill-space/datafile 2024-09-16T04:17:03.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj266 td/osd-backfill-space/datafile 2024-09-16T04:17:03.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj266 td/osd-backfill-space/datafile 2024-09-16T04:17:03.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj266 td/osd-backfill-space/datafile 2024-09-16T04:17:03.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj266 td/osd-backfill-space/datafile 2024-09-16T04:17:03.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:03.896 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:03.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj267 td/osd-backfill-space/datafile 2024-09-16T04:17:03.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:03.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj267 td/osd-backfill-space/datafile 2024-09-16T04:17:04.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj267 td/osd-backfill-space/datafile 2024-09-16T04:17:04.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj267 td/osd-backfill-space/datafile 2024-09-16T04:17:04.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj267 td/osd-backfill-space/datafile 2024-09-16T04:17:04.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj267 td/osd-backfill-space/datafile 2024-09-16T04:17:04.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj267 td/osd-backfill-space/datafile 2024-09-16T04:17:04.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj267 td/osd-backfill-space/datafile 2024-09-16T04:17:04.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:04.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:04.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj268 td/osd-backfill-space/datafile 2024-09-16T04:17:04.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj268 td/osd-backfill-space/datafile 2024-09-16T04:17:04.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj268 td/osd-backfill-space/datafile 2024-09-16T04:17:04.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj268 td/osd-backfill-space/datafile 2024-09-16T04:17:04.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj268 td/osd-backfill-space/datafile 2024-09-16T04:17:04.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj268 td/osd-backfill-space/datafile 2024-09-16T04:17:04.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj268 td/osd-backfill-space/datafile 2024-09-16T04:17:04.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:04.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj268 td/osd-backfill-space/datafile 2024-09-16T04:17:05.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:05.051 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:05.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:05.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj269 td/osd-backfill-space/datafile 2024-09-16T04:17:05.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:05.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj269 td/osd-backfill-space/datafile 2024-09-16T04:17:05.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:05.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj269 td/osd-backfill-space/datafile 2024-09-16T04:17:05.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:05.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj269 td/osd-backfill-space/datafile 2024-09-16T04:17:05.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:05.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj269 td/osd-backfill-space/datafile 2024-09-16T04:17:05.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:05.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj269 td/osd-backfill-space/datafile 2024-09-16T04:17:05.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:05.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj269 td/osd-backfill-space/datafile 2024-09-16T04:17:05.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:05.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj269 td/osd-backfill-space/datafile 2024-09-16T04:17:05.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:05.696 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:05.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:05.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj270 td/osd-backfill-space/datafile 2024-09-16T04:17:05.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:05.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj270 td/osd-backfill-space/datafile 2024-09-16T04:17:05.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:05.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj270 td/osd-backfill-space/datafile 2024-09-16T04:17:05.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:05.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj270 td/osd-backfill-space/datafile 2024-09-16T04:17:06.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj270 td/osd-backfill-space/datafile 2024-09-16T04:17:06.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj270 td/osd-backfill-space/datafile 2024-09-16T04:17:06.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj270 td/osd-backfill-space/datafile 2024-09-16T04:17:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj270 td/osd-backfill-space/datafile 2024-09-16T04:17:06.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:06.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:06.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj271 td/osd-backfill-space/datafile 2024-09-16T04:17:06.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj271 td/osd-backfill-space/datafile 2024-09-16T04:17:06.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj271 td/osd-backfill-space/datafile 2024-09-16T04:17:06.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj271 td/osd-backfill-space/datafile 2024-09-16T04:17:06.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj271 td/osd-backfill-space/datafile 2024-09-16T04:17:06.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj271 td/osd-backfill-space/datafile 2024-09-16T04:17:06.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj271 td/osd-backfill-space/datafile 2024-09-16T04:17:06.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj271 td/osd-backfill-space/datafile 2024-09-16T04:17:06.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:06.876 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:06.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj272 td/osd-backfill-space/datafile 2024-09-16T04:17:06.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:06.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj272 td/osd-backfill-space/datafile 2024-09-16T04:17:07.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj272 td/osd-backfill-space/datafile 2024-09-16T04:17:07.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj272 td/osd-backfill-space/datafile 2024-09-16T04:17:07.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj272 td/osd-backfill-space/datafile 2024-09-16T04:17:07.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj272 td/osd-backfill-space/datafile 2024-09-16T04:17:07.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj272 td/osd-backfill-space/datafile 2024-09-16T04:17:07.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj272 td/osd-backfill-space/datafile 2024-09-16T04:17:07.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:07.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:07.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj273 td/osd-backfill-space/datafile 2024-09-16T04:17:07.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj273 td/osd-backfill-space/datafile 2024-09-16T04:17:07.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj273 td/osd-backfill-space/datafile 2024-09-16T04:17:07.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj273 td/osd-backfill-space/datafile 2024-09-16T04:17:07.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj273 td/osd-backfill-space/datafile 2024-09-16T04:17:07.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj273 td/osd-backfill-space/datafile 2024-09-16T04:17:07.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj273 td/osd-backfill-space/datafile 2024-09-16T04:17:07.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:07.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj273 td/osd-backfill-space/datafile 2024-09-16T04:17:08.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:08.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:08.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj274 td/osd-backfill-space/datafile 2024-09-16T04:17:08.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj274 td/osd-backfill-space/datafile 2024-09-16T04:17:08.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj274 td/osd-backfill-space/datafile 2024-09-16T04:17:08.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj274 td/osd-backfill-space/datafile 2024-09-16T04:17:08.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj274 td/osd-backfill-space/datafile 2024-09-16T04:17:08.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj274 td/osd-backfill-space/datafile 2024-09-16T04:17:08.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj274 td/osd-backfill-space/datafile 2024-09-16T04:17:08.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj274 td/osd-backfill-space/datafile 2024-09-16T04:17:08.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:08.575 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:08.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj275 td/osd-backfill-space/datafile 2024-09-16T04:17:08.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj275 td/osd-backfill-space/datafile 2024-09-16T04:17:08.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj275 td/osd-backfill-space/datafile 2024-09-16T04:17:08.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj275 td/osd-backfill-space/datafile 2024-09-16T04:17:08.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj275 td/osd-backfill-space/datafile 2024-09-16T04:17:08.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:08.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj275 td/osd-backfill-space/datafile 2024-09-16T04:17:09.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj275 td/osd-backfill-space/datafile 2024-09-16T04:17:09.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj275 td/osd-backfill-space/datafile 2024-09-16T04:17:09.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:09.170 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:09.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj276 td/osd-backfill-space/datafile 2024-09-16T04:17:09.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj276 td/osd-backfill-space/datafile 2024-09-16T04:17:09.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj276 td/osd-backfill-space/datafile 2024-09-16T04:17:09.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj276 td/osd-backfill-space/datafile 2024-09-16T04:17:09.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj276 td/osd-backfill-space/datafile 2024-09-16T04:17:09.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj276 td/osd-backfill-space/datafile 2024-09-16T04:17:09.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj276 td/osd-backfill-space/datafile 2024-09-16T04:17:09.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj276 td/osd-backfill-space/datafile 2024-09-16T04:17:09.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:09.731 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:09.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj277 td/osd-backfill-space/datafile 2024-09-16T04:17:09.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj277 td/osd-backfill-space/datafile 2024-09-16T04:17:09.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj277 td/osd-backfill-space/datafile 2024-09-16T04:17:09.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:09.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj277 td/osd-backfill-space/datafile 2024-09-16T04:17:10.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj277 td/osd-backfill-space/datafile 2024-09-16T04:17:10.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj277 td/osd-backfill-space/datafile 2024-09-16T04:17:10.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj277 td/osd-backfill-space/datafile 2024-09-16T04:17:10.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj277 td/osd-backfill-space/datafile 2024-09-16T04:17:10.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:10.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:10.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj278 td/osd-backfill-space/datafile 2024-09-16T04:17:10.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj278 td/osd-backfill-space/datafile 2024-09-16T04:17:10.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj278 td/osd-backfill-space/datafile 2024-09-16T04:17:10.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj278 td/osd-backfill-space/datafile 2024-09-16T04:17:10.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj278 td/osd-backfill-space/datafile 2024-09-16T04:17:10.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj278 td/osd-backfill-space/datafile 2024-09-16T04:17:10.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj278 td/osd-backfill-space/datafile 2024-09-16T04:17:10.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj278 td/osd-backfill-space/datafile 2024-09-16T04:17:10.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:10.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:10.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj279 td/osd-backfill-space/datafile 2024-09-16T04:17:10.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:10.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj279 td/osd-backfill-space/datafile 2024-09-16T04:17:11.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:11.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj279 td/osd-backfill-space/datafile 2024-09-16T04:17:11.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:11.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj279 td/osd-backfill-space/datafile 2024-09-16T04:17:11.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:11.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj279 td/osd-backfill-space/datafile 2024-09-16T04:17:11.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:11.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj279 td/osd-backfill-space/datafile 2024-09-16T04:17:11.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:11.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj279 td/osd-backfill-space/datafile 2024-09-16T04:17:12.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj279 td/osd-backfill-space/datafile 2024-09-16T04:17:12.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:12.081 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:12.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj280 td/osd-backfill-space/datafile 2024-09-16T04:17:12.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj280 td/osd-backfill-space/datafile 2024-09-16T04:17:12.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj280 td/osd-backfill-space/datafile 2024-09-16T04:17:12.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj280 td/osd-backfill-space/datafile 2024-09-16T04:17:12.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj280 td/osd-backfill-space/datafile 2024-09-16T04:17:12.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj280 td/osd-backfill-space/datafile 2024-09-16T04:17:12.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj280 td/osd-backfill-space/datafile 2024-09-16T04:17:12.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj280 td/osd-backfill-space/datafile 2024-09-16T04:17:12.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:12.683 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:12.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj281 td/osd-backfill-space/datafile 2024-09-16T04:17:12.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj281 td/osd-backfill-space/datafile 2024-09-16T04:17:12.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj281 td/osd-backfill-space/datafile 2024-09-16T04:17:12.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj281 td/osd-backfill-space/datafile 2024-09-16T04:17:12.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:12.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj281 td/osd-backfill-space/datafile 2024-09-16T04:17:13.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj281 td/osd-backfill-space/datafile 2024-09-16T04:17:13.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj281 td/osd-backfill-space/datafile 2024-09-16T04:17:13.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj281 td/osd-backfill-space/datafile 2024-09-16T04:17:13.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:13.236 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:13.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj282 td/osd-backfill-space/datafile 2024-09-16T04:17:13.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj282 td/osd-backfill-space/datafile 2024-09-16T04:17:13.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj282 td/osd-backfill-space/datafile 2024-09-16T04:17:13.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj282 td/osd-backfill-space/datafile 2024-09-16T04:17:13.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj282 td/osd-backfill-space/datafile 2024-09-16T04:17:13.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj282 td/osd-backfill-space/datafile 2024-09-16T04:17:13.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj282 td/osd-backfill-space/datafile 2024-09-16T04:17:13.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj282 td/osd-backfill-space/datafile 2024-09-16T04:17:13.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:13.814 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:13.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj283 td/osd-backfill-space/datafile 2024-09-16T04:17:13.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj283 td/osd-backfill-space/datafile 2024-09-16T04:17:13.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:13.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj283 td/osd-backfill-space/datafile 2024-09-16T04:17:14.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj283 td/osd-backfill-space/datafile 2024-09-16T04:17:14.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj283 td/osd-backfill-space/datafile 2024-09-16T04:17:14.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj283 td/osd-backfill-space/datafile 2024-09-16T04:17:14.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj283 td/osd-backfill-space/datafile 2024-09-16T04:17:14.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj283 td/osd-backfill-space/datafile 2024-09-16T04:17:14.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:14.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:14.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj284 td/osd-backfill-space/datafile 2024-09-16T04:17:14.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj284 td/osd-backfill-space/datafile 2024-09-16T04:17:14.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj284 td/osd-backfill-space/datafile 2024-09-16T04:17:14.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj284 td/osd-backfill-space/datafile 2024-09-16T04:17:14.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj284 td/osd-backfill-space/datafile 2024-09-16T04:17:14.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj284 td/osd-backfill-space/datafile 2024-09-16T04:17:14.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj284 td/osd-backfill-space/datafile 2024-09-16T04:17:14.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj284 td/osd-backfill-space/datafile 2024-09-16T04:17:14.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:14.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:14.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj285 td/osd-backfill-space/datafile 2024-09-16T04:17:14.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:14.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj285 td/osd-backfill-space/datafile 2024-09-16T04:17:15.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj285 td/osd-backfill-space/datafile 2024-09-16T04:17:15.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj285 td/osd-backfill-space/datafile 2024-09-16T04:17:15.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj285 td/osd-backfill-space/datafile 2024-09-16T04:17:15.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj285 td/osd-backfill-space/datafile 2024-09-16T04:17:15.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj285 td/osd-backfill-space/datafile 2024-09-16T04:17:15.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj285 td/osd-backfill-space/datafile 2024-09-16T04:17:15.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:15.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:15.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj286 td/osd-backfill-space/datafile 2024-09-16T04:17:15.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj286 td/osd-backfill-space/datafile 2024-09-16T04:17:15.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj286 td/osd-backfill-space/datafile 2024-09-16T04:17:15.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj286 td/osd-backfill-space/datafile 2024-09-16T04:17:15.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj286 td/osd-backfill-space/datafile 2024-09-16T04:17:15.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj286 td/osd-backfill-space/datafile 2024-09-16T04:17:15.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj286 td/osd-backfill-space/datafile 2024-09-16T04:17:15.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:15.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj286 td/osd-backfill-space/datafile 2024-09-16T04:17:16.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:16.024 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:16.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj287 td/osd-backfill-space/datafile 2024-09-16T04:17:16.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj287 td/osd-backfill-space/datafile 2024-09-16T04:17:16.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj287 td/osd-backfill-space/datafile 2024-09-16T04:17:16.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj287 td/osd-backfill-space/datafile 2024-09-16T04:17:16.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj287 td/osd-backfill-space/datafile 2024-09-16T04:17:16.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj287 td/osd-backfill-space/datafile 2024-09-16T04:17:16.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj287 td/osd-backfill-space/datafile 2024-09-16T04:17:16.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj287 td/osd-backfill-space/datafile 2024-09-16T04:17:16.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:16.584 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:16.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj288 td/osd-backfill-space/datafile 2024-09-16T04:17:16.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj288 td/osd-backfill-space/datafile 2024-09-16T04:17:16.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj288 td/osd-backfill-space/datafile 2024-09-16T04:17:16.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj288 td/osd-backfill-space/datafile 2024-09-16T04:17:16.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj288 td/osd-backfill-space/datafile 2024-09-16T04:17:16.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:16.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj288 td/osd-backfill-space/datafile 2024-09-16T04:17:17.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj288 td/osd-backfill-space/datafile 2024-09-16T04:17:17.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj288 td/osd-backfill-space/datafile 2024-09-16T04:17:17.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:17.187 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:17.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj289 td/osd-backfill-space/datafile 2024-09-16T04:17:17.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj289 td/osd-backfill-space/datafile 2024-09-16T04:17:17.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj289 td/osd-backfill-space/datafile 2024-09-16T04:17:17.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj289 td/osd-backfill-space/datafile 2024-09-16T04:17:17.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj289 td/osd-backfill-space/datafile 2024-09-16T04:17:17.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj289 td/osd-backfill-space/datafile 2024-09-16T04:17:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj289 td/osd-backfill-space/datafile 2024-09-16T04:17:17.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj289 td/osd-backfill-space/datafile 2024-09-16T04:17:17.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:17.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:17.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj290 td/osd-backfill-space/datafile 2024-09-16T04:17:17.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj290 td/osd-backfill-space/datafile 2024-09-16T04:17:17.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj290 td/osd-backfill-space/datafile 2024-09-16T04:17:17.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:17.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj290 td/osd-backfill-space/datafile 2024-09-16T04:17:18.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj290 td/osd-backfill-space/datafile 2024-09-16T04:17:18.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj290 td/osd-backfill-space/datafile 2024-09-16T04:17:18.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj290 td/osd-backfill-space/datafile 2024-09-16T04:17:18.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj290 td/osd-backfill-space/datafile 2024-09-16T04:17:18.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:18.325 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:18.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj291 td/osd-backfill-space/datafile 2024-09-16T04:17:18.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj291 td/osd-backfill-space/datafile 2024-09-16T04:17:18.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj291 td/osd-backfill-space/datafile 2024-09-16T04:17:18.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj291 td/osd-backfill-space/datafile 2024-09-16T04:17:18.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj291 td/osd-backfill-space/datafile 2024-09-16T04:17:18.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj291 td/osd-backfill-space/datafile 2024-09-16T04:17:18.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj291 td/osd-backfill-space/datafile 2024-09-16T04:17:18.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj291 td/osd-backfill-space/datafile 2024-09-16T04:17:18.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:18.899 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:18.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj292 td/osd-backfill-space/datafile 2024-09-16T04:17:18.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:18.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj292 td/osd-backfill-space/datafile 2024-09-16T04:17:19.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj292 td/osd-backfill-space/datafile 2024-09-16T04:17:19.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj292 td/osd-backfill-space/datafile 2024-09-16T04:17:19.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj292 td/osd-backfill-space/datafile 2024-09-16T04:17:19.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj292 td/osd-backfill-space/datafile 2024-09-16T04:17:19.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj292 td/osd-backfill-space/datafile 2024-09-16T04:17:19.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj292 td/osd-backfill-space/datafile 2024-09-16T04:17:19.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:19.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:19.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj293 td/osd-backfill-space/datafile 2024-09-16T04:17:19.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj293 td/osd-backfill-space/datafile 2024-09-16T04:17:19.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj293 td/osd-backfill-space/datafile 2024-09-16T04:17:19.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj293 td/osd-backfill-space/datafile 2024-09-16T04:17:19.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj293 td/osd-backfill-space/datafile 2024-09-16T04:17:19.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj293 td/osd-backfill-space/datafile 2024-09-16T04:17:19.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj293 td/osd-backfill-space/datafile 2024-09-16T04:17:19.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:19.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj293 td/osd-backfill-space/datafile 2024-09-16T04:17:20.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:20.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:20.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj294 td/osd-backfill-space/datafile 2024-09-16T04:17:20.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj294 td/osd-backfill-space/datafile 2024-09-16T04:17:20.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj294 td/osd-backfill-space/datafile 2024-09-16T04:17:20.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj294 td/osd-backfill-space/datafile 2024-09-16T04:17:20.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj294 td/osd-backfill-space/datafile 2024-09-16T04:17:20.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj294 td/osd-backfill-space/datafile 2024-09-16T04:17:20.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj294 td/osd-backfill-space/datafile 2024-09-16T04:17:20.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj294 td/osd-backfill-space/datafile 2024-09-16T04:17:20.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:20.612 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:20.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj295 td/osd-backfill-space/datafile 2024-09-16T04:17:20.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj295 td/osd-backfill-space/datafile 2024-09-16T04:17:20.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj295 td/osd-backfill-space/datafile 2024-09-16T04:17:20.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj295 td/osd-backfill-space/datafile 2024-09-16T04:17:20.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj295 td/osd-backfill-space/datafile 2024-09-16T04:17:20.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:20.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj295 td/osd-backfill-space/datafile 2024-09-16T04:17:21.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj295 td/osd-backfill-space/datafile 2024-09-16T04:17:21.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj295 td/osd-backfill-space/datafile 2024-09-16T04:17:21.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:21.165 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:21.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj296 td/osd-backfill-space/datafile 2024-09-16T04:17:21.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj296 td/osd-backfill-space/datafile 2024-09-16T04:17:21.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj296 td/osd-backfill-space/datafile 2024-09-16T04:17:21.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj296 td/osd-backfill-space/datafile 2024-09-16T04:17:21.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj296 td/osd-backfill-space/datafile 2024-09-16T04:17:21.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj296 td/osd-backfill-space/datafile 2024-09-16T04:17:21.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj296 td/osd-backfill-space/datafile 2024-09-16T04:17:21.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj296 td/osd-backfill-space/datafile 2024-09-16T04:17:21.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:21.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:21.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj297 td/osd-backfill-space/datafile 2024-09-16T04:17:21.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj297 td/osd-backfill-space/datafile 2024-09-16T04:17:21.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj297 td/osd-backfill-space/datafile 2024-09-16T04:17:21.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:21.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj297 td/osd-backfill-space/datafile 2024-09-16T04:17:22.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj297 td/osd-backfill-space/datafile 2024-09-16T04:17:22.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj297 td/osd-backfill-space/datafile 2024-09-16T04:17:22.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj297 td/osd-backfill-space/datafile 2024-09-16T04:17:22.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj297 td/osd-backfill-space/datafile 2024-09-16T04:17:22.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:22.320 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:22.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj298 td/osd-backfill-space/datafile 2024-09-16T04:17:22.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj298 td/osd-backfill-space/datafile 2024-09-16T04:17:22.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj298 td/osd-backfill-space/datafile 2024-09-16T04:17:22.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj298 td/osd-backfill-space/datafile 2024-09-16T04:17:22.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj298 td/osd-backfill-space/datafile 2024-09-16T04:17:22.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj298 td/osd-backfill-space/datafile 2024-09-16T04:17:22.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj298 td/osd-backfill-space/datafile 2024-09-16T04:17:22.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj298 td/osd-backfill-space/datafile 2024-09-16T04:17:22.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:22.959 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:22.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:22.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj299 td/osd-backfill-space/datafile 2024-09-16T04:17:23.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj299 td/osd-backfill-space/datafile 2024-09-16T04:17:23.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj299 td/osd-backfill-space/datafile 2024-09-16T04:17:23.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj299 td/osd-backfill-space/datafile 2024-09-16T04:17:23.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj299 td/osd-backfill-space/datafile 2024-09-16T04:17:23.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj299 td/osd-backfill-space/datafile 2024-09-16T04:17:23.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj299 td/osd-backfill-space/datafile 2024-09-16T04:17:23.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj299 td/osd-backfill-space/datafile 2024-09-16T04:17:23.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:23.553 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:23.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj300 td/osd-backfill-space/datafile 2024-09-16T04:17:23.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj300 td/osd-backfill-space/datafile 2024-09-16T04:17:23.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj300 td/osd-backfill-space/datafile 2024-09-16T04:17:23.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj300 td/osd-backfill-space/datafile 2024-09-16T04:17:23.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj300 td/osd-backfill-space/datafile 2024-09-16T04:17:23.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj300 td/osd-backfill-space/datafile 2024-09-16T04:17:23.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:23.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj300 td/osd-backfill-space/datafile 2024-09-16T04:17:24.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj300 td/osd-backfill-space/datafile 2024-09-16T04:17:24.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:24.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:24.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj301 td/osd-backfill-space/datafile 2024-09-16T04:17:24.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj301 td/osd-backfill-space/datafile 2024-09-16T04:17:24.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj301 td/osd-backfill-space/datafile 2024-09-16T04:17:24.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj301 td/osd-backfill-space/datafile 2024-09-16T04:17:24.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj301 td/osd-backfill-space/datafile 2024-09-16T04:17:24.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj301 td/osd-backfill-space/datafile 2024-09-16T04:17:24.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj301 td/osd-backfill-space/datafile 2024-09-16T04:17:24.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj301 td/osd-backfill-space/datafile 2024-09-16T04:17:24.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:24.717 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:24.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj302 td/osd-backfill-space/datafile 2024-09-16T04:17:24.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj302 td/osd-backfill-space/datafile 2024-09-16T04:17:24.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj302 td/osd-backfill-space/datafile 2024-09-16T04:17:24.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:24.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj302 td/osd-backfill-space/datafile 2024-09-16T04:17:25.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj302 td/osd-backfill-space/datafile 2024-09-16T04:17:25.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj302 td/osd-backfill-space/datafile 2024-09-16T04:17:25.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj302 td/osd-backfill-space/datafile 2024-09-16T04:17:25.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj302 td/osd-backfill-space/datafile 2024-09-16T04:17:25.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:25.274 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:25.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj303 td/osd-backfill-space/datafile 2024-09-16T04:17:25.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj303 td/osd-backfill-space/datafile 2024-09-16T04:17:25.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj303 td/osd-backfill-space/datafile 2024-09-16T04:17:25.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj303 td/osd-backfill-space/datafile 2024-09-16T04:17:25.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj303 td/osd-backfill-space/datafile 2024-09-16T04:17:25.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj303 td/osd-backfill-space/datafile 2024-09-16T04:17:25.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj303 td/osd-backfill-space/datafile 2024-09-16T04:17:25.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj303 td/osd-backfill-space/datafile 2024-09-16T04:17:25.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:25.904 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:25.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj304 td/osd-backfill-space/datafile 2024-09-16T04:17:25.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:25.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj304 td/osd-backfill-space/datafile 2024-09-16T04:17:26.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj304 td/osd-backfill-space/datafile 2024-09-16T04:17:26.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj304 td/osd-backfill-space/datafile 2024-09-16T04:17:26.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj304 td/osd-backfill-space/datafile 2024-09-16T04:17:26.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj304 td/osd-backfill-space/datafile 2024-09-16T04:17:26.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj304 td/osd-backfill-space/datafile 2024-09-16T04:17:26.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj304 td/osd-backfill-space/datafile 2024-09-16T04:17:26.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:26.431 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:26.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj305 td/osd-backfill-space/datafile 2024-09-16T04:17:26.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj305 td/osd-backfill-space/datafile 2024-09-16T04:17:26.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj305 td/osd-backfill-space/datafile 2024-09-16T04:17:26.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj305 td/osd-backfill-space/datafile 2024-09-16T04:17:26.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj305 td/osd-backfill-space/datafile 2024-09-16T04:17:26.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj305 td/osd-backfill-space/datafile 2024-09-16T04:17:26.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj305 td/osd-backfill-space/datafile 2024-09-16T04:17:26.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:26.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj305 td/osd-backfill-space/datafile 2024-09-16T04:17:27.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:27.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:27.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj306 td/osd-backfill-space/datafile 2024-09-16T04:17:27.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj306 td/osd-backfill-space/datafile 2024-09-16T04:17:27.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj306 td/osd-backfill-space/datafile 2024-09-16T04:17:27.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj306 td/osd-backfill-space/datafile 2024-09-16T04:17:27.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj306 td/osd-backfill-space/datafile 2024-09-16T04:17:27.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj306 td/osd-backfill-space/datafile 2024-09-16T04:17:27.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj306 td/osd-backfill-space/datafile 2024-09-16T04:17:27.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj306 td/osd-backfill-space/datafile 2024-09-16T04:17:27.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:27.692 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:27.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj307 td/osd-backfill-space/datafile 2024-09-16T04:17:27.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj307 td/osd-backfill-space/datafile 2024-09-16T04:17:27.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj307 td/osd-backfill-space/datafile 2024-09-16T04:17:27.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj307 td/osd-backfill-space/datafile 2024-09-16T04:17:27.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:27.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj307 td/osd-backfill-space/datafile 2024-09-16T04:17:28.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj307 td/osd-backfill-space/datafile 2024-09-16T04:17:28.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj307 td/osd-backfill-space/datafile 2024-09-16T04:17:28.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj307 td/osd-backfill-space/datafile 2024-09-16T04:17:28.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:28.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:28.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj308 td/osd-backfill-space/datafile 2024-09-16T04:17:28.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj308 td/osd-backfill-space/datafile 2024-09-16T04:17:28.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj308 td/osd-backfill-space/datafile 2024-09-16T04:17:28.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj308 td/osd-backfill-space/datafile 2024-09-16T04:17:28.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj308 td/osd-backfill-space/datafile 2024-09-16T04:17:28.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj308 td/osd-backfill-space/datafile 2024-09-16T04:17:28.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj308 td/osd-backfill-space/datafile 2024-09-16T04:17:28.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj308 td/osd-backfill-space/datafile 2024-09-16T04:17:28.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:28.781 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:28.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj309 td/osd-backfill-space/datafile 2024-09-16T04:17:28.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj309 td/osd-backfill-space/datafile 2024-09-16T04:17:28.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:28.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj309 td/osd-backfill-space/datafile 2024-09-16T04:17:29.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj309 td/osd-backfill-space/datafile 2024-09-16T04:17:29.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj309 td/osd-backfill-space/datafile 2024-09-16T04:17:29.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj309 td/osd-backfill-space/datafile 2024-09-16T04:17:29.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj309 td/osd-backfill-space/datafile 2024-09-16T04:17:29.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj309 td/osd-backfill-space/datafile 2024-09-16T04:17:29.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:29.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:29.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj310 td/osd-backfill-space/datafile 2024-09-16T04:17:29.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj310 td/osd-backfill-space/datafile 2024-09-16T04:17:29.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj310 td/osd-backfill-space/datafile 2024-09-16T04:17:29.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj310 td/osd-backfill-space/datafile 2024-09-16T04:17:29.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj310 td/osd-backfill-space/datafile 2024-09-16T04:17:29.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj310 td/osd-backfill-space/datafile 2024-09-16T04:17:29.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj310 td/osd-backfill-space/datafile 2024-09-16T04:17:29.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj310 td/osd-backfill-space/datafile 2024-09-16T04:17:29.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:29.979 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:29.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:29.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj311 td/osd-backfill-space/datafile 2024-09-16T04:17:30.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj311 td/osd-backfill-space/datafile 2024-09-16T04:17:30.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj311 td/osd-backfill-space/datafile 2024-09-16T04:17:30.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj311 td/osd-backfill-space/datafile 2024-09-16T04:17:30.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj311 td/osd-backfill-space/datafile 2024-09-16T04:17:30.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj311 td/osd-backfill-space/datafile 2024-09-16T04:17:30.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj311 td/osd-backfill-space/datafile 2024-09-16T04:17:30.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj311 td/osd-backfill-space/datafile 2024-09-16T04:17:30.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:30.573 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:30.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj312 td/osd-backfill-space/datafile 2024-09-16T04:17:30.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj312 td/osd-backfill-space/datafile 2024-09-16T04:17:30.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj312 td/osd-backfill-space/datafile 2024-09-16T04:17:30.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj312 td/osd-backfill-space/datafile 2024-09-16T04:17:30.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj312 td/osd-backfill-space/datafile 2024-09-16T04:17:30.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:30.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj312 td/osd-backfill-space/datafile 2024-09-16T04:17:31.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj312 td/osd-backfill-space/datafile 2024-09-16T04:17:31.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj312 td/osd-backfill-space/datafile 2024-09-16T04:17:31.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:31.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:31.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj313 td/osd-backfill-space/datafile 2024-09-16T04:17:31.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj313 td/osd-backfill-space/datafile 2024-09-16T04:17:31.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj313 td/osd-backfill-space/datafile 2024-09-16T04:17:31.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj313 td/osd-backfill-space/datafile 2024-09-16T04:17:31.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj313 td/osd-backfill-space/datafile 2024-09-16T04:17:31.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj313 td/osd-backfill-space/datafile 2024-09-16T04:17:31.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj313 td/osd-backfill-space/datafile 2024-09-16T04:17:31.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj313 td/osd-backfill-space/datafile 2024-09-16T04:17:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:31.771 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj314 td/osd-backfill-space/datafile 2024-09-16T04:17:31.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj314 td/osd-backfill-space/datafile 2024-09-16T04:17:31.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj314 td/osd-backfill-space/datafile 2024-09-16T04:17:31.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:31.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj314 td/osd-backfill-space/datafile 2024-09-16T04:17:32.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj314 td/osd-backfill-space/datafile 2024-09-16T04:17:32.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj314 td/osd-backfill-space/datafile 2024-09-16T04:17:32.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj314 td/osd-backfill-space/datafile 2024-09-16T04:17:32.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj314 td/osd-backfill-space/datafile 2024-09-16T04:17:32.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:32.324 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:32.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj315 td/osd-backfill-space/datafile 2024-09-16T04:17:32.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj315 td/osd-backfill-space/datafile 2024-09-16T04:17:32.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj315 td/osd-backfill-space/datafile 2024-09-16T04:17:32.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj315 td/osd-backfill-space/datafile 2024-09-16T04:17:32.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj315 td/osd-backfill-space/datafile 2024-09-16T04:17:32.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj315 td/osd-backfill-space/datafile 2024-09-16T04:17:32.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj315 td/osd-backfill-space/datafile 2024-09-16T04:17:32.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj315 td/osd-backfill-space/datafile 2024-09-16T04:17:32.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:32.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:32.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:32.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj316 td/osd-backfill-space/datafile 2024-09-16T04:17:33.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj316 td/osd-backfill-space/datafile 2024-09-16T04:17:33.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj316 td/osd-backfill-space/datafile 2024-09-16T04:17:33.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj316 td/osd-backfill-space/datafile 2024-09-16T04:17:33.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj316 td/osd-backfill-space/datafile 2024-09-16T04:17:33.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj316 td/osd-backfill-space/datafile 2024-09-16T04:17:33.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj316 td/osd-backfill-space/datafile 2024-09-16T04:17:33.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj316 td/osd-backfill-space/datafile 2024-09-16T04:17:33.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:33.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:33.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj317 td/osd-backfill-space/datafile 2024-09-16T04:17:33.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj317 td/osd-backfill-space/datafile 2024-09-16T04:17:33.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj317 td/osd-backfill-space/datafile 2024-09-16T04:17:33.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj317 td/osd-backfill-space/datafile 2024-09-16T04:17:33.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj317 td/osd-backfill-space/datafile 2024-09-16T04:17:33.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj317 td/osd-backfill-space/datafile 2024-09-16T04:17:33.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:33.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj317 td/osd-backfill-space/datafile 2024-09-16T04:17:34.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj317 td/osd-backfill-space/datafile 2024-09-16T04:17:34.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:34.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:34.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj318 td/osd-backfill-space/datafile 2024-09-16T04:17:34.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj318 td/osd-backfill-space/datafile 2024-09-16T04:17:34.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj318 td/osd-backfill-space/datafile 2024-09-16T04:17:34.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj318 td/osd-backfill-space/datafile 2024-09-16T04:17:34.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj318 td/osd-backfill-space/datafile 2024-09-16T04:17:34.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj318 td/osd-backfill-space/datafile 2024-09-16T04:17:34.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj318 td/osd-backfill-space/datafile 2024-09-16T04:17:34.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj318 td/osd-backfill-space/datafile 2024-09-16T04:17:34.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:34.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:34.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj319 td/osd-backfill-space/datafile 2024-09-16T04:17:34.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj319 td/osd-backfill-space/datafile 2024-09-16T04:17:34.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj319 td/osd-backfill-space/datafile 2024-09-16T04:17:34.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj319 td/osd-backfill-space/datafile 2024-09-16T04:17:34.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:34.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj319 td/osd-backfill-space/datafile 2024-09-16T04:17:35.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj319 td/osd-backfill-space/datafile 2024-09-16T04:17:35.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj319 td/osd-backfill-space/datafile 2024-09-16T04:17:35.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj319 td/osd-backfill-space/datafile 2024-09-16T04:17:35.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:35.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:35.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj320 td/osd-backfill-space/datafile 2024-09-16T04:17:35.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj320 td/osd-backfill-space/datafile 2024-09-16T04:17:35.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj320 td/osd-backfill-space/datafile 2024-09-16T04:17:35.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj320 td/osd-backfill-space/datafile 2024-09-16T04:17:35.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj320 td/osd-backfill-space/datafile 2024-09-16T04:17:35.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj320 td/osd-backfill-space/datafile 2024-09-16T04:17:35.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj320 td/osd-backfill-space/datafile 2024-09-16T04:17:35.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj320 td/osd-backfill-space/datafile 2024-09-16T04:17:35.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:35.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:35.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj321 td/osd-backfill-space/datafile 2024-09-16T04:17:35.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:35.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj321 td/osd-backfill-space/datafile 2024-09-16T04:17:36.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj321 td/osd-backfill-space/datafile 2024-09-16T04:17:36.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj321 td/osd-backfill-space/datafile 2024-09-16T04:17:36.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj321 td/osd-backfill-space/datafile 2024-09-16T04:17:36.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj321 td/osd-backfill-space/datafile 2024-09-16T04:17:36.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj321 td/osd-backfill-space/datafile 2024-09-16T04:17:36.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj321 td/osd-backfill-space/datafile 2024-09-16T04:17:36.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:36.402 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:36.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj322 td/osd-backfill-space/datafile 2024-09-16T04:17:36.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj322 td/osd-backfill-space/datafile 2024-09-16T04:17:36.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj322 td/osd-backfill-space/datafile 2024-09-16T04:17:36.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj322 td/osd-backfill-space/datafile 2024-09-16T04:17:36.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj322 td/osd-backfill-space/datafile 2024-09-16T04:17:36.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj322 td/osd-backfill-space/datafile 2024-09-16T04:17:36.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj322 td/osd-backfill-space/datafile 2024-09-16T04:17:36.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj322 td/osd-backfill-space/datafile 2024-09-16T04:17:36.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:36.981 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:36.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:36.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj323 td/osd-backfill-space/datafile 2024-09-16T04:17:37.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj323 td/osd-backfill-space/datafile 2024-09-16T04:17:37.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj323 td/osd-backfill-space/datafile 2024-09-16T04:17:37.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj323 td/osd-backfill-space/datafile 2024-09-16T04:17:37.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj323 td/osd-backfill-space/datafile 2024-09-16T04:17:37.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj323 td/osd-backfill-space/datafile 2024-09-16T04:17:37.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj323 td/osd-backfill-space/datafile 2024-09-16T04:17:37.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj323 td/osd-backfill-space/datafile 2024-09-16T04:17:37.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:37.547 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:37.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj324 td/osd-backfill-space/datafile 2024-09-16T04:17:37.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj324 td/osd-backfill-space/datafile 2024-09-16T04:17:37.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj324 td/osd-backfill-space/datafile 2024-09-16T04:17:37.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj324 td/osd-backfill-space/datafile 2024-09-16T04:17:37.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj324 td/osd-backfill-space/datafile 2024-09-16T04:17:37.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:37.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj324 td/osd-backfill-space/datafile 2024-09-16T04:17:38.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj324 td/osd-backfill-space/datafile 2024-09-16T04:17:38.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj324 td/osd-backfill-space/datafile 2024-09-16T04:17:38.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:38.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:38.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj325 td/osd-backfill-space/datafile 2024-09-16T04:17:38.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj325 td/osd-backfill-space/datafile 2024-09-16T04:17:38.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj325 td/osd-backfill-space/datafile 2024-09-16T04:17:38.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj325 td/osd-backfill-space/datafile 2024-09-16T04:17:38.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj325 td/osd-backfill-space/datafile 2024-09-16T04:17:38.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj325 td/osd-backfill-space/datafile 2024-09-16T04:17:38.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj325 td/osd-backfill-space/datafile 2024-09-16T04:17:38.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj325 td/osd-backfill-space/datafile 2024-09-16T04:17:38.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:38.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:38.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj326 td/osd-backfill-space/datafile 2024-09-16T04:17:38.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj326 td/osd-backfill-space/datafile 2024-09-16T04:17:38.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj326 td/osd-backfill-space/datafile 2024-09-16T04:17:38.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj326 td/osd-backfill-space/datafile 2024-09-16T04:17:38.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:38.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj326 td/osd-backfill-space/datafile 2024-09-16T04:17:39.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj326 td/osd-backfill-space/datafile 2024-09-16T04:17:39.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj326 td/osd-backfill-space/datafile 2024-09-16T04:17:39.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj326 td/osd-backfill-space/datafile 2024-09-16T04:17:39.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:39.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:39.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj327 td/osd-backfill-space/datafile 2024-09-16T04:17:39.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj327 td/osd-backfill-space/datafile 2024-09-16T04:17:39.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj327 td/osd-backfill-space/datafile 2024-09-16T04:17:39.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj327 td/osd-backfill-space/datafile 2024-09-16T04:17:39.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj327 td/osd-backfill-space/datafile 2024-09-16T04:17:39.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj327 td/osd-backfill-space/datafile 2024-09-16T04:17:39.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj327 td/osd-backfill-space/datafile 2024-09-16T04:17:39.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj327 td/osd-backfill-space/datafile 2024-09-16T04:17:39.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:39.880 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:39.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj328 td/osd-backfill-space/datafile 2024-09-16T04:17:39.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:39.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj328 td/osd-backfill-space/datafile 2024-09-16T04:17:40.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj328 td/osd-backfill-space/datafile 2024-09-16T04:17:40.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj328 td/osd-backfill-space/datafile 2024-09-16T04:17:40.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj328 td/osd-backfill-space/datafile 2024-09-16T04:17:40.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj328 td/osd-backfill-space/datafile 2024-09-16T04:17:40.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj328 td/osd-backfill-space/datafile 2024-09-16T04:17:40.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj328 td/osd-backfill-space/datafile 2024-09-16T04:17:40.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:40.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:40.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj329 td/osd-backfill-space/datafile 2024-09-16T04:17:40.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj329 td/osd-backfill-space/datafile 2024-09-16T04:17:40.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj329 td/osd-backfill-space/datafile 2024-09-16T04:17:40.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj329 td/osd-backfill-space/datafile 2024-09-16T04:17:40.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj329 td/osd-backfill-space/datafile 2024-09-16T04:17:40.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj329 td/osd-backfill-space/datafile 2024-09-16T04:17:40.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj329 td/osd-backfill-space/datafile 2024-09-16T04:17:40.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:40.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj329 td/osd-backfill-space/datafile 2024-09-16T04:17:41.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:41.059 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:41.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj330 td/osd-backfill-space/datafile 2024-09-16T04:17:41.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj330 td/osd-backfill-space/datafile 2024-09-16T04:17:41.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj330 td/osd-backfill-space/datafile 2024-09-16T04:17:41.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj330 td/osd-backfill-space/datafile 2024-09-16T04:17:41.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj330 td/osd-backfill-space/datafile 2024-09-16T04:17:41.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj330 td/osd-backfill-space/datafile 2024-09-16T04:17:41.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj330 td/osd-backfill-space/datafile 2024-09-16T04:17:41.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj330 td/osd-backfill-space/datafile 2024-09-16T04:17:41.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:41.629 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:41.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj331 td/osd-backfill-space/datafile 2024-09-16T04:17:41.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj331 td/osd-backfill-space/datafile 2024-09-16T04:17:41.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj331 td/osd-backfill-space/datafile 2024-09-16T04:17:41.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj331 td/osd-backfill-space/datafile 2024-09-16T04:17:41.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj331 td/osd-backfill-space/datafile 2024-09-16T04:17:41.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:41.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj331 td/osd-backfill-space/datafile 2024-09-16T04:17:42.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:42.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj331 td/osd-backfill-space/datafile 2024-09-16T04:17:42.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:42.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj331 td/osd-backfill-space/datafile 2024-09-16T04:17:42.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:42.190 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:42.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:42.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj332 td/osd-backfill-space/datafile 2024-09-16T04:17:42.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:42.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj332 td/osd-backfill-space/datafile 2024-09-16T04:17:42.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:42.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj332 td/osd-backfill-space/datafile 2024-09-16T04:17:42.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:42.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj332 td/osd-backfill-space/datafile 2024-09-16T04:17:42.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:42.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj332 td/osd-backfill-space/datafile 2024-09-16T04:17:42.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:42.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj332 td/osd-backfill-space/datafile 2024-09-16T04:17:42.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:42.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj332 td/osd-backfill-space/datafile 2024-09-16T04:17:42.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:42.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj332 td/osd-backfill-space/datafile 2024-09-16T04:17:43.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:43.128 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:43.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:43.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj333 td/osd-backfill-space/datafile 2024-09-16T04:17:43.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:43.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj333 td/osd-backfill-space/datafile 2024-09-16T04:17:43.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:43.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj333 td/osd-backfill-space/datafile 2024-09-16T04:17:43.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:43.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj333 td/osd-backfill-space/datafile 2024-09-16T04:17:43.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:43.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj333 td/osd-backfill-space/datafile 2024-09-16T04:17:43.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:43.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj333 td/osd-backfill-space/datafile 2024-09-16T04:17:43.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:43.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj333 td/osd-backfill-space/datafile 2024-09-16T04:17:43.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:43.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj333 td/osd-backfill-space/datafile 2024-09-16T04:17:44.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:44.009 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:44.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj334 td/osd-backfill-space/datafile 2024-09-16T04:17:44.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj334 td/osd-backfill-space/datafile 2024-09-16T04:17:44.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj334 td/osd-backfill-space/datafile 2024-09-16T04:17:44.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj334 td/osd-backfill-space/datafile 2024-09-16T04:17:44.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj334 td/osd-backfill-space/datafile 2024-09-16T04:17:44.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj334 td/osd-backfill-space/datafile 2024-09-16T04:17:44.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj334 td/osd-backfill-space/datafile 2024-09-16T04:17:44.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj334 td/osd-backfill-space/datafile 2024-09-16T04:17:44.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:44.559 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:44.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj335 td/osd-backfill-space/datafile 2024-09-16T04:17:44.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj335 td/osd-backfill-space/datafile 2024-09-16T04:17:44.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj335 td/osd-backfill-space/datafile 2024-09-16T04:17:44.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj335 td/osd-backfill-space/datafile 2024-09-16T04:17:44.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj335 td/osd-backfill-space/datafile 2024-09-16T04:17:44.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj335 td/osd-backfill-space/datafile 2024-09-16T04:17:44.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:44.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj335 td/osd-backfill-space/datafile 2024-09-16T04:17:45.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj335 td/osd-backfill-space/datafile 2024-09-16T04:17:45.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:45.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:45.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj336 td/osd-backfill-space/datafile 2024-09-16T04:17:45.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj336 td/osd-backfill-space/datafile 2024-09-16T04:17:45.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj336 td/osd-backfill-space/datafile 2024-09-16T04:17:45.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj336 td/osd-backfill-space/datafile 2024-09-16T04:17:45.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj336 td/osd-backfill-space/datafile 2024-09-16T04:17:45.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj336 td/osd-backfill-space/datafile 2024-09-16T04:17:45.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj336 td/osd-backfill-space/datafile 2024-09-16T04:17:45.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj336 td/osd-backfill-space/datafile 2024-09-16T04:17:45.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:45.682 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:45.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj337 td/osd-backfill-space/datafile 2024-09-16T04:17:45.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj337 td/osd-backfill-space/datafile 2024-09-16T04:17:45.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj337 td/osd-backfill-space/datafile 2024-09-16T04:17:45.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj337 td/osd-backfill-space/datafile 2024-09-16T04:17:45.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:45.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj337 td/osd-backfill-space/datafile 2024-09-16T04:17:46.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj337 td/osd-backfill-space/datafile 2024-09-16T04:17:46.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj337 td/osd-backfill-space/datafile 2024-09-16T04:17:46.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj337 td/osd-backfill-space/datafile 2024-09-16T04:17:46.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:46.251 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:46.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj338 td/osd-backfill-space/datafile 2024-09-16T04:17:46.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj338 td/osd-backfill-space/datafile 2024-09-16T04:17:46.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj338 td/osd-backfill-space/datafile 2024-09-16T04:17:46.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj338 td/osd-backfill-space/datafile 2024-09-16T04:17:46.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj338 td/osd-backfill-space/datafile 2024-09-16T04:17:46.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj338 td/osd-backfill-space/datafile 2024-09-16T04:17:46.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj338 td/osd-backfill-space/datafile 2024-09-16T04:17:46.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj338 td/osd-backfill-space/datafile 2024-09-16T04:17:46.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:46.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:46.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj339 td/osd-backfill-space/datafile 2024-09-16T04:17:46.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj339 td/osd-backfill-space/datafile 2024-09-16T04:17:46.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:46.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj339 td/osd-backfill-space/datafile 2024-09-16T04:17:47.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj339 td/osd-backfill-space/datafile 2024-09-16T04:17:47.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj339 td/osd-backfill-space/datafile 2024-09-16T04:17:47.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj339 td/osd-backfill-space/datafile 2024-09-16T04:17:47.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj339 td/osd-backfill-space/datafile 2024-09-16T04:17:47.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj339 td/osd-backfill-space/datafile 2024-09-16T04:17:47.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:47.398 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:47.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj340 td/osd-backfill-space/datafile 2024-09-16T04:17:47.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj340 td/osd-backfill-space/datafile 2024-09-16T04:17:47.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj340 td/osd-backfill-space/datafile 2024-09-16T04:17:47.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj340 td/osd-backfill-space/datafile 2024-09-16T04:17:47.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj340 td/osd-backfill-space/datafile 2024-09-16T04:17:47.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj340 td/osd-backfill-space/datafile 2024-09-16T04:17:47.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj340 td/osd-backfill-space/datafile 2024-09-16T04:17:47.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj340 td/osd-backfill-space/datafile 2024-09-16T04:17:47.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:47.984 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:47.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:47.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj341 td/osd-backfill-space/datafile 2024-09-16T04:17:48.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj341 td/osd-backfill-space/datafile 2024-09-16T04:17:48.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj341 td/osd-backfill-space/datafile 2024-09-16T04:17:48.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj341 td/osd-backfill-space/datafile 2024-09-16T04:17:48.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj341 td/osd-backfill-space/datafile 2024-09-16T04:17:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj341 td/osd-backfill-space/datafile 2024-09-16T04:17:48.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj341 td/osd-backfill-space/datafile 2024-09-16T04:17:48.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj341 td/osd-backfill-space/datafile 2024-09-16T04:17:48.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:48.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:48.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj342 td/osd-backfill-space/datafile 2024-09-16T04:17:48.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj342 td/osd-backfill-space/datafile 2024-09-16T04:17:48.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj342 td/osd-backfill-space/datafile 2024-09-16T04:17:48.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj342 td/osd-backfill-space/datafile 2024-09-16T04:17:48.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj342 td/osd-backfill-space/datafile 2024-09-16T04:17:48.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:48.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj342 td/osd-backfill-space/datafile 2024-09-16T04:17:49.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj342 td/osd-backfill-space/datafile 2024-09-16T04:17:49.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj342 td/osd-backfill-space/datafile 2024-09-16T04:17:49.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:49.156 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:49.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj343 td/osd-backfill-space/datafile 2024-09-16T04:17:49.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj343 td/osd-backfill-space/datafile 2024-09-16T04:17:49.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj343 td/osd-backfill-space/datafile 2024-09-16T04:17:49.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj343 td/osd-backfill-space/datafile 2024-09-16T04:17:49.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj343 td/osd-backfill-space/datafile 2024-09-16T04:17:49.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj343 td/osd-backfill-space/datafile 2024-09-16T04:17:49.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj343 td/osd-backfill-space/datafile 2024-09-16T04:17:49.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj343 td/osd-backfill-space/datafile 2024-09-16T04:17:49.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:49.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:49.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj344 td/osd-backfill-space/datafile 2024-09-16T04:17:49.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj344 td/osd-backfill-space/datafile 2024-09-16T04:17:49.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj344 td/osd-backfill-space/datafile 2024-09-16T04:17:49.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:49.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj344 td/osd-backfill-space/datafile 2024-09-16T04:17:50.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj344 td/osd-backfill-space/datafile 2024-09-16T04:17:50.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj344 td/osd-backfill-space/datafile 2024-09-16T04:17:50.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj344 td/osd-backfill-space/datafile 2024-09-16T04:17:50.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj344 td/osd-backfill-space/datafile 2024-09-16T04:17:50.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:50.286 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:50.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj345 td/osd-backfill-space/datafile 2024-09-16T04:17:50.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj345 td/osd-backfill-space/datafile 2024-09-16T04:17:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj345 td/osd-backfill-space/datafile 2024-09-16T04:17:50.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj345 td/osd-backfill-space/datafile 2024-09-16T04:17:50.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj345 td/osd-backfill-space/datafile 2024-09-16T04:17:50.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj345 td/osd-backfill-space/datafile 2024-09-16T04:17:50.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj345 td/osd-backfill-space/datafile 2024-09-16T04:17:50.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj345 td/osd-backfill-space/datafile 2024-09-16T04:17:50.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:50.873 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:50.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj346 td/osd-backfill-space/datafile 2024-09-16T04:17:50.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:50.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj346 td/osd-backfill-space/datafile 2024-09-16T04:17:51.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj346 td/osd-backfill-space/datafile 2024-09-16T04:17:51.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj346 td/osd-backfill-space/datafile 2024-09-16T04:17:51.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj346 td/osd-backfill-space/datafile 2024-09-16T04:17:51.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj346 td/osd-backfill-space/datafile 2024-09-16T04:17:51.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj346 td/osd-backfill-space/datafile 2024-09-16T04:17:51.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj346 td/osd-backfill-space/datafile 2024-09-16T04:17:51.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:51.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:51.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj347 td/osd-backfill-space/datafile 2024-09-16T04:17:51.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj347 td/osd-backfill-space/datafile 2024-09-16T04:17:51.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj347 td/osd-backfill-space/datafile 2024-09-16T04:17:51.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj347 td/osd-backfill-space/datafile 2024-09-16T04:17:51.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj347 td/osd-backfill-space/datafile 2024-09-16T04:17:51.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj347 td/osd-backfill-space/datafile 2024-09-16T04:17:51.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj347 td/osd-backfill-space/datafile 2024-09-16T04:17:51.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:51.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj347 td/osd-backfill-space/datafile 2024-09-16T04:17:52.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:52.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:52.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj348 td/osd-backfill-space/datafile 2024-09-16T04:17:52.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj348 td/osd-backfill-space/datafile 2024-09-16T04:17:52.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj348 td/osd-backfill-space/datafile 2024-09-16T04:17:52.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj348 td/osd-backfill-space/datafile 2024-09-16T04:17:52.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj348 td/osd-backfill-space/datafile 2024-09-16T04:17:52.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj348 td/osd-backfill-space/datafile 2024-09-16T04:17:52.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj348 td/osd-backfill-space/datafile 2024-09-16T04:17:52.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj348 td/osd-backfill-space/datafile 2024-09-16T04:17:52.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:52.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:52.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj349 td/osd-backfill-space/datafile 2024-09-16T04:17:52.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj349 td/osd-backfill-space/datafile 2024-09-16T04:17:52.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj349 td/osd-backfill-space/datafile 2024-09-16T04:17:52.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj349 td/osd-backfill-space/datafile 2024-09-16T04:17:52.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj349 td/osd-backfill-space/datafile 2024-09-16T04:17:52.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:52.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj349 td/osd-backfill-space/datafile 2024-09-16T04:17:53.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj349 td/osd-backfill-space/datafile 2024-09-16T04:17:53.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj349 td/osd-backfill-space/datafile 2024-09-16T04:17:53.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:53.142 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:53.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj350 td/osd-backfill-space/datafile 2024-09-16T04:17:53.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj350 td/osd-backfill-space/datafile 2024-09-16T04:17:53.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj350 td/osd-backfill-space/datafile 2024-09-16T04:17:53.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj350 td/osd-backfill-space/datafile 2024-09-16T04:17:53.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj350 td/osd-backfill-space/datafile 2024-09-16T04:17:53.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj350 td/osd-backfill-space/datafile 2024-09-16T04:17:53.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj350 td/osd-backfill-space/datafile 2024-09-16T04:17:53.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj350 td/osd-backfill-space/datafile 2024-09-16T04:17:53.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:53.719 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:53.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj351 td/osd-backfill-space/datafile 2024-09-16T04:17:53.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj351 td/osd-backfill-space/datafile 2024-09-16T04:17:53.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj351 td/osd-backfill-space/datafile 2024-09-16T04:17:53.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:53.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj351 td/osd-backfill-space/datafile 2024-09-16T04:17:54.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj351 td/osd-backfill-space/datafile 2024-09-16T04:17:54.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj351 td/osd-backfill-space/datafile 2024-09-16T04:17:54.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj351 td/osd-backfill-space/datafile 2024-09-16T04:17:54.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj351 td/osd-backfill-space/datafile 2024-09-16T04:17:54.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:54.364 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:54.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj352 td/osd-backfill-space/datafile 2024-09-16T04:17:54.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj352 td/osd-backfill-space/datafile 2024-09-16T04:17:54.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj352 td/osd-backfill-space/datafile 2024-09-16T04:17:54.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj352 td/osd-backfill-space/datafile 2024-09-16T04:17:54.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj352 td/osd-backfill-space/datafile 2024-09-16T04:17:54.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj352 td/osd-backfill-space/datafile 2024-09-16T04:17:54.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj352 td/osd-backfill-space/datafile 2024-09-16T04:17:54.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj352 td/osd-backfill-space/datafile 2024-09-16T04:17:54.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:54.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:54.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:54.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj353 td/osd-backfill-space/datafile 2024-09-16T04:17:55.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj353 td/osd-backfill-space/datafile 2024-09-16T04:17:55.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj353 td/osd-backfill-space/datafile 2024-09-16T04:17:55.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj353 td/osd-backfill-space/datafile 2024-09-16T04:17:55.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj353 td/osd-backfill-space/datafile 2024-09-16T04:17:55.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj353 td/osd-backfill-space/datafile 2024-09-16T04:17:55.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj353 td/osd-backfill-space/datafile 2024-09-16T04:17:55.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj353 td/osd-backfill-space/datafile 2024-09-16T04:17:55.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:55.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:55.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj354 td/osd-backfill-space/datafile 2024-09-16T04:17:55.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj354 td/osd-backfill-space/datafile 2024-09-16T04:17:55.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj354 td/osd-backfill-space/datafile 2024-09-16T04:17:55.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj354 td/osd-backfill-space/datafile 2024-09-16T04:17:55.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj354 td/osd-backfill-space/datafile 2024-09-16T04:17:55.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj354 td/osd-backfill-space/datafile 2024-09-16T04:17:55.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:55.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj354 td/osd-backfill-space/datafile 2024-09-16T04:17:56.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj354 td/osd-backfill-space/datafile 2024-09-16T04:17:56.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:56.079 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:56.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj355 td/osd-backfill-space/datafile 2024-09-16T04:17:56.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj355 td/osd-backfill-space/datafile 2024-09-16T04:17:56.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj355 td/osd-backfill-space/datafile 2024-09-16T04:17:56.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj355 td/osd-backfill-space/datafile 2024-09-16T04:17:56.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj355 td/osd-backfill-space/datafile 2024-09-16T04:17:56.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj355 td/osd-backfill-space/datafile 2024-09-16T04:17:56.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj355 td/osd-backfill-space/datafile 2024-09-16T04:17:56.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj355 td/osd-backfill-space/datafile 2024-09-16T04:17:56.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:56.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:56.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj356 td/osd-backfill-space/datafile 2024-09-16T04:17:56.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj356 td/osd-backfill-space/datafile 2024-09-16T04:17:56.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj356 td/osd-backfill-space/datafile 2024-09-16T04:17:56.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj356 td/osd-backfill-space/datafile 2024-09-16T04:17:56.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj356 td/osd-backfill-space/datafile 2024-09-16T04:17:56.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:56.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj356 td/osd-backfill-space/datafile 2024-09-16T04:17:57.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj356 td/osd-backfill-space/datafile 2024-09-16T04:17:57.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj356 td/osd-backfill-space/datafile 2024-09-16T04:17:57.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:57.192 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:57.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj357 td/osd-backfill-space/datafile 2024-09-16T04:17:57.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj357 td/osd-backfill-space/datafile 2024-09-16T04:17:57.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj357 td/osd-backfill-space/datafile 2024-09-16T04:17:57.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj357 td/osd-backfill-space/datafile 2024-09-16T04:17:57.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj357 td/osd-backfill-space/datafile 2024-09-16T04:17:57.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj357 td/osd-backfill-space/datafile 2024-09-16T04:17:57.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj357 td/osd-backfill-space/datafile 2024-09-16T04:17:57.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj357 td/osd-backfill-space/datafile 2024-09-16T04:17:57.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:57.788 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:57.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj358 td/osd-backfill-space/datafile 2024-09-16T04:17:57.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj358 td/osd-backfill-space/datafile 2024-09-16T04:17:57.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj358 td/osd-backfill-space/datafile 2024-09-16T04:17:57.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:57.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj358 td/osd-backfill-space/datafile 2024-09-16T04:17:58.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj358 td/osd-backfill-space/datafile 2024-09-16T04:17:58.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj358 td/osd-backfill-space/datafile 2024-09-16T04:17:58.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj358 td/osd-backfill-space/datafile 2024-09-16T04:17:58.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj358 td/osd-backfill-space/datafile 2024-09-16T04:17:58.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:58.331 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:58.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj359 td/osd-backfill-space/datafile 2024-09-16T04:17:58.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj359 td/osd-backfill-space/datafile 2024-09-16T04:17:58.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj359 td/osd-backfill-space/datafile 2024-09-16T04:17:58.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj359 td/osd-backfill-space/datafile 2024-09-16T04:17:58.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj359 td/osd-backfill-space/datafile 2024-09-16T04:17:58.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj359 td/osd-backfill-space/datafile 2024-09-16T04:17:58.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj359 td/osd-backfill-space/datafile 2024-09-16T04:17:58.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj359 td/osd-backfill-space/datafile 2024-09-16T04:17:58.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:58.893 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:58.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj360 td/osd-backfill-space/datafile 2024-09-16T04:17:58.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:58.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj360 td/osd-backfill-space/datafile 2024-09-16T04:17:59.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj360 td/osd-backfill-space/datafile 2024-09-16T04:17:59.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj360 td/osd-backfill-space/datafile 2024-09-16T04:17:59.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj360 td/osd-backfill-space/datafile 2024-09-16T04:17:59.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj360 td/osd-backfill-space/datafile 2024-09-16T04:17:59.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj360 td/osd-backfill-space/datafile 2024-09-16T04:17:59.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj360 td/osd-backfill-space/datafile 2024-09-16T04:17:59.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:17:59.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:17:59.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj361 td/osd-backfill-space/datafile 2024-09-16T04:17:59.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj361 td/osd-backfill-space/datafile 2024-09-16T04:17:59.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj361 td/osd-backfill-space/datafile 2024-09-16T04:17:59.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj361 td/osd-backfill-space/datafile 2024-09-16T04:17:59.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj361 td/osd-backfill-space/datafile 2024-09-16T04:17:59.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj361 td/osd-backfill-space/datafile 2024-09-16T04:17:59.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj361 td/osd-backfill-space/datafile 2024-09-16T04:17:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:17:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj361 td/osd-backfill-space/datafile 2024-09-16T04:18:00.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:00.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:00.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj362 td/osd-backfill-space/datafile 2024-09-16T04:18:00.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj362 td/osd-backfill-space/datafile 2024-09-16T04:18:00.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj362 td/osd-backfill-space/datafile 2024-09-16T04:18:00.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj362 td/osd-backfill-space/datafile 2024-09-16T04:18:00.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj362 td/osd-backfill-space/datafile 2024-09-16T04:18:00.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj362 td/osd-backfill-space/datafile 2024-09-16T04:18:00.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj362 td/osd-backfill-space/datafile 2024-09-16T04:18:00.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj362 td/osd-backfill-space/datafile 2024-09-16T04:18:00.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:00.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:00.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj363 td/osd-backfill-space/datafile 2024-09-16T04:18:00.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj363 td/osd-backfill-space/datafile 2024-09-16T04:18:00.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj363 td/osd-backfill-space/datafile 2024-09-16T04:18:00.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj363 td/osd-backfill-space/datafile 2024-09-16T04:18:00.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj363 td/osd-backfill-space/datafile 2024-09-16T04:18:00.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:00.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj363 td/osd-backfill-space/datafile 2024-09-16T04:18:01.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj363 td/osd-backfill-space/datafile 2024-09-16T04:18:01.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj363 td/osd-backfill-space/datafile 2024-09-16T04:18:01.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:01.170 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:01.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj364 td/osd-backfill-space/datafile 2024-09-16T04:18:01.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj364 td/osd-backfill-space/datafile 2024-09-16T04:18:01.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj364 td/osd-backfill-space/datafile 2024-09-16T04:18:01.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj364 td/osd-backfill-space/datafile 2024-09-16T04:18:01.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj364 td/osd-backfill-space/datafile 2024-09-16T04:18:01.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj364 td/osd-backfill-space/datafile 2024-09-16T04:18:01.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj364 td/osd-backfill-space/datafile 2024-09-16T04:18:01.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj364 td/osd-backfill-space/datafile 2024-09-16T04:18:01.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:01.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:01.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj365 td/osd-backfill-space/datafile 2024-09-16T04:18:01.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj365 td/osd-backfill-space/datafile 2024-09-16T04:18:01.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj365 td/osd-backfill-space/datafile 2024-09-16T04:18:01.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:01.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj365 td/osd-backfill-space/datafile 2024-09-16T04:18:02.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj365 td/osd-backfill-space/datafile 2024-09-16T04:18:02.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj365 td/osd-backfill-space/datafile 2024-09-16T04:18:02.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj365 td/osd-backfill-space/datafile 2024-09-16T04:18:02.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj365 td/osd-backfill-space/datafile 2024-09-16T04:18:02.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:02.333 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:02.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj366 td/osd-backfill-space/datafile 2024-09-16T04:18:02.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj366 td/osd-backfill-space/datafile 2024-09-16T04:18:02.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj366 td/osd-backfill-space/datafile 2024-09-16T04:18:02.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj366 td/osd-backfill-space/datafile 2024-09-16T04:18:02.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj366 td/osd-backfill-space/datafile 2024-09-16T04:18:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj366 td/osd-backfill-space/datafile 2024-09-16T04:18:02.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj366 td/osd-backfill-space/datafile 2024-09-16T04:18:02.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj366 td/osd-backfill-space/datafile 2024-09-16T04:18:02.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:02.919 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:02.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj367 td/osd-backfill-space/datafile 2024-09-16T04:18:02.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:02.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj367 td/osd-backfill-space/datafile 2024-09-16T04:18:03.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj367 td/osd-backfill-space/datafile 2024-09-16T04:18:03.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj367 td/osd-backfill-space/datafile 2024-09-16T04:18:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj367 td/osd-backfill-space/datafile 2024-09-16T04:18:03.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj367 td/osd-backfill-space/datafile 2024-09-16T04:18:03.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj367 td/osd-backfill-space/datafile 2024-09-16T04:18:03.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj367 td/osd-backfill-space/datafile 2024-09-16T04:18:03.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:03.479 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:03.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj368 td/osd-backfill-space/datafile 2024-09-16T04:18:03.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj368 td/osd-backfill-space/datafile 2024-09-16T04:18:03.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj368 td/osd-backfill-space/datafile 2024-09-16T04:18:03.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj368 td/osd-backfill-space/datafile 2024-09-16T04:18:03.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj368 td/osd-backfill-space/datafile 2024-09-16T04:18:03.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj368 td/osd-backfill-space/datafile 2024-09-16T04:18:03.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:03.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj368 td/osd-backfill-space/datafile 2024-09-16T04:18:04.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj368 td/osd-backfill-space/datafile 2024-09-16T04:18:04.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:04.068 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:04.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj369 td/osd-backfill-space/datafile 2024-09-16T04:18:04.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj369 td/osd-backfill-space/datafile 2024-09-16T04:18:04.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj369 td/osd-backfill-space/datafile 2024-09-16T04:18:04.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj369 td/osd-backfill-space/datafile 2024-09-16T04:18:04.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj369 td/osd-backfill-space/datafile 2024-09-16T04:18:04.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj369 td/osd-backfill-space/datafile 2024-09-16T04:18:04.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj369 td/osd-backfill-space/datafile 2024-09-16T04:18:04.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj369 td/osd-backfill-space/datafile 2024-09-16T04:18:04.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:04.646 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:04.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj370 td/osd-backfill-space/datafile 2024-09-16T04:18:04.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj370 td/osd-backfill-space/datafile 2024-09-16T04:18:04.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj370 td/osd-backfill-space/datafile 2024-09-16T04:18:04.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj370 td/osd-backfill-space/datafile 2024-09-16T04:18:04.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:04.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj370 td/osd-backfill-space/datafile 2024-09-16T04:18:05.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj370 td/osd-backfill-space/datafile 2024-09-16T04:18:05.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj370 td/osd-backfill-space/datafile 2024-09-16T04:18:05.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj370 td/osd-backfill-space/datafile 2024-09-16T04:18:05.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:05.224 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:05.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj371 td/osd-backfill-space/datafile 2024-09-16T04:18:05.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj371 td/osd-backfill-space/datafile 2024-09-16T04:18:05.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj371 td/osd-backfill-space/datafile 2024-09-16T04:18:05.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj371 td/osd-backfill-space/datafile 2024-09-16T04:18:05.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj371 td/osd-backfill-space/datafile 2024-09-16T04:18:05.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj371 td/osd-backfill-space/datafile 2024-09-16T04:18:05.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj371 td/osd-backfill-space/datafile 2024-09-16T04:18:05.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj371 td/osd-backfill-space/datafile 2024-09-16T04:18:05.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:05.801 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:05.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj372 td/osd-backfill-space/datafile 2024-09-16T04:18:05.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj372 td/osd-backfill-space/datafile 2024-09-16T04:18:05.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:05.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj372 td/osd-backfill-space/datafile 2024-09-16T04:18:06.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj372 td/osd-backfill-space/datafile 2024-09-16T04:18:06.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj372 td/osd-backfill-space/datafile 2024-09-16T04:18:06.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj372 td/osd-backfill-space/datafile 2024-09-16T04:18:06.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj372 td/osd-backfill-space/datafile 2024-09-16T04:18:06.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj372 td/osd-backfill-space/datafile 2024-09-16T04:18:06.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:06.361 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:06.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj373 td/osd-backfill-space/datafile 2024-09-16T04:18:06.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj373 td/osd-backfill-space/datafile 2024-09-16T04:18:06.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj373 td/osd-backfill-space/datafile 2024-09-16T04:18:06.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj373 td/osd-backfill-space/datafile 2024-09-16T04:18:06.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj373 td/osd-backfill-space/datafile 2024-09-16T04:18:06.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj373 td/osd-backfill-space/datafile 2024-09-16T04:18:06.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj373 td/osd-backfill-space/datafile 2024-09-16T04:18:06.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj373 td/osd-backfill-space/datafile 2024-09-16T04:18:06.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:06.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:06.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj374 td/osd-backfill-space/datafile 2024-09-16T04:18:06.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:06.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj374 td/osd-backfill-space/datafile 2024-09-16T04:18:07.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj374 td/osd-backfill-space/datafile 2024-09-16T04:18:07.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj374 td/osd-backfill-space/datafile 2024-09-16T04:18:07.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj374 td/osd-backfill-space/datafile 2024-09-16T04:18:07.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj374 td/osd-backfill-space/datafile 2024-09-16T04:18:07.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj374 td/osd-backfill-space/datafile 2024-09-16T04:18:07.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj374 td/osd-backfill-space/datafile 2024-09-16T04:18:07.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:07.467 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:07.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj375 td/osd-backfill-space/datafile 2024-09-16T04:18:07.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj375 td/osd-backfill-space/datafile 2024-09-16T04:18:07.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj375 td/osd-backfill-space/datafile 2024-09-16T04:18:07.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj375 td/osd-backfill-space/datafile 2024-09-16T04:18:07.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj375 td/osd-backfill-space/datafile 2024-09-16T04:18:07.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj375 td/osd-backfill-space/datafile 2024-09-16T04:18:07.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj375 td/osd-backfill-space/datafile 2024-09-16T04:18:07.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:07.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj375 td/osd-backfill-space/datafile 2024-09-16T04:18:08.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:08.062 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:08.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj376 td/osd-backfill-space/datafile 2024-09-16T04:18:08.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj376 td/osd-backfill-space/datafile 2024-09-16T04:18:08.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj376 td/osd-backfill-space/datafile 2024-09-16T04:18:08.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj376 td/osd-backfill-space/datafile 2024-09-16T04:18:08.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj376 td/osd-backfill-space/datafile 2024-09-16T04:18:08.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj376 td/osd-backfill-space/datafile 2024-09-16T04:18:08.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj376 td/osd-backfill-space/datafile 2024-09-16T04:18:08.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj376 td/osd-backfill-space/datafile 2024-09-16T04:18:08.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:08.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:08.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj377 td/osd-backfill-space/datafile 2024-09-16T04:18:08.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj377 td/osd-backfill-space/datafile 2024-09-16T04:18:08.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj377 td/osd-backfill-space/datafile 2024-09-16T04:18:08.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj377 td/osd-backfill-space/datafile 2024-09-16T04:18:08.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj377 td/osd-backfill-space/datafile 2024-09-16T04:18:08.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:08.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj377 td/osd-backfill-space/datafile 2024-09-16T04:18:09.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj377 td/osd-backfill-space/datafile 2024-09-16T04:18:09.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj377 td/osd-backfill-space/datafile 2024-09-16T04:18:09.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:09.183 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:09.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj378 td/osd-backfill-space/datafile 2024-09-16T04:18:09.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj378 td/osd-backfill-space/datafile 2024-09-16T04:18:09.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj378 td/osd-backfill-space/datafile 2024-09-16T04:18:09.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj378 td/osd-backfill-space/datafile 2024-09-16T04:18:09.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj378 td/osd-backfill-space/datafile 2024-09-16T04:18:09.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj378 td/osd-backfill-space/datafile 2024-09-16T04:18:09.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj378 td/osd-backfill-space/datafile 2024-09-16T04:18:09.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj378 td/osd-backfill-space/datafile 2024-09-16T04:18:09.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:09.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:09.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj379 td/osd-backfill-space/datafile 2024-09-16T04:18:09.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj379 td/osd-backfill-space/datafile 2024-09-16T04:18:09.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:09.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj379 td/osd-backfill-space/datafile 2024-09-16T04:18:10.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj379 td/osd-backfill-space/datafile 2024-09-16T04:18:10.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj379 td/osd-backfill-space/datafile 2024-09-16T04:18:10.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj379 td/osd-backfill-space/datafile 2024-09-16T04:18:10.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj379 td/osd-backfill-space/datafile 2024-09-16T04:18:10.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj379 td/osd-backfill-space/datafile 2024-09-16T04:18:10.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:10.372 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:10.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj380 td/osd-backfill-space/datafile 2024-09-16T04:18:10.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj380 td/osd-backfill-space/datafile 2024-09-16T04:18:10.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj380 td/osd-backfill-space/datafile 2024-09-16T04:18:10.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj380 td/osd-backfill-space/datafile 2024-09-16T04:18:10.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj380 td/osd-backfill-space/datafile 2024-09-16T04:18:10.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj380 td/osd-backfill-space/datafile 2024-09-16T04:18:10.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj380 td/osd-backfill-space/datafile 2024-09-16T04:18:10.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj380 td/osd-backfill-space/datafile 2024-09-16T04:18:10.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:10.900 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:10.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj381 td/osd-backfill-space/datafile 2024-09-16T04:18:10.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:10.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj381 td/osd-backfill-space/datafile 2024-09-16T04:18:11.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj381 td/osd-backfill-space/datafile 2024-09-16T04:18:11.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj381 td/osd-backfill-space/datafile 2024-09-16T04:18:11.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj381 td/osd-backfill-space/datafile 2024-09-16T04:18:11.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj381 td/osd-backfill-space/datafile 2024-09-16T04:18:11.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj381 td/osd-backfill-space/datafile 2024-09-16T04:18:11.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj381 td/osd-backfill-space/datafile 2024-09-16T04:18:11.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:11.452 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:11.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj382 td/osd-backfill-space/datafile 2024-09-16T04:18:11.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj382 td/osd-backfill-space/datafile 2024-09-16T04:18:11.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj382 td/osd-backfill-space/datafile 2024-09-16T04:18:11.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj382 td/osd-backfill-space/datafile 2024-09-16T04:18:11.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj382 td/osd-backfill-space/datafile 2024-09-16T04:18:11.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj382 td/osd-backfill-space/datafile 2024-09-16T04:18:11.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj382 td/osd-backfill-space/datafile 2024-09-16T04:18:11.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:11.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj382 td/osd-backfill-space/datafile 2024-09-16T04:18:12.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:12.013 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:12.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj383 td/osd-backfill-space/datafile 2024-09-16T04:18:12.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj383 td/osd-backfill-space/datafile 2024-09-16T04:18:12.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj383 td/osd-backfill-space/datafile 2024-09-16T04:18:12.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj383 td/osd-backfill-space/datafile 2024-09-16T04:18:12.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj383 td/osd-backfill-space/datafile 2024-09-16T04:18:12.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj383 td/osd-backfill-space/datafile 2024-09-16T04:18:12.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj383 td/osd-backfill-space/datafile 2024-09-16T04:18:12.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj383 td/osd-backfill-space/datafile 2024-09-16T04:18:12.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:12.548 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:12.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj384 td/osd-backfill-space/datafile 2024-09-16T04:18:12.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj384 td/osd-backfill-space/datafile 2024-09-16T04:18:12.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj384 td/osd-backfill-space/datafile 2024-09-16T04:18:12.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj384 td/osd-backfill-space/datafile 2024-09-16T04:18:12.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj384 td/osd-backfill-space/datafile 2024-09-16T04:18:12.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj384 td/osd-backfill-space/datafile 2024-09-16T04:18:12.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:12.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj384 td/osd-backfill-space/datafile 2024-09-16T04:18:13.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj384 td/osd-backfill-space/datafile 2024-09-16T04:18:13.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:13.135 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:13.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj385 td/osd-backfill-space/datafile 2024-09-16T04:18:13.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj385 td/osd-backfill-space/datafile 2024-09-16T04:18:13.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj385 td/osd-backfill-space/datafile 2024-09-16T04:18:13.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj385 td/osd-backfill-space/datafile 2024-09-16T04:18:13.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj385 td/osd-backfill-space/datafile 2024-09-16T04:18:13.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj385 td/osd-backfill-space/datafile 2024-09-16T04:18:13.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj385 td/osd-backfill-space/datafile 2024-09-16T04:18:13.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj385 td/osd-backfill-space/datafile 2024-09-16T04:18:13.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:13.713 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:13.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj386 td/osd-backfill-space/datafile 2024-09-16T04:18:13.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj386 td/osd-backfill-space/datafile 2024-09-16T04:18:13.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj386 td/osd-backfill-space/datafile 2024-09-16T04:18:13.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj386 td/osd-backfill-space/datafile 2024-09-16T04:18:13.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:13.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj386 td/osd-backfill-space/datafile 2024-09-16T04:18:14.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:14.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj386 td/osd-backfill-space/datafile 2024-09-16T04:18:14.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:14.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj386 td/osd-backfill-space/datafile 2024-09-16T04:18:14.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:14.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj386 td/osd-backfill-space/datafile 2024-09-16T04:18:14.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:14.248 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:14.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:14.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj387 td/osd-backfill-space/datafile 2024-09-16T04:18:14.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:14.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj387 td/osd-backfill-space/datafile 2024-09-16T04:18:14.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:14.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj387 td/osd-backfill-space/datafile 2024-09-16T04:18:14.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:14.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj387 td/osd-backfill-space/datafile 2024-09-16T04:18:14.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:14.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj387 td/osd-backfill-space/datafile 2024-09-16T04:18:15.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:15.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj387 td/osd-backfill-space/datafile 2024-09-16T04:18:15.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:15.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj387 td/osd-backfill-space/datafile 2024-09-16T04:18:15.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:15.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj387 td/osd-backfill-space/datafile 2024-09-16T04:18:15.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:15.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:15.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:15.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj388 td/osd-backfill-space/datafile 2024-09-16T04:18:15.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:15.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj388 td/osd-backfill-space/datafile 2024-09-16T04:18:15.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:15.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj388 td/osd-backfill-space/datafile 2024-09-16T04:18:15.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:15.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj388 td/osd-backfill-space/datafile 2024-09-16T04:18:15.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:15.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj388 td/osd-backfill-space/datafile 2024-09-16T04:18:15.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:15.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj388 td/osd-backfill-space/datafile 2024-09-16T04:18:15.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:15.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj388 td/osd-backfill-space/datafile 2024-09-16T04:18:16.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj388 td/osd-backfill-space/datafile 2024-09-16T04:18:16.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:16.116 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:16.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj389 td/osd-backfill-space/datafile 2024-09-16T04:18:16.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj389 td/osd-backfill-space/datafile 2024-09-16T04:18:16.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj389 td/osd-backfill-space/datafile 2024-09-16T04:18:16.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj389 td/osd-backfill-space/datafile 2024-09-16T04:18:16.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj389 td/osd-backfill-space/datafile 2024-09-16T04:18:16.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj389 td/osd-backfill-space/datafile 2024-09-16T04:18:16.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj389 td/osd-backfill-space/datafile 2024-09-16T04:18:16.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj389 td/osd-backfill-space/datafile 2024-09-16T04:18:16.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:16.685 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:16.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj390 td/osd-backfill-space/datafile 2024-09-16T04:18:16.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj390 td/osd-backfill-space/datafile 2024-09-16T04:18:16.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj390 td/osd-backfill-space/datafile 2024-09-16T04:18:16.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj390 td/osd-backfill-space/datafile 2024-09-16T04:18:16.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:16.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj390 td/osd-backfill-space/datafile 2024-09-16T04:18:17.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj390 td/osd-backfill-space/datafile 2024-09-16T04:18:17.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj390 td/osd-backfill-space/datafile 2024-09-16T04:18:17.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj390 td/osd-backfill-space/datafile 2024-09-16T04:18:17.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:17.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:17.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj391 td/osd-backfill-space/datafile 2024-09-16T04:18:17.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj391 td/osd-backfill-space/datafile 2024-09-16T04:18:17.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj391 td/osd-backfill-space/datafile 2024-09-16T04:18:17.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj391 td/osd-backfill-space/datafile 2024-09-16T04:18:17.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj391 td/osd-backfill-space/datafile 2024-09-16T04:18:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj391 td/osd-backfill-space/datafile 2024-09-16T04:18:17.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj391 td/osd-backfill-space/datafile 2024-09-16T04:18:17.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj391 td/osd-backfill-space/datafile 2024-09-16T04:18:17.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:17.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:17.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj392 td/osd-backfill-space/datafile 2024-09-16T04:18:17.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj392 td/osd-backfill-space/datafile 2024-09-16T04:18:17.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:17.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj392 td/osd-backfill-space/datafile 2024-09-16T04:18:18.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj392 td/osd-backfill-space/datafile 2024-09-16T04:18:18.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj392 td/osd-backfill-space/datafile 2024-09-16T04:18:18.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj392 td/osd-backfill-space/datafile 2024-09-16T04:18:18.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj392 td/osd-backfill-space/datafile 2024-09-16T04:18:18.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj392 td/osd-backfill-space/datafile 2024-09-16T04:18:18.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:18.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:18.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj393 td/osd-backfill-space/datafile 2024-09-16T04:18:18.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj393 td/osd-backfill-space/datafile 2024-09-16T04:18:18.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj393 td/osd-backfill-space/datafile 2024-09-16T04:18:18.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj393 td/osd-backfill-space/datafile 2024-09-16T04:18:18.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj393 td/osd-backfill-space/datafile 2024-09-16T04:18:18.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj393 td/osd-backfill-space/datafile 2024-09-16T04:18:18.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj393 td/osd-backfill-space/datafile 2024-09-16T04:18:18.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj393 td/osd-backfill-space/datafile 2024-09-16T04:18:18.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:18.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:18.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:18.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj394 td/osd-backfill-space/datafile 2024-09-16T04:18:19.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj394 td/osd-backfill-space/datafile 2024-09-16T04:18:19.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj394 td/osd-backfill-space/datafile 2024-09-16T04:18:19.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj394 td/osd-backfill-space/datafile 2024-09-16T04:18:19.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj394 td/osd-backfill-space/datafile 2024-09-16T04:18:19.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj394 td/osd-backfill-space/datafile 2024-09-16T04:18:19.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj394 td/osd-backfill-space/datafile 2024-09-16T04:18:19.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj394 td/osd-backfill-space/datafile 2024-09-16T04:18:19.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:19.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:19.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj395 td/osd-backfill-space/datafile 2024-09-16T04:18:19.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj395 td/osd-backfill-space/datafile 2024-09-16T04:18:19.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj395 td/osd-backfill-space/datafile 2024-09-16T04:18:19.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj395 td/osd-backfill-space/datafile 2024-09-16T04:18:19.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj395 td/osd-backfill-space/datafile 2024-09-16T04:18:19.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj395 td/osd-backfill-space/datafile 2024-09-16T04:18:19.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:19.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj395 td/osd-backfill-space/datafile 2024-09-16T04:18:20.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj395 td/osd-backfill-space/datafile 2024-09-16T04:18:20.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:20.125 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:20.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj396 td/osd-backfill-space/datafile 2024-09-16T04:18:20.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj396 td/osd-backfill-space/datafile 2024-09-16T04:18:20.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj396 td/osd-backfill-space/datafile 2024-09-16T04:18:20.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj396 td/osd-backfill-space/datafile 2024-09-16T04:18:20.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj396 td/osd-backfill-space/datafile 2024-09-16T04:18:20.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj396 td/osd-backfill-space/datafile 2024-09-16T04:18:20.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj396 td/osd-backfill-space/datafile 2024-09-16T04:18:20.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj396 td/osd-backfill-space/datafile 2024-09-16T04:18:20.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:20.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:20.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj397 td/osd-backfill-space/datafile 2024-09-16T04:18:20.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj397 td/osd-backfill-space/datafile 2024-09-16T04:18:20.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj397 td/osd-backfill-space/datafile 2024-09-16T04:18:20.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:20.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj397 td/osd-backfill-space/datafile 2024-09-16T04:18:21.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj397 td/osd-backfill-space/datafile 2024-09-16T04:18:21.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj397 td/osd-backfill-space/datafile 2024-09-16T04:18:21.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj397 td/osd-backfill-space/datafile 2024-09-16T04:18:21.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj397 td/osd-backfill-space/datafile 2024-09-16T04:18:21.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:21.289 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:21.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj398 td/osd-backfill-space/datafile 2024-09-16T04:18:21.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj398 td/osd-backfill-space/datafile 2024-09-16T04:18:21.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj398 td/osd-backfill-space/datafile 2024-09-16T04:18:21.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj398 td/osd-backfill-space/datafile 2024-09-16T04:18:21.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj398 td/osd-backfill-space/datafile 2024-09-16T04:18:21.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj398 td/osd-backfill-space/datafile 2024-09-16T04:18:21.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj398 td/osd-backfill-space/datafile 2024-09-16T04:18:21.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj398 td/osd-backfill-space/datafile 2024-09-16T04:18:21.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:21.884 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:21.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj399 td/osd-backfill-space/datafile 2024-09-16T04:18:21.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:21.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj399 td/osd-backfill-space/datafile 2024-09-16T04:18:22.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj399 td/osd-backfill-space/datafile 2024-09-16T04:18:22.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj399 td/osd-backfill-space/datafile 2024-09-16T04:18:22.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj399 td/osd-backfill-space/datafile 2024-09-16T04:18:22.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj399 td/osd-backfill-space/datafile 2024-09-16T04:18:22.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj399 td/osd-backfill-space/datafile 2024-09-16T04:18:22.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj399 td/osd-backfill-space/datafile 2024-09-16T04:18:22.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:22.428 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:22.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj400 td/osd-backfill-space/datafile 2024-09-16T04:18:22.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj400 td/osd-backfill-space/datafile 2024-09-16T04:18:22.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj400 td/osd-backfill-space/datafile 2024-09-16T04:18:22.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj400 td/osd-backfill-space/datafile 2024-09-16T04:18:22.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj400 td/osd-backfill-space/datafile 2024-09-16T04:18:22.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj400 td/osd-backfill-space/datafile 2024-09-16T04:18:22.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj400 td/osd-backfill-space/datafile 2024-09-16T04:18:22.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj400 td/osd-backfill-space/datafile 2024-09-16T04:18:22.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:22.997 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:22.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:22.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj401 td/osd-backfill-space/datafile 2024-09-16T04:18:23.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj401 td/osd-backfill-space/datafile 2024-09-16T04:18:23.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj401 td/osd-backfill-space/datafile 2024-09-16T04:18:23.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj401 td/osd-backfill-space/datafile 2024-09-16T04:18:23.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj401 td/osd-backfill-space/datafile 2024-09-16T04:18:23.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj401 td/osd-backfill-space/datafile 2024-09-16T04:18:23.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj401 td/osd-backfill-space/datafile 2024-09-16T04:18:23.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj401 td/osd-backfill-space/datafile 2024-09-16T04:18:23.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:23.561 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:23.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj402 td/osd-backfill-space/datafile 2024-09-16T04:18:23.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj402 td/osd-backfill-space/datafile 2024-09-16T04:18:23.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj402 td/osd-backfill-space/datafile 2024-09-16T04:18:23.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj402 td/osd-backfill-space/datafile 2024-09-16T04:18:23.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj402 td/osd-backfill-space/datafile 2024-09-16T04:18:23.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj402 td/osd-backfill-space/datafile 2024-09-16T04:18:23.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:23.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj402 td/osd-backfill-space/datafile 2024-09-16T04:18:24.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj402 td/osd-backfill-space/datafile 2024-09-16T04:18:24.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:24.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:24.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj403 td/osd-backfill-space/datafile 2024-09-16T04:18:24.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj403 td/osd-backfill-space/datafile 2024-09-16T04:18:24.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj403 td/osd-backfill-space/datafile 2024-09-16T04:18:24.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj403 td/osd-backfill-space/datafile 2024-09-16T04:18:24.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj403 td/osd-backfill-space/datafile 2024-09-16T04:18:24.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj403 td/osd-backfill-space/datafile 2024-09-16T04:18:24.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj403 td/osd-backfill-space/datafile 2024-09-16T04:18:24.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj403 td/osd-backfill-space/datafile 2024-09-16T04:18:24.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:24.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:24.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj404 td/osd-backfill-space/datafile 2024-09-16T04:18:24.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj404 td/osd-backfill-space/datafile 2024-09-16T04:18:24.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj404 td/osd-backfill-space/datafile 2024-09-16T04:18:24.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj404 td/osd-backfill-space/datafile 2024-09-16T04:18:24.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj404 td/osd-backfill-space/datafile 2024-09-16T04:18:24.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:24.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj404 td/osd-backfill-space/datafile 2024-09-16T04:18:25.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj404 td/osd-backfill-space/datafile 2024-09-16T04:18:25.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj404 td/osd-backfill-space/datafile 2024-09-16T04:18:25.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:25.183 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:25.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj405 td/osd-backfill-space/datafile 2024-09-16T04:18:25.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj405 td/osd-backfill-space/datafile 2024-09-16T04:18:25.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj405 td/osd-backfill-space/datafile 2024-09-16T04:18:25.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj405 td/osd-backfill-space/datafile 2024-09-16T04:18:25.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj405 td/osd-backfill-space/datafile 2024-09-16T04:18:25.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj405 td/osd-backfill-space/datafile 2024-09-16T04:18:25.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj405 td/osd-backfill-space/datafile 2024-09-16T04:18:25.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj405 td/osd-backfill-space/datafile 2024-09-16T04:18:25.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:25.812 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:25.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj406 td/osd-backfill-space/datafile 2024-09-16T04:18:25.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj406 td/osd-backfill-space/datafile 2024-09-16T04:18:25.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:25.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj406 td/osd-backfill-space/datafile 2024-09-16T04:18:26.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj406 td/osd-backfill-space/datafile 2024-09-16T04:18:26.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj406 td/osd-backfill-space/datafile 2024-09-16T04:18:26.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj406 td/osd-backfill-space/datafile 2024-09-16T04:18:26.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj406 td/osd-backfill-space/datafile 2024-09-16T04:18:26.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj406 td/osd-backfill-space/datafile 2024-09-16T04:18:26.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:26.339 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:26.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj407 td/osd-backfill-space/datafile 2024-09-16T04:18:26.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj407 td/osd-backfill-space/datafile 2024-09-16T04:18:26.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj407 td/osd-backfill-space/datafile 2024-09-16T04:18:26.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj407 td/osd-backfill-space/datafile 2024-09-16T04:18:26.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj407 td/osd-backfill-space/datafile 2024-09-16T04:18:26.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj407 td/osd-backfill-space/datafile 2024-09-16T04:18:26.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj407 td/osd-backfill-space/datafile 2024-09-16T04:18:26.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj407 td/osd-backfill-space/datafile 2024-09-16T04:18:26.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:26.909 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:26.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:26.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj408 td/osd-backfill-space/datafile 2024-09-16T04:18:27.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj408 td/osd-backfill-space/datafile 2024-09-16T04:18:27.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj408 td/osd-backfill-space/datafile 2024-09-16T04:18:27.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj408 td/osd-backfill-space/datafile 2024-09-16T04:18:27.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj408 td/osd-backfill-space/datafile 2024-09-16T04:18:27.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj408 td/osd-backfill-space/datafile 2024-09-16T04:18:27.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj408 td/osd-backfill-space/datafile 2024-09-16T04:18:27.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj408 td/osd-backfill-space/datafile 2024-09-16T04:18:27.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:27.462 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:27.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj409 td/osd-backfill-space/datafile 2024-09-16T04:18:27.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj409 td/osd-backfill-space/datafile 2024-09-16T04:18:27.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj409 td/osd-backfill-space/datafile 2024-09-16T04:18:27.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj409 td/osd-backfill-space/datafile 2024-09-16T04:18:27.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj409 td/osd-backfill-space/datafile 2024-09-16T04:18:27.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj409 td/osd-backfill-space/datafile 2024-09-16T04:18:27.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj409 td/osd-backfill-space/datafile 2024-09-16T04:18:27.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:27.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj409 td/osd-backfill-space/datafile 2024-09-16T04:18:28.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:28.032 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:28.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj410 td/osd-backfill-space/datafile 2024-09-16T04:18:28.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj410 td/osd-backfill-space/datafile 2024-09-16T04:18:28.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj410 td/osd-backfill-space/datafile 2024-09-16T04:18:28.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj410 td/osd-backfill-space/datafile 2024-09-16T04:18:28.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj410 td/osd-backfill-space/datafile 2024-09-16T04:18:28.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj410 td/osd-backfill-space/datafile 2024-09-16T04:18:28.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj410 td/osd-backfill-space/datafile 2024-09-16T04:18:28.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj410 td/osd-backfill-space/datafile 2024-09-16T04:18:28.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:28.577 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:28.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj411 td/osd-backfill-space/datafile 2024-09-16T04:18:28.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj411 td/osd-backfill-space/datafile 2024-09-16T04:18:28.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj411 td/osd-backfill-space/datafile 2024-09-16T04:18:28.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj411 td/osd-backfill-space/datafile 2024-09-16T04:18:28.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj411 td/osd-backfill-space/datafile 2024-09-16T04:18:28.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:28.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj411 td/osd-backfill-space/datafile 2024-09-16T04:18:29.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj411 td/osd-backfill-space/datafile 2024-09-16T04:18:29.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj411 td/osd-backfill-space/datafile 2024-09-16T04:18:29.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:29.155 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:29.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj412 td/osd-backfill-space/datafile 2024-09-16T04:18:29.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj412 td/osd-backfill-space/datafile 2024-09-16T04:18:29.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj412 td/osd-backfill-space/datafile 2024-09-16T04:18:29.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj412 td/osd-backfill-space/datafile 2024-09-16T04:18:29.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj412 td/osd-backfill-space/datafile 2024-09-16T04:18:29.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj412 td/osd-backfill-space/datafile 2024-09-16T04:18:29.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj412 td/osd-backfill-space/datafile 2024-09-16T04:18:29.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj412 td/osd-backfill-space/datafile 2024-09-16T04:18:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:29.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj413 td/osd-backfill-space/datafile 2024-09-16T04:18:29.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj413 td/osd-backfill-space/datafile 2024-09-16T04:18:29.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj413 td/osd-backfill-space/datafile 2024-09-16T04:18:29.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:29.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj413 td/osd-backfill-space/datafile 2024-09-16T04:18:30.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj413 td/osd-backfill-space/datafile 2024-09-16T04:18:30.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj413 td/osd-backfill-space/datafile 2024-09-16T04:18:30.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj413 td/osd-backfill-space/datafile 2024-09-16T04:18:30.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj413 td/osd-backfill-space/datafile 2024-09-16T04:18:30.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:30.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:30.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj414 td/osd-backfill-space/datafile 2024-09-16T04:18:30.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj414 td/osd-backfill-space/datafile 2024-09-16T04:18:30.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj414 td/osd-backfill-space/datafile 2024-09-16T04:18:30.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj414 td/osd-backfill-space/datafile 2024-09-16T04:18:30.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj414 td/osd-backfill-space/datafile 2024-09-16T04:18:30.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj414 td/osd-backfill-space/datafile 2024-09-16T04:18:30.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj414 td/osd-backfill-space/datafile 2024-09-16T04:18:30.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj414 td/osd-backfill-space/datafile 2024-09-16T04:18:30.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:30.913 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:30.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj415 td/osd-backfill-space/datafile 2024-09-16T04:18:30.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:30.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj415 td/osd-backfill-space/datafile 2024-09-16T04:18:31.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj415 td/osd-backfill-space/datafile 2024-09-16T04:18:31.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj415 td/osd-backfill-space/datafile 2024-09-16T04:18:31.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj415 td/osd-backfill-space/datafile 2024-09-16T04:18:31.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj415 td/osd-backfill-space/datafile 2024-09-16T04:18:31.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj415 td/osd-backfill-space/datafile 2024-09-16T04:18:31.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj415 td/osd-backfill-space/datafile 2024-09-16T04:18:31.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:31.457 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:31.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj416 td/osd-backfill-space/datafile 2024-09-16T04:18:31.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj416 td/osd-backfill-space/datafile 2024-09-16T04:18:31.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj416 td/osd-backfill-space/datafile 2024-09-16T04:18:31.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj416 td/osd-backfill-space/datafile 2024-09-16T04:18:31.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj416 td/osd-backfill-space/datafile 2024-09-16T04:18:31.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj416 td/osd-backfill-space/datafile 2024-09-16T04:18:31.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj416 td/osd-backfill-space/datafile 2024-09-16T04:18:31.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:31.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj416 td/osd-backfill-space/datafile 2024-09-16T04:18:32.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:32.029 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:32.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj417 td/osd-backfill-space/datafile 2024-09-16T04:18:32.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj417 td/osd-backfill-space/datafile 2024-09-16T04:18:32.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj417 td/osd-backfill-space/datafile 2024-09-16T04:18:32.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj417 td/osd-backfill-space/datafile 2024-09-16T04:18:32.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj417 td/osd-backfill-space/datafile 2024-09-16T04:18:32.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj417 td/osd-backfill-space/datafile 2024-09-16T04:18:32.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj417 td/osd-backfill-space/datafile 2024-09-16T04:18:32.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj417 td/osd-backfill-space/datafile 2024-09-16T04:18:32.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:32.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:32.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj418 td/osd-backfill-space/datafile 2024-09-16T04:18:32.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj418 td/osd-backfill-space/datafile 2024-09-16T04:18:32.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj418 td/osd-backfill-space/datafile 2024-09-16T04:18:32.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj418 td/osd-backfill-space/datafile 2024-09-16T04:18:32.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj418 td/osd-backfill-space/datafile 2024-09-16T04:18:32.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:32.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj418 td/osd-backfill-space/datafile 2024-09-16T04:18:33.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj418 td/osd-backfill-space/datafile 2024-09-16T04:18:33.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj418 td/osd-backfill-space/datafile 2024-09-16T04:18:33.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:33.127 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:33.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj419 td/osd-backfill-space/datafile 2024-09-16T04:18:33.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj419 td/osd-backfill-space/datafile 2024-09-16T04:18:33.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj419 td/osd-backfill-space/datafile 2024-09-16T04:18:33.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj419 td/osd-backfill-space/datafile 2024-09-16T04:18:33.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj419 td/osd-backfill-space/datafile 2024-09-16T04:18:33.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj419 td/osd-backfill-space/datafile 2024-09-16T04:18:33.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj419 td/osd-backfill-space/datafile 2024-09-16T04:18:33.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj419 td/osd-backfill-space/datafile 2024-09-16T04:18:33.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:33.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:33.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj420 td/osd-backfill-space/datafile 2024-09-16T04:18:33.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj420 td/osd-backfill-space/datafile 2024-09-16T04:18:33.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj420 td/osd-backfill-space/datafile 2024-09-16T04:18:33.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj420 td/osd-backfill-space/datafile 2024-09-16T04:18:33.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:33.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj420 td/osd-backfill-space/datafile 2024-09-16T04:18:34.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj420 td/osd-backfill-space/datafile 2024-09-16T04:18:34.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj420 td/osd-backfill-space/datafile 2024-09-16T04:18:34.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj420 td/osd-backfill-space/datafile 2024-09-16T04:18:34.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:34.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:34.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj421 td/osd-backfill-space/datafile 2024-09-16T04:18:34.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj421 td/osd-backfill-space/datafile 2024-09-16T04:18:34.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj421 td/osd-backfill-space/datafile 2024-09-16T04:18:34.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj421 td/osd-backfill-space/datafile 2024-09-16T04:18:34.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj421 td/osd-backfill-space/datafile 2024-09-16T04:18:34.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj421 td/osd-backfill-space/datafile 2024-09-16T04:18:34.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj421 td/osd-backfill-space/datafile 2024-09-16T04:18:34.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj421 td/osd-backfill-space/datafile 2024-09-16T04:18:34.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:34.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:34.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj422 td/osd-backfill-space/datafile 2024-09-16T04:18:34.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj422 td/osd-backfill-space/datafile 2024-09-16T04:18:34.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:34.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj422 td/osd-backfill-space/datafile 2024-09-16T04:18:35.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj422 td/osd-backfill-space/datafile 2024-09-16T04:18:35.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj422 td/osd-backfill-space/datafile 2024-09-16T04:18:35.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj422 td/osd-backfill-space/datafile 2024-09-16T04:18:35.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj422 td/osd-backfill-space/datafile 2024-09-16T04:18:35.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj422 td/osd-backfill-space/datafile 2024-09-16T04:18:35.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:35.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:35.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj423 td/osd-backfill-space/datafile 2024-09-16T04:18:35.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj423 td/osd-backfill-space/datafile 2024-09-16T04:18:35.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj423 td/osd-backfill-space/datafile 2024-09-16T04:18:35.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj423 td/osd-backfill-space/datafile 2024-09-16T04:18:35.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj423 td/osd-backfill-space/datafile 2024-09-16T04:18:35.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj423 td/osd-backfill-space/datafile 2024-09-16T04:18:35.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj423 td/osd-backfill-space/datafile 2024-09-16T04:18:35.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj423 td/osd-backfill-space/datafile 2024-09-16T04:18:35.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:35.974 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:35.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:35.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj424 td/osd-backfill-space/datafile 2024-09-16T04:18:36.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj424 td/osd-backfill-space/datafile 2024-09-16T04:18:36.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj424 td/osd-backfill-space/datafile 2024-09-16T04:18:36.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj424 td/osd-backfill-space/datafile 2024-09-16T04:18:36.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj424 td/osd-backfill-space/datafile 2024-09-16T04:18:36.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj424 td/osd-backfill-space/datafile 2024-09-16T04:18:36.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj424 td/osd-backfill-space/datafile 2024-09-16T04:18:36.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj424 td/osd-backfill-space/datafile 2024-09-16T04:18:36.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:36.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:36.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj425 td/osd-backfill-space/datafile 2024-09-16T04:18:36.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj425 td/osd-backfill-space/datafile 2024-09-16T04:18:36.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj425 td/osd-backfill-space/datafile 2024-09-16T04:18:36.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj425 td/osd-backfill-space/datafile 2024-09-16T04:18:36.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj425 td/osd-backfill-space/datafile 2024-09-16T04:18:36.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:36.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj425 td/osd-backfill-space/datafile 2024-09-16T04:18:37.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj425 td/osd-backfill-space/datafile 2024-09-16T04:18:37.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj425 td/osd-backfill-space/datafile 2024-09-16T04:18:37.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:37.137 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:37.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj426 td/osd-backfill-space/datafile 2024-09-16T04:18:37.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj426 td/osd-backfill-space/datafile 2024-09-16T04:18:37.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj426 td/osd-backfill-space/datafile 2024-09-16T04:18:37.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj426 td/osd-backfill-space/datafile 2024-09-16T04:18:37.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj426 td/osd-backfill-space/datafile 2024-09-16T04:18:37.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj426 td/osd-backfill-space/datafile 2024-09-16T04:18:37.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj426 td/osd-backfill-space/datafile 2024-09-16T04:18:37.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj426 td/osd-backfill-space/datafile 2024-09-16T04:18:37.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:37.683 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:37.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj427 td/osd-backfill-space/datafile 2024-09-16T04:18:37.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj427 td/osd-backfill-space/datafile 2024-09-16T04:18:37.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj427 td/osd-backfill-space/datafile 2024-09-16T04:18:37.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj427 td/osd-backfill-space/datafile 2024-09-16T04:18:37.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:37.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj427 td/osd-backfill-space/datafile 2024-09-16T04:18:38.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj427 td/osd-backfill-space/datafile 2024-09-16T04:18:38.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj427 td/osd-backfill-space/datafile 2024-09-16T04:18:38.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj427 td/osd-backfill-space/datafile 2024-09-16T04:18:38.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:38.219 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:38.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj428 td/osd-backfill-space/datafile 2024-09-16T04:18:38.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj428 td/osd-backfill-space/datafile 2024-09-16T04:18:38.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj428 td/osd-backfill-space/datafile 2024-09-16T04:18:38.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj428 td/osd-backfill-space/datafile 2024-09-16T04:18:38.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj428 td/osd-backfill-space/datafile 2024-09-16T04:18:38.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj428 td/osd-backfill-space/datafile 2024-09-16T04:18:38.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj428 td/osd-backfill-space/datafile 2024-09-16T04:18:38.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj428 td/osd-backfill-space/datafile 2024-09-16T04:18:38.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:38.788 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:38.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj429 td/osd-backfill-space/datafile 2024-09-16T04:18:38.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj429 td/osd-backfill-space/datafile 2024-09-16T04:18:38.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj429 td/osd-backfill-space/datafile 2024-09-16T04:18:38.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:38.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj429 td/osd-backfill-space/datafile 2024-09-16T04:18:39.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj429 td/osd-backfill-space/datafile 2024-09-16T04:18:39.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj429 td/osd-backfill-space/datafile 2024-09-16T04:18:39.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj429 td/osd-backfill-space/datafile 2024-09-16T04:18:39.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj429 td/osd-backfill-space/datafile 2024-09-16T04:18:39.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:39.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:39.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj430 td/osd-backfill-space/datafile 2024-09-16T04:18:39.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj430 td/osd-backfill-space/datafile 2024-09-16T04:18:39.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj430 td/osd-backfill-space/datafile 2024-09-16T04:18:39.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj430 td/osd-backfill-space/datafile 2024-09-16T04:18:39.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj430 td/osd-backfill-space/datafile 2024-09-16T04:18:39.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj430 td/osd-backfill-space/datafile 2024-09-16T04:18:39.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj430 td/osd-backfill-space/datafile 2024-09-16T04:18:39.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj430 td/osd-backfill-space/datafile 2024-09-16T04:18:39.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:39.919 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:39.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj431 td/osd-backfill-space/datafile 2024-09-16T04:18:39.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:39.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj431 td/osd-backfill-space/datafile 2024-09-16T04:18:40.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj431 td/osd-backfill-space/datafile 2024-09-16T04:18:40.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj431 td/osd-backfill-space/datafile 2024-09-16T04:18:40.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj431 td/osd-backfill-space/datafile 2024-09-16T04:18:40.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj431 td/osd-backfill-space/datafile 2024-09-16T04:18:40.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj431 td/osd-backfill-space/datafile 2024-09-16T04:18:40.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj431 td/osd-backfill-space/datafile 2024-09-16T04:18:40.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:40.471 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:40.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj432 td/osd-backfill-space/datafile 2024-09-16T04:18:40.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj432 td/osd-backfill-space/datafile 2024-09-16T04:18:40.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj432 td/osd-backfill-space/datafile 2024-09-16T04:18:40.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj432 td/osd-backfill-space/datafile 2024-09-16T04:18:40.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj432 td/osd-backfill-space/datafile 2024-09-16T04:18:40.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj432 td/osd-backfill-space/datafile 2024-09-16T04:18:40.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:40.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj432 td/osd-backfill-space/datafile 2024-09-16T04:18:41.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj432 td/osd-backfill-space/datafile 2024-09-16T04:18:41.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:41.074 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:41.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj433 td/osd-backfill-space/datafile 2024-09-16T04:18:41.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj433 td/osd-backfill-space/datafile 2024-09-16T04:18:41.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj433 td/osd-backfill-space/datafile 2024-09-16T04:18:41.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj433 td/osd-backfill-space/datafile 2024-09-16T04:18:41.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj433 td/osd-backfill-space/datafile 2024-09-16T04:18:41.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj433 td/osd-backfill-space/datafile 2024-09-16T04:18:41.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj433 td/osd-backfill-space/datafile 2024-09-16T04:18:41.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj433 td/osd-backfill-space/datafile 2024-09-16T04:18:41.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:41.694 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:41.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj434 td/osd-backfill-space/datafile 2024-09-16T04:18:41.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj434 td/osd-backfill-space/datafile 2024-09-16T04:18:41.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj434 td/osd-backfill-space/datafile 2024-09-16T04:18:41.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj434 td/osd-backfill-space/datafile 2024-09-16T04:18:41.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:41.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj434 td/osd-backfill-space/datafile 2024-09-16T04:18:42.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj434 td/osd-backfill-space/datafile 2024-09-16T04:18:42.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj434 td/osd-backfill-space/datafile 2024-09-16T04:18:42.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj434 td/osd-backfill-space/datafile 2024-09-16T04:18:42.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:42.230 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:42.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj435 td/osd-backfill-space/datafile 2024-09-16T04:18:42.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj435 td/osd-backfill-space/datafile 2024-09-16T04:18:42.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj435 td/osd-backfill-space/datafile 2024-09-16T04:18:42.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj435 td/osd-backfill-space/datafile 2024-09-16T04:18:42.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj435 td/osd-backfill-space/datafile 2024-09-16T04:18:42.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj435 td/osd-backfill-space/datafile 2024-09-16T04:18:42.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj435 td/osd-backfill-space/datafile 2024-09-16T04:18:42.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj435 td/osd-backfill-space/datafile 2024-09-16T04:18:42.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:42.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:42.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj436 td/osd-backfill-space/datafile 2024-09-16T04:18:42.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj436 td/osd-backfill-space/datafile 2024-09-16T04:18:42.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj436 td/osd-backfill-space/datafile 2024-09-16T04:18:42.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:42.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj436 td/osd-backfill-space/datafile 2024-09-16T04:18:43.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj436 td/osd-backfill-space/datafile 2024-09-16T04:18:43.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj436 td/osd-backfill-space/datafile 2024-09-16T04:18:43.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj436 td/osd-backfill-space/datafile 2024-09-16T04:18:43.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj436 td/osd-backfill-space/datafile 2024-09-16T04:18:43.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:43.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:43.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj437 td/osd-backfill-space/datafile 2024-09-16T04:18:43.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj437 td/osd-backfill-space/datafile 2024-09-16T04:18:43.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj437 td/osd-backfill-space/datafile 2024-09-16T04:18:43.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj437 td/osd-backfill-space/datafile 2024-09-16T04:18:43.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj437 td/osd-backfill-space/datafile 2024-09-16T04:18:43.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj437 td/osd-backfill-space/datafile 2024-09-16T04:18:43.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj437 td/osd-backfill-space/datafile 2024-09-16T04:18:43.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj437 td/osd-backfill-space/datafile 2024-09-16T04:18:43.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:43.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:43.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj438 td/osd-backfill-space/datafile 2024-09-16T04:18:43.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:43.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj438 td/osd-backfill-space/datafile 2024-09-16T04:18:44.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj438 td/osd-backfill-space/datafile 2024-09-16T04:18:44.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj438 td/osd-backfill-space/datafile 2024-09-16T04:18:44.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj438 td/osd-backfill-space/datafile 2024-09-16T04:18:44.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj438 td/osd-backfill-space/datafile 2024-09-16T04:18:44.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj438 td/osd-backfill-space/datafile 2024-09-16T04:18:44.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj438 td/osd-backfill-space/datafile 2024-09-16T04:18:44.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:44.441 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:44.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj439 td/osd-backfill-space/datafile 2024-09-16T04:18:44.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj439 td/osd-backfill-space/datafile 2024-09-16T04:18:44.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj439 td/osd-backfill-space/datafile 2024-09-16T04:18:44.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj439 td/osd-backfill-space/datafile 2024-09-16T04:18:44.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj439 td/osd-backfill-space/datafile 2024-09-16T04:18:44.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj439 td/osd-backfill-space/datafile 2024-09-16T04:18:44.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj439 td/osd-backfill-space/datafile 2024-09-16T04:18:44.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj439 td/osd-backfill-space/datafile 2024-09-16T04:18:44.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:44.993 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:44.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:44.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj440 td/osd-backfill-space/datafile 2024-09-16T04:18:45.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:45.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj440 td/osd-backfill-space/datafile 2024-09-16T04:18:45.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:45.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj440 td/osd-backfill-space/datafile 2024-09-16T04:18:45.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:45.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj440 td/osd-backfill-space/datafile 2024-09-16T04:18:45.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:45.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj440 td/osd-backfill-space/datafile 2024-09-16T04:18:45.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:45.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj440 td/osd-backfill-space/datafile 2024-09-16T04:18:45.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:45.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj440 td/osd-backfill-space/datafile 2024-09-16T04:18:45.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:45.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj440 td/osd-backfill-space/datafile 2024-09-16T04:18:45.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:45.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:45.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:45.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj441 td/osd-backfill-space/datafile 2024-09-16T04:18:45.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:45.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj441 td/osd-backfill-space/datafile 2024-09-16T04:18:45.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:45.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj441 td/osd-backfill-space/datafile 2024-09-16T04:18:45.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:45.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj441 td/osd-backfill-space/datafile 2024-09-16T04:18:45.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:45.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj441 td/osd-backfill-space/datafile 2024-09-16T04:18:46.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:46.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj441 td/osd-backfill-space/datafile 2024-09-16T04:18:46.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:46.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj441 td/osd-backfill-space/datafile 2024-09-16T04:18:46.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:46.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj441 td/osd-backfill-space/datafile 2024-09-16T04:18:46.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:46.659 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:46.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:46.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj442 td/osd-backfill-space/datafile 2024-09-16T04:18:47.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj442 td/osd-backfill-space/datafile 2024-09-16T04:18:47.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj442 td/osd-backfill-space/datafile 2024-09-16T04:18:47.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj442 td/osd-backfill-space/datafile 2024-09-16T04:18:47.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj442 td/osd-backfill-space/datafile 2024-09-16T04:18:47.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj442 td/osd-backfill-space/datafile 2024-09-16T04:18:47.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj442 td/osd-backfill-space/datafile 2024-09-16T04:18:47.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj442 td/osd-backfill-space/datafile 2024-09-16T04:18:47.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:47.487 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:47.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj443 td/osd-backfill-space/datafile 2024-09-16T04:18:47.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj443 td/osd-backfill-space/datafile 2024-09-16T04:18:47.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj443 td/osd-backfill-space/datafile 2024-09-16T04:18:47.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj443 td/osd-backfill-space/datafile 2024-09-16T04:18:47.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj443 td/osd-backfill-space/datafile 2024-09-16T04:18:47.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj443 td/osd-backfill-space/datafile 2024-09-16T04:18:47.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:47.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj443 td/osd-backfill-space/datafile 2024-09-16T04:18:48.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj443 td/osd-backfill-space/datafile 2024-09-16T04:18:48.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:48.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:48.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj444 td/osd-backfill-space/datafile 2024-09-16T04:18:48.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj444 td/osd-backfill-space/datafile 2024-09-16T04:18:48.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj444 td/osd-backfill-space/datafile 2024-09-16T04:18:48.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj444 td/osd-backfill-space/datafile 2024-09-16T04:18:48.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj444 td/osd-backfill-space/datafile 2024-09-16T04:18:48.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj444 td/osd-backfill-space/datafile 2024-09-16T04:18:48.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj444 td/osd-backfill-space/datafile 2024-09-16T04:18:48.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj444 td/osd-backfill-space/datafile 2024-09-16T04:18:48.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:48.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:48.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj445 td/osd-backfill-space/datafile 2024-09-16T04:18:48.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj445 td/osd-backfill-space/datafile 2024-09-16T04:18:48.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj445 td/osd-backfill-space/datafile 2024-09-16T04:18:48.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj445 td/osd-backfill-space/datafile 2024-09-16T04:18:48.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:48.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj445 td/osd-backfill-space/datafile 2024-09-16T04:18:49.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj445 td/osd-backfill-space/datafile 2024-09-16T04:18:49.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj445 td/osd-backfill-space/datafile 2024-09-16T04:18:49.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj445 td/osd-backfill-space/datafile 2024-09-16T04:18:49.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:49.220 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:49.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj446 td/osd-backfill-space/datafile 2024-09-16T04:18:49.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj446 td/osd-backfill-space/datafile 2024-09-16T04:18:49.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj446 td/osd-backfill-space/datafile 2024-09-16T04:18:49.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj446 td/osd-backfill-space/datafile 2024-09-16T04:18:49.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj446 td/osd-backfill-space/datafile 2024-09-16T04:18:49.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj446 td/osd-backfill-space/datafile 2024-09-16T04:18:49.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj446 td/osd-backfill-space/datafile 2024-09-16T04:18:49.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj446 td/osd-backfill-space/datafile 2024-09-16T04:18:49.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:49.809 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:49.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj447 td/osd-backfill-space/datafile 2024-09-16T04:18:49.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj447 td/osd-backfill-space/datafile 2024-09-16T04:18:49.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:49.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj447 td/osd-backfill-space/datafile 2024-09-16T04:18:50.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj447 td/osd-backfill-space/datafile 2024-09-16T04:18:50.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj447 td/osd-backfill-space/datafile 2024-09-16T04:18:50.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj447 td/osd-backfill-space/datafile 2024-09-16T04:18:50.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj447 td/osd-backfill-space/datafile 2024-09-16T04:18:50.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj447 td/osd-backfill-space/datafile 2024-09-16T04:18:50.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:50.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:50.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj448 td/osd-backfill-space/datafile 2024-09-16T04:18:50.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj448 td/osd-backfill-space/datafile 2024-09-16T04:18:50.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj448 td/osd-backfill-space/datafile 2024-09-16T04:18:50.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj448 td/osd-backfill-space/datafile 2024-09-16T04:18:50.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj448 td/osd-backfill-space/datafile 2024-09-16T04:18:50.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj448 td/osd-backfill-space/datafile 2024-09-16T04:18:50.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj448 td/osd-backfill-space/datafile 2024-09-16T04:18:50.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj448 td/osd-backfill-space/datafile 2024-09-16T04:18:50.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:50.902 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:50.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj449 td/osd-backfill-space/datafile 2024-09-16T04:18:50.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:50.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj449 td/osd-backfill-space/datafile 2024-09-16T04:18:51.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj449 td/osd-backfill-space/datafile 2024-09-16T04:18:51.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj449 td/osd-backfill-space/datafile 2024-09-16T04:18:51.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj449 td/osd-backfill-space/datafile 2024-09-16T04:18:51.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj449 td/osd-backfill-space/datafile 2024-09-16T04:18:51.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj449 td/osd-backfill-space/datafile 2024-09-16T04:18:51.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj449 td/osd-backfill-space/datafile 2024-09-16T04:18:51.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:51.455 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:51.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj450 td/osd-backfill-space/datafile 2024-09-16T04:18:51.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj450 td/osd-backfill-space/datafile 2024-09-16T04:18:51.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj450 td/osd-backfill-space/datafile 2024-09-16T04:18:51.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj450 td/osd-backfill-space/datafile 2024-09-16T04:18:51.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj450 td/osd-backfill-space/datafile 2024-09-16T04:18:51.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj450 td/osd-backfill-space/datafile 2024-09-16T04:18:51.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj450 td/osd-backfill-space/datafile 2024-09-16T04:18:51.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:51.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj450 td/osd-backfill-space/datafile 2024-09-16T04:18:52.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:52.016 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:52.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj451 td/osd-backfill-space/datafile 2024-09-16T04:18:52.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj451 td/osd-backfill-space/datafile 2024-09-16T04:18:52.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj451 td/osd-backfill-space/datafile 2024-09-16T04:18:52.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj451 td/osd-backfill-space/datafile 2024-09-16T04:18:52.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj451 td/osd-backfill-space/datafile 2024-09-16T04:18:52.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj451 td/osd-backfill-space/datafile 2024-09-16T04:18:52.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj451 td/osd-backfill-space/datafile 2024-09-16T04:18:52.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj451 td/osd-backfill-space/datafile 2024-09-16T04:18:52.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:52.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:52.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj452 td/osd-backfill-space/datafile 2024-09-16T04:18:52.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj452 td/osd-backfill-space/datafile 2024-09-16T04:18:52.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj452 td/osd-backfill-space/datafile 2024-09-16T04:18:52.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj452 td/osd-backfill-space/datafile 2024-09-16T04:18:52.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj452 td/osd-backfill-space/datafile 2024-09-16T04:18:52.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:52.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj452 td/osd-backfill-space/datafile 2024-09-16T04:18:53.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj452 td/osd-backfill-space/datafile 2024-09-16T04:18:53.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj452 td/osd-backfill-space/datafile 2024-09-16T04:18:53.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:53.196 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:53.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj453 td/osd-backfill-space/datafile 2024-09-16T04:18:53.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj453 td/osd-backfill-space/datafile 2024-09-16T04:18:53.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj453 td/osd-backfill-space/datafile 2024-09-16T04:18:53.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj453 td/osd-backfill-space/datafile 2024-09-16T04:18:53.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj453 td/osd-backfill-space/datafile 2024-09-16T04:18:53.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj453 td/osd-backfill-space/datafile 2024-09-16T04:18:53.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj453 td/osd-backfill-space/datafile 2024-09-16T04:18:53.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj453 td/osd-backfill-space/datafile 2024-09-16T04:18:53.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:53.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:53.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj454 td/osd-backfill-space/datafile 2024-09-16T04:18:53.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj454 td/osd-backfill-space/datafile 2024-09-16T04:18:53.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:53.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj454 td/osd-backfill-space/datafile 2024-09-16T04:18:54.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj454 td/osd-backfill-space/datafile 2024-09-16T04:18:54.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj454 td/osd-backfill-space/datafile 2024-09-16T04:18:54.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj454 td/osd-backfill-space/datafile 2024-09-16T04:18:54.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj454 td/osd-backfill-space/datafile 2024-09-16T04:18:54.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj454 td/osd-backfill-space/datafile 2024-09-16T04:18:54.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:54.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:54.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj455 td/osd-backfill-space/datafile 2024-09-16T04:18:54.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj455 td/osd-backfill-space/datafile 2024-09-16T04:18:54.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj455 td/osd-backfill-space/datafile 2024-09-16T04:18:54.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj455 td/osd-backfill-space/datafile 2024-09-16T04:18:54.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj455 td/osd-backfill-space/datafile 2024-09-16T04:18:54.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj455 td/osd-backfill-space/datafile 2024-09-16T04:18:54.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj455 td/osd-backfill-space/datafile 2024-09-16T04:18:54.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj455 td/osd-backfill-space/datafile 2024-09-16T04:18:54.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:54.921 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:54.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj456 td/osd-backfill-space/datafile 2024-09-16T04:18:54.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:54.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj456 td/osd-backfill-space/datafile 2024-09-16T04:18:55.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj456 td/osd-backfill-space/datafile 2024-09-16T04:18:55.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj456 td/osd-backfill-space/datafile 2024-09-16T04:18:55.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj456 td/osd-backfill-space/datafile 2024-09-16T04:18:55.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj456 td/osd-backfill-space/datafile 2024-09-16T04:18:55.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj456 td/osd-backfill-space/datafile 2024-09-16T04:18:55.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj456 td/osd-backfill-space/datafile 2024-09-16T04:18:55.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:55.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:55.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj457 td/osd-backfill-space/datafile 2024-09-16T04:18:55.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj457 td/osd-backfill-space/datafile 2024-09-16T04:18:55.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj457 td/osd-backfill-space/datafile 2024-09-16T04:18:55.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj457 td/osd-backfill-space/datafile 2024-09-16T04:18:55.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj457 td/osd-backfill-space/datafile 2024-09-16T04:18:55.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj457 td/osd-backfill-space/datafile 2024-09-16T04:18:55.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:55.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj457 td/osd-backfill-space/datafile 2024-09-16T04:18:56.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj457 td/osd-backfill-space/datafile 2024-09-16T04:18:56.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:56.078 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:56.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj458 td/osd-backfill-space/datafile 2024-09-16T04:18:56.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj458 td/osd-backfill-space/datafile 2024-09-16T04:18:56.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj458 td/osd-backfill-space/datafile 2024-09-16T04:18:56.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj458 td/osd-backfill-space/datafile 2024-09-16T04:18:56.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj458 td/osd-backfill-space/datafile 2024-09-16T04:18:56.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj458 td/osd-backfill-space/datafile 2024-09-16T04:18:56.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj458 td/osd-backfill-space/datafile 2024-09-16T04:18:56.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj458 td/osd-backfill-space/datafile 2024-09-16T04:18:56.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:56.622 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:56.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj459 td/osd-backfill-space/datafile 2024-09-16T04:18:56.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj459 td/osd-backfill-space/datafile 2024-09-16T04:18:56.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj459 td/osd-backfill-space/datafile 2024-09-16T04:18:56.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj459 td/osd-backfill-space/datafile 2024-09-16T04:18:56.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:56.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj459 td/osd-backfill-space/datafile 2024-09-16T04:18:57.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj459 td/osd-backfill-space/datafile 2024-09-16T04:18:57.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj459 td/osd-backfill-space/datafile 2024-09-16T04:18:57.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj459 td/osd-backfill-space/datafile 2024-09-16T04:18:57.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:57.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:57.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj460 td/osd-backfill-space/datafile 2024-09-16T04:18:57.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj460 td/osd-backfill-space/datafile 2024-09-16T04:18:57.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj460 td/osd-backfill-space/datafile 2024-09-16T04:18:57.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj460 td/osd-backfill-space/datafile 2024-09-16T04:18:57.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj460 td/osd-backfill-space/datafile 2024-09-16T04:18:57.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj460 td/osd-backfill-space/datafile 2024-09-16T04:18:57.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj460 td/osd-backfill-space/datafile 2024-09-16T04:18:57.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj460 td/osd-backfill-space/datafile 2024-09-16T04:18:57.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:57.845 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:57.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj461 td/osd-backfill-space/datafile 2024-09-16T04:18:57.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj461 td/osd-backfill-space/datafile 2024-09-16T04:18:57.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:57.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj461 td/osd-backfill-space/datafile 2024-09-16T04:18:58.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj461 td/osd-backfill-space/datafile 2024-09-16T04:18:58.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj461 td/osd-backfill-space/datafile 2024-09-16T04:18:58.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj461 td/osd-backfill-space/datafile 2024-09-16T04:18:58.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj461 td/osd-backfill-space/datafile 2024-09-16T04:18:58.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj461 td/osd-backfill-space/datafile 2024-09-16T04:18:58.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:58.414 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:58.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj462 td/osd-backfill-space/datafile 2024-09-16T04:18:58.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj462 td/osd-backfill-space/datafile 2024-09-16T04:18:58.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj462 td/osd-backfill-space/datafile 2024-09-16T04:18:58.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj462 td/osd-backfill-space/datafile 2024-09-16T04:18:58.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj462 td/osd-backfill-space/datafile 2024-09-16T04:18:58.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj462 td/osd-backfill-space/datafile 2024-09-16T04:18:58.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj462 td/osd-backfill-space/datafile 2024-09-16T04:18:58.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj462 td/osd-backfill-space/datafile 2024-09-16T04:18:58.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:58.992 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:58.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:58.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj463 td/osd-backfill-space/datafile 2024-09-16T04:18:59.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj463 td/osd-backfill-space/datafile 2024-09-16T04:18:59.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj463 td/osd-backfill-space/datafile 2024-09-16T04:18:59.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj463 td/osd-backfill-space/datafile 2024-09-16T04:18:59.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj463 td/osd-backfill-space/datafile 2024-09-16T04:18:59.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj463 td/osd-backfill-space/datafile 2024-09-16T04:18:59.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj463 td/osd-backfill-space/datafile 2024-09-16T04:18:59.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj463 td/osd-backfill-space/datafile 2024-09-16T04:18:59.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:18:59.561 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:18:59.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj464 td/osd-backfill-space/datafile 2024-09-16T04:18:59.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj464 td/osd-backfill-space/datafile 2024-09-16T04:18:59.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj464 td/osd-backfill-space/datafile 2024-09-16T04:18:59.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj464 td/osd-backfill-space/datafile 2024-09-16T04:18:59.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj464 td/osd-backfill-space/datafile 2024-09-16T04:18:59.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:18:59.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj464 td/osd-backfill-space/datafile 2024-09-16T04:19:00.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj464 td/osd-backfill-space/datafile 2024-09-16T04:19:00.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj464 td/osd-backfill-space/datafile 2024-09-16T04:19:00.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:00.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:00.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj465 td/osd-backfill-space/datafile 2024-09-16T04:19:00.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj465 td/osd-backfill-space/datafile 2024-09-16T04:19:00.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj465 td/osd-backfill-space/datafile 2024-09-16T04:19:00.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj465 td/osd-backfill-space/datafile 2024-09-16T04:19:00.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj465 td/osd-backfill-space/datafile 2024-09-16T04:19:00.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj465 td/osd-backfill-space/datafile 2024-09-16T04:19:00.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj465 td/osd-backfill-space/datafile 2024-09-16T04:19:00.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj465 td/osd-backfill-space/datafile 2024-09-16T04:19:00.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:00.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:00.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj466 td/osd-backfill-space/datafile 2024-09-16T04:19:00.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj466 td/osd-backfill-space/datafile 2024-09-16T04:19:00.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj466 td/osd-backfill-space/datafile 2024-09-16T04:19:00.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:00.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj466 td/osd-backfill-space/datafile 2024-09-16T04:19:01.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj466 td/osd-backfill-space/datafile 2024-09-16T04:19:01.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj466 td/osd-backfill-space/datafile 2024-09-16T04:19:01.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj466 td/osd-backfill-space/datafile 2024-09-16T04:19:01.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj466 td/osd-backfill-space/datafile 2024-09-16T04:19:01.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:01.261 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:01.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj467 td/osd-backfill-space/datafile 2024-09-16T04:19:01.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj467 td/osd-backfill-space/datafile 2024-09-16T04:19:01.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj467 td/osd-backfill-space/datafile 2024-09-16T04:19:01.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj467 td/osd-backfill-space/datafile 2024-09-16T04:19:01.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj467 td/osd-backfill-space/datafile 2024-09-16T04:19:01.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj467 td/osd-backfill-space/datafile 2024-09-16T04:19:01.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj467 td/osd-backfill-space/datafile 2024-09-16T04:19:01.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj467 td/osd-backfill-space/datafile 2024-09-16T04:19:01.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:01.830 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:01.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj468 td/osd-backfill-space/datafile 2024-09-16T04:19:01.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj468 td/osd-backfill-space/datafile 2024-09-16T04:19:01.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:01.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj468 td/osd-backfill-space/datafile 2024-09-16T04:19:02.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj468 td/osd-backfill-space/datafile 2024-09-16T04:19:02.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj468 td/osd-backfill-space/datafile 2024-09-16T04:19:02.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj468 td/osd-backfill-space/datafile 2024-09-16T04:19:02.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj468 td/osd-backfill-space/datafile 2024-09-16T04:19:02.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj468 td/osd-backfill-space/datafile 2024-09-16T04:19:02.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:02.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:02.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj469 td/osd-backfill-space/datafile 2024-09-16T04:19:02.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj469 td/osd-backfill-space/datafile 2024-09-16T04:19:02.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj469 td/osd-backfill-space/datafile 2024-09-16T04:19:02.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj469 td/osd-backfill-space/datafile 2024-09-16T04:19:02.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj469 td/osd-backfill-space/datafile 2024-09-16T04:19:02.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj469 td/osd-backfill-space/datafile 2024-09-16T04:19:02.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj469 td/osd-backfill-space/datafile 2024-09-16T04:19:02.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj469 td/osd-backfill-space/datafile 2024-09-16T04:19:02.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:02.977 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:02.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:02.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj470 td/osd-backfill-space/datafile 2024-09-16T04:19:03.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj470 td/osd-backfill-space/datafile 2024-09-16T04:19:03.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj470 td/osd-backfill-space/datafile 2024-09-16T04:19:03.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj470 td/osd-backfill-space/datafile 2024-09-16T04:19:03.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj470 td/osd-backfill-space/datafile 2024-09-16T04:19:03.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj470 td/osd-backfill-space/datafile 2024-09-16T04:19:03.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj470 td/osd-backfill-space/datafile 2024-09-16T04:19:03.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj470 td/osd-backfill-space/datafile 2024-09-16T04:19:03.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:03.554 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:03.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj471 td/osd-backfill-space/datafile 2024-09-16T04:19:03.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj471 td/osd-backfill-space/datafile 2024-09-16T04:19:03.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj471 td/osd-backfill-space/datafile 2024-09-16T04:19:03.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj471 td/osd-backfill-space/datafile 2024-09-16T04:19:03.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj471 td/osd-backfill-space/datafile 2024-09-16T04:19:03.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj471 td/osd-backfill-space/datafile 2024-09-16T04:19:03.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:03.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj471 td/osd-backfill-space/datafile 2024-09-16T04:19:04.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj471 td/osd-backfill-space/datafile 2024-09-16T04:19:04.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:04.102 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:04.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj472 td/osd-backfill-space/datafile 2024-09-16T04:19:04.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj472 td/osd-backfill-space/datafile 2024-09-16T04:19:04.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj472 td/osd-backfill-space/datafile 2024-09-16T04:19:04.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj472 td/osd-backfill-space/datafile 2024-09-16T04:19:04.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj472 td/osd-backfill-space/datafile 2024-09-16T04:19:04.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj472 td/osd-backfill-space/datafile 2024-09-16T04:19:04.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj472 td/osd-backfill-space/datafile 2024-09-16T04:19:04.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj472 td/osd-backfill-space/datafile 2024-09-16T04:19:04.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:04.643 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:04.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj473 td/osd-backfill-space/datafile 2024-09-16T04:19:04.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj473 td/osd-backfill-space/datafile 2024-09-16T04:19:04.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj473 td/osd-backfill-space/datafile 2024-09-16T04:19:04.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj473 td/osd-backfill-space/datafile 2024-09-16T04:19:04.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:04.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj473 td/osd-backfill-space/datafile 2024-09-16T04:19:05.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj473 td/osd-backfill-space/datafile 2024-09-16T04:19:05.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj473 td/osd-backfill-space/datafile 2024-09-16T04:19:05.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj473 td/osd-backfill-space/datafile 2024-09-16T04:19:05.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:05.212 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:05.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj474 td/osd-backfill-space/datafile 2024-09-16T04:19:05.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj474 td/osd-backfill-space/datafile 2024-09-16T04:19:05.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj474 td/osd-backfill-space/datafile 2024-09-16T04:19:05.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj474 td/osd-backfill-space/datafile 2024-09-16T04:19:05.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj474 td/osd-backfill-space/datafile 2024-09-16T04:19:05.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj474 td/osd-backfill-space/datafile 2024-09-16T04:19:05.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj474 td/osd-backfill-space/datafile 2024-09-16T04:19:05.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj474 td/osd-backfill-space/datafile 2024-09-16T04:19:05.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:05.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:05.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj475 td/osd-backfill-space/datafile 2024-09-16T04:19:05.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj475 td/osd-backfill-space/datafile 2024-09-16T04:19:05.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj475 td/osd-backfill-space/datafile 2024-09-16T04:19:05.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:05.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj475 td/osd-backfill-space/datafile 2024-09-16T04:19:06.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj475 td/osd-backfill-space/datafile 2024-09-16T04:19:06.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj475 td/osd-backfill-space/datafile 2024-09-16T04:19:06.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj475 td/osd-backfill-space/datafile 2024-09-16T04:19:06.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj475 td/osd-backfill-space/datafile 2024-09-16T04:19:06.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:06.300 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:06.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj476 td/osd-backfill-space/datafile 2024-09-16T04:19:06.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj476 td/osd-backfill-space/datafile 2024-09-16T04:19:06.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj476 td/osd-backfill-space/datafile 2024-09-16T04:19:06.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj476 td/osd-backfill-space/datafile 2024-09-16T04:19:06.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj476 td/osd-backfill-space/datafile 2024-09-16T04:19:06.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj476 td/osd-backfill-space/datafile 2024-09-16T04:19:06.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj476 td/osd-backfill-space/datafile 2024-09-16T04:19:06.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj476 td/osd-backfill-space/datafile 2024-09-16T04:19:06.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:06.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:06.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj477 td/osd-backfill-space/datafile 2024-09-16T04:19:06.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:06.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj477 td/osd-backfill-space/datafile 2024-09-16T04:19:07.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj477 td/osd-backfill-space/datafile 2024-09-16T04:19:07.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj477 td/osd-backfill-space/datafile 2024-09-16T04:19:07.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj477 td/osd-backfill-space/datafile 2024-09-16T04:19:07.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj477 td/osd-backfill-space/datafile 2024-09-16T04:19:07.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj477 td/osd-backfill-space/datafile 2024-09-16T04:19:07.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj477 td/osd-backfill-space/datafile 2024-09-16T04:19:07.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:07.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:07.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj478 td/osd-backfill-space/datafile 2024-09-16T04:19:07.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj478 td/osd-backfill-space/datafile 2024-09-16T04:19:07.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj478 td/osd-backfill-space/datafile 2024-09-16T04:19:07.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj478 td/osd-backfill-space/datafile 2024-09-16T04:19:07.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj478 td/osd-backfill-space/datafile 2024-09-16T04:19:07.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj478 td/osd-backfill-space/datafile 2024-09-16T04:19:07.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj478 td/osd-backfill-space/datafile 2024-09-16T04:19:07.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:07.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj478 td/osd-backfill-space/datafile 2024-09-16T04:19:08.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:08.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:08.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj479 td/osd-backfill-space/datafile 2024-09-16T04:19:08.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj479 td/osd-backfill-space/datafile 2024-09-16T04:19:08.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj479 td/osd-backfill-space/datafile 2024-09-16T04:19:08.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj479 td/osd-backfill-space/datafile 2024-09-16T04:19:08.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj479 td/osd-backfill-space/datafile 2024-09-16T04:19:08.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj479 td/osd-backfill-space/datafile 2024-09-16T04:19:08.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj479 td/osd-backfill-space/datafile 2024-09-16T04:19:08.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj479 td/osd-backfill-space/datafile 2024-09-16T04:19:08.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:08.644 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:08.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj480 td/osd-backfill-space/datafile 2024-09-16T04:19:08.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj480 td/osd-backfill-space/datafile 2024-09-16T04:19:08.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj480 td/osd-backfill-space/datafile 2024-09-16T04:19:08.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj480 td/osd-backfill-space/datafile 2024-09-16T04:19:08.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:08.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj480 td/osd-backfill-space/datafile 2024-09-16T04:19:09.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj480 td/osd-backfill-space/datafile 2024-09-16T04:19:09.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj480 td/osd-backfill-space/datafile 2024-09-16T04:19:09.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj480 td/osd-backfill-space/datafile 2024-09-16T04:19:09.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:09.205 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:09.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj481 td/osd-backfill-space/datafile 2024-09-16T04:19:09.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj481 td/osd-backfill-space/datafile 2024-09-16T04:19:09.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj481 td/osd-backfill-space/datafile 2024-09-16T04:19:09.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj481 td/osd-backfill-space/datafile 2024-09-16T04:19:09.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj481 td/osd-backfill-space/datafile 2024-09-16T04:19:09.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj481 td/osd-backfill-space/datafile 2024-09-16T04:19:09.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj481 td/osd-backfill-space/datafile 2024-09-16T04:19:09.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj481 td/osd-backfill-space/datafile 2024-09-16T04:19:09.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:09.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:09.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj482 td/osd-backfill-space/datafile 2024-09-16T04:19:09.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj482 td/osd-backfill-space/datafile 2024-09-16T04:19:09.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj482 td/osd-backfill-space/datafile 2024-09-16T04:19:09.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:09.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj482 td/osd-backfill-space/datafile 2024-09-16T04:19:10.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj482 td/osd-backfill-space/datafile 2024-09-16T04:19:10.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj482 td/osd-backfill-space/datafile 2024-09-16T04:19:10.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj482 td/osd-backfill-space/datafile 2024-09-16T04:19:10.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj482 td/osd-backfill-space/datafile 2024-09-16T04:19:10.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:10.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:10.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj483 td/osd-backfill-space/datafile 2024-09-16T04:19:10.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj483 td/osd-backfill-space/datafile 2024-09-16T04:19:10.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj483 td/osd-backfill-space/datafile 2024-09-16T04:19:10.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj483 td/osd-backfill-space/datafile 2024-09-16T04:19:10.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj483 td/osd-backfill-space/datafile 2024-09-16T04:19:10.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj483 td/osd-backfill-space/datafile 2024-09-16T04:19:10.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj483 td/osd-backfill-space/datafile 2024-09-16T04:19:10.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj483 td/osd-backfill-space/datafile 2024-09-16T04:19:10.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:10.887 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:10.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj484 td/osd-backfill-space/datafile 2024-09-16T04:19:10.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:10.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj484 td/osd-backfill-space/datafile 2024-09-16T04:19:11.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj484 td/osd-backfill-space/datafile 2024-09-16T04:19:11.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj484 td/osd-backfill-space/datafile 2024-09-16T04:19:11.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj484 td/osd-backfill-space/datafile 2024-09-16T04:19:11.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj484 td/osd-backfill-space/datafile 2024-09-16T04:19:11.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj484 td/osd-backfill-space/datafile 2024-09-16T04:19:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj484 td/osd-backfill-space/datafile 2024-09-16T04:19:11.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:11.431 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:11.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj485 td/osd-backfill-space/datafile 2024-09-16T04:19:11.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj485 td/osd-backfill-space/datafile 2024-09-16T04:19:11.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj485 td/osd-backfill-space/datafile 2024-09-16T04:19:11.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj485 td/osd-backfill-space/datafile 2024-09-16T04:19:11.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj485 td/osd-backfill-space/datafile 2024-09-16T04:19:11.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj485 td/osd-backfill-space/datafile 2024-09-16T04:19:11.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj485 td/osd-backfill-space/datafile 2024-09-16T04:19:11.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:11.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj485 td/osd-backfill-space/datafile 2024-09-16T04:19:12.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:12.051 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:12.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj486 td/osd-backfill-space/datafile 2024-09-16T04:19:12.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj486 td/osd-backfill-space/datafile 2024-09-16T04:19:12.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj486 td/osd-backfill-space/datafile 2024-09-16T04:19:12.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj486 td/osd-backfill-space/datafile 2024-09-16T04:19:12.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj486 td/osd-backfill-space/datafile 2024-09-16T04:19:12.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj486 td/osd-backfill-space/datafile 2024-09-16T04:19:12.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj486 td/osd-backfill-space/datafile 2024-09-16T04:19:12.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj486 td/osd-backfill-space/datafile 2024-09-16T04:19:12.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:12.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:12.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj487 td/osd-backfill-space/datafile 2024-09-16T04:19:12.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj487 td/osd-backfill-space/datafile 2024-09-16T04:19:12.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj487 td/osd-backfill-space/datafile 2024-09-16T04:19:12.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj487 td/osd-backfill-space/datafile 2024-09-16T04:19:12.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:12.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj487 td/osd-backfill-space/datafile 2024-09-16T04:19:13.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj487 td/osd-backfill-space/datafile 2024-09-16T04:19:13.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj487 td/osd-backfill-space/datafile 2024-09-16T04:19:13.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj487 td/osd-backfill-space/datafile 2024-09-16T04:19:13.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:13.214 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:13.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj488 td/osd-backfill-space/datafile 2024-09-16T04:19:13.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj488 td/osd-backfill-space/datafile 2024-09-16T04:19:13.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj488 td/osd-backfill-space/datafile 2024-09-16T04:19:13.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj488 td/osd-backfill-space/datafile 2024-09-16T04:19:13.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj488 td/osd-backfill-space/datafile 2024-09-16T04:19:13.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj488 td/osd-backfill-space/datafile 2024-09-16T04:19:13.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj488 td/osd-backfill-space/datafile 2024-09-16T04:19:13.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj488 td/osd-backfill-space/datafile 2024-09-16T04:19:13.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:13.809 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:13.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj489 td/osd-backfill-space/datafile 2024-09-16T04:19:13.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj489 td/osd-backfill-space/datafile 2024-09-16T04:19:13.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:13.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj489 td/osd-backfill-space/datafile 2024-09-16T04:19:14.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj489 td/osd-backfill-space/datafile 2024-09-16T04:19:14.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj489 td/osd-backfill-space/datafile 2024-09-16T04:19:14.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj489 td/osd-backfill-space/datafile 2024-09-16T04:19:14.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj489 td/osd-backfill-space/datafile 2024-09-16T04:19:14.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj489 td/osd-backfill-space/datafile 2024-09-16T04:19:14.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:14.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:14.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj490 td/osd-backfill-space/datafile 2024-09-16T04:19:14.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj490 td/osd-backfill-space/datafile 2024-09-16T04:19:14.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj490 td/osd-backfill-space/datafile 2024-09-16T04:19:14.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj490 td/osd-backfill-space/datafile 2024-09-16T04:19:14.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj490 td/osd-backfill-space/datafile 2024-09-16T04:19:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj490 td/osd-backfill-space/datafile 2024-09-16T04:19:14.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj490 td/osd-backfill-space/datafile 2024-09-16T04:19:14.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj490 td/osd-backfill-space/datafile 2024-09-16T04:19:14.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:14.931 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:14.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj491 td/osd-backfill-space/datafile 2024-09-16T04:19:14.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:14.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj491 td/osd-backfill-space/datafile 2024-09-16T04:19:15.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj491 td/osd-backfill-space/datafile 2024-09-16T04:19:15.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj491 td/osd-backfill-space/datafile 2024-09-16T04:19:15.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj491 td/osd-backfill-space/datafile 2024-09-16T04:19:15.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj491 td/osd-backfill-space/datafile 2024-09-16T04:19:15.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj491 td/osd-backfill-space/datafile 2024-09-16T04:19:15.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj491 td/osd-backfill-space/datafile 2024-09-16T04:19:15.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:15.469 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:15.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj492 td/osd-backfill-space/datafile 2024-09-16T04:19:15.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj492 td/osd-backfill-space/datafile 2024-09-16T04:19:15.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj492 td/osd-backfill-space/datafile 2024-09-16T04:19:15.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj492 td/osd-backfill-space/datafile 2024-09-16T04:19:15.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj492 td/osd-backfill-space/datafile 2024-09-16T04:19:15.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj492 td/osd-backfill-space/datafile 2024-09-16T04:19:15.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj492 td/osd-backfill-space/datafile 2024-09-16T04:19:15.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:15.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj492 td/osd-backfill-space/datafile 2024-09-16T04:19:16.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:16.036 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:16.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj493 td/osd-backfill-space/datafile 2024-09-16T04:19:16.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj493 td/osd-backfill-space/datafile 2024-09-16T04:19:16.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj493 td/osd-backfill-space/datafile 2024-09-16T04:19:16.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj493 td/osd-backfill-space/datafile 2024-09-16T04:19:16.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj493 td/osd-backfill-space/datafile 2024-09-16T04:19:16.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj493 td/osd-backfill-space/datafile 2024-09-16T04:19:16.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj493 td/osd-backfill-space/datafile 2024-09-16T04:19:16.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj493 td/osd-backfill-space/datafile 2024-09-16T04:19:16.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:16.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:16.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj494 td/osd-backfill-space/datafile 2024-09-16T04:19:16.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj494 td/osd-backfill-space/datafile 2024-09-16T04:19:16.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj494 td/osd-backfill-space/datafile 2024-09-16T04:19:16.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj494 td/osd-backfill-space/datafile 2024-09-16T04:19:16.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj494 td/osd-backfill-space/datafile 2024-09-16T04:19:16.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:16.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj494 td/osd-backfill-space/datafile 2024-09-16T04:19:17.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj494 td/osd-backfill-space/datafile 2024-09-16T04:19:17.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj494 td/osd-backfill-space/datafile 2024-09-16T04:19:17.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:17.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:17.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj495 td/osd-backfill-space/datafile 2024-09-16T04:19:17.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj495 td/osd-backfill-space/datafile 2024-09-16T04:19:17.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj495 td/osd-backfill-space/datafile 2024-09-16T04:19:17.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj495 td/osd-backfill-space/datafile 2024-09-16T04:19:17.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj495 td/osd-backfill-space/datafile 2024-09-16T04:19:17.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj495 td/osd-backfill-space/datafile 2024-09-16T04:19:17.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj495 td/osd-backfill-space/datafile 2024-09-16T04:19:17.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj495 td/osd-backfill-space/datafile 2024-09-16T04:19:17.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:17.681 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:17.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj496 td/osd-backfill-space/datafile 2024-09-16T04:19:17.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj496 td/osd-backfill-space/datafile 2024-09-16T04:19:17.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj496 td/osd-backfill-space/datafile 2024-09-16T04:19:17.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj496 td/osd-backfill-space/datafile 2024-09-16T04:19:17.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:17.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj496 td/osd-backfill-space/datafile 2024-09-16T04:19:18.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:18.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj496 td/osd-backfill-space/datafile 2024-09-16T04:19:18.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:18.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj496 td/osd-backfill-space/datafile 2024-09-16T04:19:18.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:18.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj496 td/osd-backfill-space/datafile 2024-09-16T04:19:18.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:18.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:18.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:18.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj497 td/osd-backfill-space/datafile 2024-09-16T04:19:18.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:18.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj497 td/osd-backfill-space/datafile 2024-09-16T04:19:18.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:18.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj497 td/osd-backfill-space/datafile 2024-09-16T04:19:19.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj497 td/osd-backfill-space/datafile 2024-09-16T04:19:19.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj497 td/osd-backfill-space/datafile 2024-09-16T04:19:19.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj497 td/osd-backfill-space/datafile 2024-09-16T04:19:19.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj497 td/osd-backfill-space/datafile 2024-09-16T04:19:19.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj497 td/osd-backfill-space/datafile 2024-09-16T04:19:19.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:19.383 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:19.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj498 td/osd-backfill-space/datafile 2024-09-16T04:19:19.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj498 td/osd-backfill-space/datafile 2024-09-16T04:19:19.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj498 td/osd-backfill-space/datafile 2024-09-16T04:19:19.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj498 td/osd-backfill-space/datafile 2024-09-16T04:19:19.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj498 td/osd-backfill-space/datafile 2024-09-16T04:19:19.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj498 td/osd-backfill-space/datafile 2024-09-16T04:19:19.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj498 td/osd-backfill-space/datafile 2024-09-16T04:19:19.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj498 td/osd-backfill-space/datafile 2024-09-16T04:19:19.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:19.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:19.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:19.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj499 td/osd-backfill-space/datafile 2024-09-16T04:19:20.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj499 td/osd-backfill-space/datafile 2024-09-16T04:19:20.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj499 td/osd-backfill-space/datafile 2024-09-16T04:19:20.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj499 td/osd-backfill-space/datafile 2024-09-16T04:19:20.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj499 td/osd-backfill-space/datafile 2024-09-16T04:19:20.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj499 td/osd-backfill-space/datafile 2024-09-16T04:19:20.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj499 td/osd-backfill-space/datafile 2024-09-16T04:19:20.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj499 td/osd-backfill-space/datafile 2024-09-16T04:19:20.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:20.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:20.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj500 td/osd-backfill-space/datafile 2024-09-16T04:19:20.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj500 td/osd-backfill-space/datafile 2024-09-16T04:19:20.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj500 td/osd-backfill-space/datafile 2024-09-16T04:19:20.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj500 td/osd-backfill-space/datafile 2024-09-16T04:19:20.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj500 td/osd-backfill-space/datafile 2024-09-16T04:19:20.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj500 td/osd-backfill-space/datafile 2024-09-16T04:19:20.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:20.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj500 td/osd-backfill-space/datafile 2024-09-16T04:19:21.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj500 td/osd-backfill-space/datafile 2024-09-16T04:19:21.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:21.074 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:21.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj501 td/osd-backfill-space/datafile 2024-09-16T04:19:21.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj501 td/osd-backfill-space/datafile 2024-09-16T04:19:21.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj501 td/osd-backfill-space/datafile 2024-09-16T04:19:21.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj501 td/osd-backfill-space/datafile 2024-09-16T04:19:21.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj501 td/osd-backfill-space/datafile 2024-09-16T04:19:21.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj501 td/osd-backfill-space/datafile 2024-09-16T04:19:21.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj501 td/osd-backfill-space/datafile 2024-09-16T04:19:21.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj501 td/osd-backfill-space/datafile 2024-09-16T04:19:21.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:21.694 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:21.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj502 td/osd-backfill-space/datafile 2024-09-16T04:19:21.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj502 td/osd-backfill-space/datafile 2024-09-16T04:19:21.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj502 td/osd-backfill-space/datafile 2024-09-16T04:19:21.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj502 td/osd-backfill-space/datafile 2024-09-16T04:19:21.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:21.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj502 td/osd-backfill-space/datafile 2024-09-16T04:19:22.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj502 td/osd-backfill-space/datafile 2024-09-16T04:19:22.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj502 td/osd-backfill-space/datafile 2024-09-16T04:19:22.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj502 td/osd-backfill-space/datafile 2024-09-16T04:19:22.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:22.263 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:22.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj503 td/osd-backfill-space/datafile 2024-09-16T04:19:22.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj503 td/osd-backfill-space/datafile 2024-09-16T04:19:22.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj503 td/osd-backfill-space/datafile 2024-09-16T04:19:22.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj503 td/osd-backfill-space/datafile 2024-09-16T04:19:22.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj503 td/osd-backfill-space/datafile 2024-09-16T04:19:22.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj503 td/osd-backfill-space/datafile 2024-09-16T04:19:22.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj503 td/osd-backfill-space/datafile 2024-09-16T04:19:22.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj503 td/osd-backfill-space/datafile 2024-09-16T04:19:22.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:22.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:22.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj504 td/osd-backfill-space/datafile 2024-09-16T04:19:22.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj504 td/osd-backfill-space/datafile 2024-09-16T04:19:22.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:22.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj504 td/osd-backfill-space/datafile 2024-09-16T04:19:23.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj504 td/osd-backfill-space/datafile 2024-09-16T04:19:23.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj504 td/osd-backfill-space/datafile 2024-09-16T04:19:23.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj504 td/osd-backfill-space/datafile 2024-09-16T04:19:23.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj504 td/osd-backfill-space/datafile 2024-09-16T04:19:23.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj504 td/osd-backfill-space/datafile 2024-09-16T04:19:23.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:23.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:23.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj505 td/osd-backfill-space/datafile 2024-09-16T04:19:23.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj505 td/osd-backfill-space/datafile 2024-09-16T04:19:23.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj505 td/osd-backfill-space/datafile 2024-09-16T04:19:23.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj505 td/osd-backfill-space/datafile 2024-09-16T04:19:23.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj505 td/osd-backfill-space/datafile 2024-09-16T04:19:23.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj505 td/osd-backfill-space/datafile 2024-09-16T04:19:23.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj505 td/osd-backfill-space/datafile 2024-09-16T04:19:23.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj505 td/osd-backfill-space/datafile 2024-09-16T04:19:23.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:23.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:23.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:23.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj506 td/osd-backfill-space/datafile 2024-09-16T04:19:24.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj506 td/osd-backfill-space/datafile 2024-09-16T04:19:24.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj506 td/osd-backfill-space/datafile 2024-09-16T04:19:24.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj506 td/osd-backfill-space/datafile 2024-09-16T04:19:24.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj506 td/osd-backfill-space/datafile 2024-09-16T04:19:24.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj506 td/osd-backfill-space/datafile 2024-09-16T04:19:24.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj506 td/osd-backfill-space/datafile 2024-09-16T04:19:24.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj506 td/osd-backfill-space/datafile 2024-09-16T04:19:24.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:24.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:24.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj507 td/osd-backfill-space/datafile 2024-09-16T04:19:24.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj507 td/osd-backfill-space/datafile 2024-09-16T04:19:24.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj507 td/osd-backfill-space/datafile 2024-09-16T04:19:24.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj507 td/osd-backfill-space/datafile 2024-09-16T04:19:24.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj507 td/osd-backfill-space/datafile 2024-09-16T04:19:24.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj507 td/osd-backfill-space/datafile 2024-09-16T04:19:24.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:24.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj507 td/osd-backfill-space/datafile 2024-09-16T04:19:25.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj507 td/osd-backfill-space/datafile 2024-09-16T04:19:25.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:25.084 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:25.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj508 td/osd-backfill-space/datafile 2024-09-16T04:19:25.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj508 td/osd-backfill-space/datafile 2024-09-16T04:19:25.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj508 td/osd-backfill-space/datafile 2024-09-16T04:19:25.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj508 td/osd-backfill-space/datafile 2024-09-16T04:19:25.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj508 td/osd-backfill-space/datafile 2024-09-16T04:19:25.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj508 td/osd-backfill-space/datafile 2024-09-16T04:19:25.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj508 td/osd-backfill-space/datafile 2024-09-16T04:19:25.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj508 td/osd-backfill-space/datafile 2024-09-16T04:19:25.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:25.686 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:25.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj509 td/osd-backfill-space/datafile 2024-09-16T04:19:25.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj509 td/osd-backfill-space/datafile 2024-09-16T04:19:25.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj509 td/osd-backfill-space/datafile 2024-09-16T04:19:25.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj509 td/osd-backfill-space/datafile 2024-09-16T04:19:25.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:25.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj509 td/osd-backfill-space/datafile 2024-09-16T04:19:26.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj509 td/osd-backfill-space/datafile 2024-09-16T04:19:26.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj509 td/osd-backfill-space/datafile 2024-09-16T04:19:26.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj509 td/osd-backfill-space/datafile 2024-09-16T04:19:26.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:26.248 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:26.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj510 td/osd-backfill-space/datafile 2024-09-16T04:19:26.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj510 td/osd-backfill-space/datafile 2024-09-16T04:19:26.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj510 td/osd-backfill-space/datafile 2024-09-16T04:19:26.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj510 td/osd-backfill-space/datafile 2024-09-16T04:19:26.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj510 td/osd-backfill-space/datafile 2024-09-16T04:19:26.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj510 td/osd-backfill-space/datafile 2024-09-16T04:19:26.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj510 td/osd-backfill-space/datafile 2024-09-16T04:19:26.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj510 td/osd-backfill-space/datafile 2024-09-16T04:19:26.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:26.810 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:26.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj511 td/osd-backfill-space/datafile 2024-09-16T04:19:26.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj511 td/osd-backfill-space/datafile 2024-09-16T04:19:26.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:26.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj511 td/osd-backfill-space/datafile 2024-09-16T04:19:27.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj511 td/osd-backfill-space/datafile 2024-09-16T04:19:27.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj511 td/osd-backfill-space/datafile 2024-09-16T04:19:27.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj511 td/osd-backfill-space/datafile 2024-09-16T04:19:27.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj511 td/osd-backfill-space/datafile 2024-09-16T04:19:27.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj511 td/osd-backfill-space/datafile 2024-09-16T04:19:27.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:27.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:27.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj512 td/osd-backfill-space/datafile 2024-09-16T04:19:27.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj512 td/osd-backfill-space/datafile 2024-09-16T04:19:27.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj512 td/osd-backfill-space/datafile 2024-09-16T04:19:27.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj512 td/osd-backfill-space/datafile 2024-09-16T04:19:27.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj512 td/osd-backfill-space/datafile 2024-09-16T04:19:27.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj512 td/osd-backfill-space/datafile 2024-09-16T04:19:27.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj512 td/osd-backfill-space/datafile 2024-09-16T04:19:27.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj512 td/osd-backfill-space/datafile 2024-09-16T04:19:27.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:27.988 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:27.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:27.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj513 td/osd-backfill-space/datafile 2024-09-16T04:19:28.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj513 td/osd-backfill-space/datafile 2024-09-16T04:19:28.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj513 td/osd-backfill-space/datafile 2024-09-16T04:19:28.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj513 td/osd-backfill-space/datafile 2024-09-16T04:19:28.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj513 td/osd-backfill-space/datafile 2024-09-16T04:19:28.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj513 td/osd-backfill-space/datafile 2024-09-16T04:19:28.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj513 td/osd-backfill-space/datafile 2024-09-16T04:19:28.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj513 td/osd-backfill-space/datafile 2024-09-16T04:19:28.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:28.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:28.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj514 td/osd-backfill-space/datafile 2024-09-16T04:19:28.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj514 td/osd-backfill-space/datafile 2024-09-16T04:19:28.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj514 td/osd-backfill-space/datafile 2024-09-16T04:19:28.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj514 td/osd-backfill-space/datafile 2024-09-16T04:19:28.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj514 td/osd-backfill-space/datafile 2024-09-16T04:19:28.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj514 td/osd-backfill-space/datafile 2024-09-16T04:19:28.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:28.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj514 td/osd-backfill-space/datafile 2024-09-16T04:19:29.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj514 td/osd-backfill-space/datafile 2024-09-16T04:19:29.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:29.110 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:29.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj515 td/osd-backfill-space/datafile 2024-09-16T04:19:29.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj515 td/osd-backfill-space/datafile 2024-09-16T04:19:29.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj515 td/osd-backfill-space/datafile 2024-09-16T04:19:29.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj515 td/osd-backfill-space/datafile 2024-09-16T04:19:29.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj515 td/osd-backfill-space/datafile 2024-09-16T04:19:29.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj515 td/osd-backfill-space/datafile 2024-09-16T04:19:29.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj515 td/osd-backfill-space/datafile 2024-09-16T04:19:29.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj515 td/osd-backfill-space/datafile 2024-09-16T04:19:29.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:29.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:29.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj516 td/osd-backfill-space/datafile 2024-09-16T04:19:29.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj516 td/osd-backfill-space/datafile 2024-09-16T04:19:29.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj516 td/osd-backfill-space/datafile 2024-09-16T04:19:29.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:29.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj516 td/osd-backfill-space/datafile 2024-09-16T04:19:30.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj516 td/osd-backfill-space/datafile 2024-09-16T04:19:30.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj516 td/osd-backfill-space/datafile 2024-09-16T04:19:30.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj516 td/osd-backfill-space/datafile 2024-09-16T04:19:30.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj516 td/osd-backfill-space/datafile 2024-09-16T04:19:30.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:30.331 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:30.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj517 td/osd-backfill-space/datafile 2024-09-16T04:19:30.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj517 td/osd-backfill-space/datafile 2024-09-16T04:19:30.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj517 td/osd-backfill-space/datafile 2024-09-16T04:19:30.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj517 td/osd-backfill-space/datafile 2024-09-16T04:19:30.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj517 td/osd-backfill-space/datafile 2024-09-16T04:19:30.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj517 td/osd-backfill-space/datafile 2024-09-16T04:19:30.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj517 td/osd-backfill-space/datafile 2024-09-16T04:19:30.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj517 td/osd-backfill-space/datafile 2024-09-16T04:19:30.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:30.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj518 td/osd-backfill-space/datafile 2024-09-16T04:19:30.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:30.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj518 td/osd-backfill-space/datafile 2024-09-16T04:19:31.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj518 td/osd-backfill-space/datafile 2024-09-16T04:19:31.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj518 td/osd-backfill-space/datafile 2024-09-16T04:19:31.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj518 td/osd-backfill-space/datafile 2024-09-16T04:19:31.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj518 td/osd-backfill-space/datafile 2024-09-16T04:19:31.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj518 td/osd-backfill-space/datafile 2024-09-16T04:19:31.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj518 td/osd-backfill-space/datafile 2024-09-16T04:19:31.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:31.479 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:31.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj519 td/osd-backfill-space/datafile 2024-09-16T04:19:31.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj519 td/osd-backfill-space/datafile 2024-09-16T04:19:31.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj519 td/osd-backfill-space/datafile 2024-09-16T04:19:31.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj519 td/osd-backfill-space/datafile 2024-09-16T04:19:31.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj519 td/osd-backfill-space/datafile 2024-09-16T04:19:31.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj519 td/osd-backfill-space/datafile 2024-09-16T04:19:31.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:31.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj519 td/osd-backfill-space/datafile 2024-09-16T04:19:32.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj519 td/osd-backfill-space/datafile 2024-09-16T04:19:32.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:32.075 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:32.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj520 td/osd-backfill-space/datafile 2024-09-16T04:19:32.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj520 td/osd-backfill-space/datafile 2024-09-16T04:19:32.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj520 td/osd-backfill-space/datafile 2024-09-16T04:19:32.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj520 td/osd-backfill-space/datafile 2024-09-16T04:19:32.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj520 td/osd-backfill-space/datafile 2024-09-16T04:19:32.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj520 td/osd-backfill-space/datafile 2024-09-16T04:19:32.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj520 td/osd-backfill-space/datafile 2024-09-16T04:19:32.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj520 td/osd-backfill-space/datafile 2024-09-16T04:19:32.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:32.611 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:32.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj521 td/osd-backfill-space/datafile 2024-09-16T04:19:32.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj521 td/osd-backfill-space/datafile 2024-09-16T04:19:32.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj521 td/osd-backfill-space/datafile 2024-09-16T04:19:32.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj521 td/osd-backfill-space/datafile 2024-09-16T04:19:32.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj521 td/osd-backfill-space/datafile 2024-09-16T04:19:32.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:32.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj521 td/osd-backfill-space/datafile 2024-09-16T04:19:33.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj521 td/osd-backfill-space/datafile 2024-09-16T04:19:33.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj521 td/osd-backfill-space/datafile 2024-09-16T04:19:33.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:33.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:33.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj522 td/osd-backfill-space/datafile 2024-09-16T04:19:33.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj522 td/osd-backfill-space/datafile 2024-09-16T04:19:33.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj522 td/osd-backfill-space/datafile 2024-09-16T04:19:33.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj522 td/osd-backfill-space/datafile 2024-09-16T04:19:33.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj522 td/osd-backfill-space/datafile 2024-09-16T04:19:33.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj522 td/osd-backfill-space/datafile 2024-09-16T04:19:33.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj522 td/osd-backfill-space/datafile 2024-09-16T04:19:33.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj522 td/osd-backfill-space/datafile 2024-09-16T04:19:33.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:33.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:33.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj523 td/osd-backfill-space/datafile 2024-09-16T04:19:33.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj523 td/osd-backfill-space/datafile 2024-09-16T04:19:33.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj523 td/osd-backfill-space/datafile 2024-09-16T04:19:33.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:33.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj523 td/osd-backfill-space/datafile 2024-09-16T04:19:34.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj523 td/osd-backfill-space/datafile 2024-09-16T04:19:34.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj523 td/osd-backfill-space/datafile 2024-09-16T04:19:34.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj523 td/osd-backfill-space/datafile 2024-09-16T04:19:34.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj523 td/osd-backfill-space/datafile 2024-09-16T04:19:34.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:34.404 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:34.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj524 td/osd-backfill-space/datafile 2024-09-16T04:19:34.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj524 td/osd-backfill-space/datafile 2024-09-16T04:19:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj524 td/osd-backfill-space/datafile 2024-09-16T04:19:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj524 td/osd-backfill-space/datafile 2024-09-16T04:19:34.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj524 td/osd-backfill-space/datafile 2024-09-16T04:19:34.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj524 td/osd-backfill-space/datafile 2024-09-16T04:19:34.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj524 td/osd-backfill-space/datafile 2024-09-16T04:19:34.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj524 td/osd-backfill-space/datafile 2024-09-16T04:19:34.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:34.967 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:34.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:34.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj525 td/osd-backfill-space/datafile 2024-09-16T04:19:35.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj525 td/osd-backfill-space/datafile 2024-09-16T04:19:35.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj525 td/osd-backfill-space/datafile 2024-09-16T04:19:35.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj525 td/osd-backfill-space/datafile 2024-09-16T04:19:35.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj525 td/osd-backfill-space/datafile 2024-09-16T04:19:35.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj525 td/osd-backfill-space/datafile 2024-09-16T04:19:35.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj525 td/osd-backfill-space/datafile 2024-09-16T04:19:35.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj525 td/osd-backfill-space/datafile 2024-09-16T04:19:35.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:35.561 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:35.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj526 td/osd-backfill-space/datafile 2024-09-16T04:19:35.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj526 td/osd-backfill-space/datafile 2024-09-16T04:19:35.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj526 td/osd-backfill-space/datafile 2024-09-16T04:19:35.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj526 td/osd-backfill-space/datafile 2024-09-16T04:19:35.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj526 td/osd-backfill-space/datafile 2024-09-16T04:19:35.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj526 td/osd-backfill-space/datafile 2024-09-16T04:19:35.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:35.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj526 td/osd-backfill-space/datafile 2024-09-16T04:19:36.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj526 td/osd-backfill-space/datafile 2024-09-16T04:19:36.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:36.122 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:36.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj527 td/osd-backfill-space/datafile 2024-09-16T04:19:36.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj527 td/osd-backfill-space/datafile 2024-09-16T04:19:36.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj527 td/osd-backfill-space/datafile 2024-09-16T04:19:36.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj527 td/osd-backfill-space/datafile 2024-09-16T04:19:36.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj527 td/osd-backfill-space/datafile 2024-09-16T04:19:36.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj527 td/osd-backfill-space/datafile 2024-09-16T04:19:36.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj527 td/osd-backfill-space/datafile 2024-09-16T04:19:36.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj527 td/osd-backfill-space/datafile 2024-09-16T04:19:36.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:36.708 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:36.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj528 td/osd-backfill-space/datafile 2024-09-16T04:19:36.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj528 td/osd-backfill-space/datafile 2024-09-16T04:19:36.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj528 td/osd-backfill-space/datafile 2024-09-16T04:19:36.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:36.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj528 td/osd-backfill-space/datafile 2024-09-16T04:19:37.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj528 td/osd-backfill-space/datafile 2024-09-16T04:19:37.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj528 td/osd-backfill-space/datafile 2024-09-16T04:19:37.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj528 td/osd-backfill-space/datafile 2024-09-16T04:19:37.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj528 td/osd-backfill-space/datafile 2024-09-16T04:19:37.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:37.331 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:37.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj529 td/osd-backfill-space/datafile 2024-09-16T04:19:37.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj529 td/osd-backfill-space/datafile 2024-09-16T04:19:37.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj529 td/osd-backfill-space/datafile 2024-09-16T04:19:37.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj529 td/osd-backfill-space/datafile 2024-09-16T04:19:37.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj529 td/osd-backfill-space/datafile 2024-09-16T04:19:37.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj529 td/osd-backfill-space/datafile 2024-09-16T04:19:37.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj529 td/osd-backfill-space/datafile 2024-09-16T04:19:37.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj529 td/osd-backfill-space/datafile 2024-09-16T04:19:37.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:37.901 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:37.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj530 td/osd-backfill-space/datafile 2024-09-16T04:19:37.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:37.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj530 td/osd-backfill-space/datafile 2024-09-16T04:19:38.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj530 td/osd-backfill-space/datafile 2024-09-16T04:19:38.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj530 td/osd-backfill-space/datafile 2024-09-16T04:19:38.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj530 td/osd-backfill-space/datafile 2024-09-16T04:19:38.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj530 td/osd-backfill-space/datafile 2024-09-16T04:19:38.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj530 td/osd-backfill-space/datafile 2024-09-16T04:19:38.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj530 td/osd-backfill-space/datafile 2024-09-16T04:19:38.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:38.462 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:38.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj531 td/osd-backfill-space/datafile 2024-09-16T04:19:38.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj531 td/osd-backfill-space/datafile 2024-09-16T04:19:38.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj531 td/osd-backfill-space/datafile 2024-09-16T04:19:38.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj531 td/osd-backfill-space/datafile 2024-09-16T04:19:38.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj531 td/osd-backfill-space/datafile 2024-09-16T04:19:38.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj531 td/osd-backfill-space/datafile 2024-09-16T04:19:38.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:38.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj531 td/osd-backfill-space/datafile 2024-09-16T04:19:39.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj531 td/osd-backfill-space/datafile 2024-09-16T04:19:39.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:39.081 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:39.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj532 td/osd-backfill-space/datafile 2024-09-16T04:19:39.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj532 td/osd-backfill-space/datafile 2024-09-16T04:19:39.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj532 td/osd-backfill-space/datafile 2024-09-16T04:19:39.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj532 td/osd-backfill-space/datafile 2024-09-16T04:19:39.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj532 td/osd-backfill-space/datafile 2024-09-16T04:19:39.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj532 td/osd-backfill-space/datafile 2024-09-16T04:19:39.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj532 td/osd-backfill-space/datafile 2024-09-16T04:19:39.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj532 td/osd-backfill-space/datafile 2024-09-16T04:19:39.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:39.710 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:39.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj533 td/osd-backfill-space/datafile 2024-09-16T04:19:39.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj533 td/osd-backfill-space/datafile 2024-09-16T04:19:39.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj533 td/osd-backfill-space/datafile 2024-09-16T04:19:39.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:39.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj533 td/osd-backfill-space/datafile 2024-09-16T04:19:40.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj533 td/osd-backfill-space/datafile 2024-09-16T04:19:40.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj533 td/osd-backfill-space/datafile 2024-09-16T04:19:40.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj533 td/osd-backfill-space/datafile 2024-09-16T04:19:40.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj533 td/osd-backfill-space/datafile 2024-09-16T04:19:40.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:40.299 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:40.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj534 td/osd-backfill-space/datafile 2024-09-16T04:19:40.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj534 td/osd-backfill-space/datafile 2024-09-16T04:19:40.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj534 td/osd-backfill-space/datafile 2024-09-16T04:19:40.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj534 td/osd-backfill-space/datafile 2024-09-16T04:19:40.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj534 td/osd-backfill-space/datafile 2024-09-16T04:19:40.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj534 td/osd-backfill-space/datafile 2024-09-16T04:19:40.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj534 td/osd-backfill-space/datafile 2024-09-16T04:19:40.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj534 td/osd-backfill-space/datafile 2024-09-16T04:19:40.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:40.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:40.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj535 td/osd-backfill-space/datafile 2024-09-16T04:19:40.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:40.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj535 td/osd-backfill-space/datafile 2024-09-16T04:19:41.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj535 td/osd-backfill-space/datafile 2024-09-16T04:19:41.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj535 td/osd-backfill-space/datafile 2024-09-16T04:19:41.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj535 td/osd-backfill-space/datafile 2024-09-16T04:19:41.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj535 td/osd-backfill-space/datafile 2024-09-16T04:19:41.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj535 td/osd-backfill-space/datafile 2024-09-16T04:19:41.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj535 td/osd-backfill-space/datafile 2024-09-16T04:19:41.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:41.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:41.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj536 td/osd-backfill-space/datafile 2024-09-16T04:19:41.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj536 td/osd-backfill-space/datafile 2024-09-16T04:19:41.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj536 td/osd-backfill-space/datafile 2024-09-16T04:19:41.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj536 td/osd-backfill-space/datafile 2024-09-16T04:19:41.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj536 td/osd-backfill-space/datafile 2024-09-16T04:19:41.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj536 td/osd-backfill-space/datafile 2024-09-16T04:19:41.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj536 td/osd-backfill-space/datafile 2024-09-16T04:19:41.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:41.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj536 td/osd-backfill-space/datafile 2024-09-16T04:19:42.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:42.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:42.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj537 td/osd-backfill-space/datafile 2024-09-16T04:19:42.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj537 td/osd-backfill-space/datafile 2024-09-16T04:19:42.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj537 td/osd-backfill-space/datafile 2024-09-16T04:19:42.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj537 td/osd-backfill-space/datafile 2024-09-16T04:19:42.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj537 td/osd-backfill-space/datafile 2024-09-16T04:19:42.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj537 td/osd-backfill-space/datafile 2024-09-16T04:19:42.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj537 td/osd-backfill-space/datafile 2024-09-16T04:19:42.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj537 td/osd-backfill-space/datafile 2024-09-16T04:19:42.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:42.656 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:42.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj538 td/osd-backfill-space/datafile 2024-09-16T04:19:42.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj538 td/osd-backfill-space/datafile 2024-09-16T04:19:42.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj538 td/osd-backfill-space/datafile 2024-09-16T04:19:42.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj538 td/osd-backfill-space/datafile 2024-09-16T04:19:42.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:42.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj538 td/osd-backfill-space/datafile 2024-09-16T04:19:43.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj538 td/osd-backfill-space/datafile 2024-09-16T04:19:43.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj538 td/osd-backfill-space/datafile 2024-09-16T04:19:43.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj538 td/osd-backfill-space/datafile 2024-09-16T04:19:43.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:43.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:43.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj539 td/osd-backfill-space/datafile 2024-09-16T04:19:43.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj539 td/osd-backfill-space/datafile 2024-09-16T04:19:43.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj539 td/osd-backfill-space/datafile 2024-09-16T04:19:43.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj539 td/osd-backfill-space/datafile 2024-09-16T04:19:43.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj539 td/osd-backfill-space/datafile 2024-09-16T04:19:43.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj539 td/osd-backfill-space/datafile 2024-09-16T04:19:43.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj539 td/osd-backfill-space/datafile 2024-09-16T04:19:43.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj539 td/osd-backfill-space/datafile 2024-09-16T04:19:43.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:43.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:43.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj540 td/osd-backfill-space/datafile 2024-09-16T04:19:43.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:43.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj540 td/osd-backfill-space/datafile 2024-09-16T04:19:44.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj540 td/osd-backfill-space/datafile 2024-09-16T04:19:44.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj540 td/osd-backfill-space/datafile 2024-09-16T04:19:44.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj540 td/osd-backfill-space/datafile 2024-09-16T04:19:44.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj540 td/osd-backfill-space/datafile 2024-09-16T04:19:44.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj540 td/osd-backfill-space/datafile 2024-09-16T04:19:44.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj540 td/osd-backfill-space/datafile 2024-09-16T04:19:44.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:44.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:44.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj541 td/osd-backfill-space/datafile 2024-09-16T04:19:44.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj541 td/osd-backfill-space/datafile 2024-09-16T04:19:44.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj541 td/osd-backfill-space/datafile 2024-09-16T04:19:44.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj541 td/osd-backfill-space/datafile 2024-09-16T04:19:44.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj541 td/osd-backfill-space/datafile 2024-09-16T04:19:44.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj541 td/osd-backfill-space/datafile 2024-09-16T04:19:44.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:44.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj541 td/osd-backfill-space/datafile 2024-09-16T04:19:45.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj541 td/osd-backfill-space/datafile 2024-09-16T04:19:45.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:45.118 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:45.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj542 td/osd-backfill-space/datafile 2024-09-16T04:19:45.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj542 td/osd-backfill-space/datafile 2024-09-16T04:19:45.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj542 td/osd-backfill-space/datafile 2024-09-16T04:19:45.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj542 td/osd-backfill-space/datafile 2024-09-16T04:19:45.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj542 td/osd-backfill-space/datafile 2024-09-16T04:19:45.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj542 td/osd-backfill-space/datafile 2024-09-16T04:19:45.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj542 td/osd-backfill-space/datafile 2024-09-16T04:19:45.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj542 td/osd-backfill-space/datafile 2024-09-16T04:19:45.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:45.721 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:45.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj543 td/osd-backfill-space/datafile 2024-09-16T04:19:45.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj543 td/osd-backfill-space/datafile 2024-09-16T04:19:45.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj543 td/osd-backfill-space/datafile 2024-09-16T04:19:45.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:45.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj543 td/osd-backfill-space/datafile 2024-09-16T04:19:46.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj543 td/osd-backfill-space/datafile 2024-09-16T04:19:46.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj543 td/osd-backfill-space/datafile 2024-09-16T04:19:46.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj543 td/osd-backfill-space/datafile 2024-09-16T04:19:46.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj543 td/osd-backfill-space/datafile 2024-09-16T04:19:46.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:46.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:46.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj544 td/osd-backfill-space/datafile 2024-09-16T04:19:46.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj544 td/osd-backfill-space/datafile 2024-09-16T04:19:46.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj544 td/osd-backfill-space/datafile 2024-09-16T04:19:46.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj544 td/osd-backfill-space/datafile 2024-09-16T04:19:46.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj544 td/osd-backfill-space/datafile 2024-09-16T04:19:46.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj544 td/osd-backfill-space/datafile 2024-09-16T04:19:46.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj544 td/osd-backfill-space/datafile 2024-09-16T04:19:46.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj544 td/osd-backfill-space/datafile 2024-09-16T04:19:46.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:46.901 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:46.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj545 td/osd-backfill-space/datafile 2024-09-16T04:19:46.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:46.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj545 td/osd-backfill-space/datafile 2024-09-16T04:19:47.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj545 td/osd-backfill-space/datafile 2024-09-16T04:19:47.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj545 td/osd-backfill-space/datafile 2024-09-16T04:19:47.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj545 td/osd-backfill-space/datafile 2024-09-16T04:19:47.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj545 td/osd-backfill-space/datafile 2024-09-16T04:19:47.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj545 td/osd-backfill-space/datafile 2024-09-16T04:19:47.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj545 td/osd-backfill-space/datafile 2024-09-16T04:19:47.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:47.461 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:47.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj546 td/osd-backfill-space/datafile 2024-09-16T04:19:47.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj546 td/osd-backfill-space/datafile 2024-09-16T04:19:47.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj546 td/osd-backfill-space/datafile 2024-09-16T04:19:47.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj546 td/osd-backfill-space/datafile 2024-09-16T04:19:47.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj546 td/osd-backfill-space/datafile 2024-09-16T04:19:47.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj546 td/osd-backfill-space/datafile 2024-09-16T04:19:47.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj546 td/osd-backfill-space/datafile 2024-09-16T04:19:47.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:47.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj546 td/osd-backfill-space/datafile 2024-09-16T04:19:48.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:48.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:48.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj547 td/osd-backfill-space/datafile 2024-09-16T04:19:48.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj547 td/osd-backfill-space/datafile 2024-09-16T04:19:48.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj547 td/osd-backfill-space/datafile 2024-09-16T04:19:48.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj547 td/osd-backfill-space/datafile 2024-09-16T04:19:48.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj547 td/osd-backfill-space/datafile 2024-09-16T04:19:48.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj547 td/osd-backfill-space/datafile 2024-09-16T04:19:48.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj547 td/osd-backfill-space/datafile 2024-09-16T04:19:48.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj547 td/osd-backfill-space/datafile 2024-09-16T04:19:48.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:48.617 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:48.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj548 td/osd-backfill-space/datafile 2024-09-16T04:19:48.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj548 td/osd-backfill-space/datafile 2024-09-16T04:19:48.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj548 td/osd-backfill-space/datafile 2024-09-16T04:19:48.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj548 td/osd-backfill-space/datafile 2024-09-16T04:19:48.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:48.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj548 td/osd-backfill-space/datafile 2024-09-16T04:19:49.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:49.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj548 td/osd-backfill-space/datafile 2024-09-16T04:19:49.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:49.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj548 td/osd-backfill-space/datafile 2024-09-16T04:19:49.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:49.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj548 td/osd-backfill-space/datafile 2024-09-16T04:19:49.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:49.206 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:49.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:49.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj549 td/osd-backfill-space/datafile 2024-09-16T04:19:49.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:49.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj549 td/osd-backfill-space/datafile 2024-09-16T04:19:49.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:49.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj549 td/osd-backfill-space/datafile 2024-09-16T04:19:49.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:49.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj549 td/osd-backfill-space/datafile 2024-09-16T04:19:49.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:49.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj549 td/osd-backfill-space/datafile 2024-09-16T04:19:49.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:49.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj549 td/osd-backfill-space/datafile 2024-09-16T04:19:49.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:49.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj549 td/osd-backfill-space/datafile 2024-09-16T04:19:50.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:50.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj549 td/osd-backfill-space/datafile 2024-09-16T04:19:50.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:50.468 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:50.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:50.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj550 td/osd-backfill-space/datafile 2024-09-16T04:19:50.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:50.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj550 td/osd-backfill-space/datafile 2024-09-16T04:19:50.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:50.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj550 td/osd-backfill-space/datafile 2024-09-16T04:19:50.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:50.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj550 td/osd-backfill-space/datafile 2024-09-16T04:19:50.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:50.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj550 td/osd-backfill-space/datafile 2024-09-16T04:19:50.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:50.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj550 td/osd-backfill-space/datafile 2024-09-16T04:19:51.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj550 td/osd-backfill-space/datafile 2024-09-16T04:19:51.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj550 td/osd-backfill-space/datafile 2024-09-16T04:19:51.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:51.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:51.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj551 td/osd-backfill-space/datafile 2024-09-16T04:19:51.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj551 td/osd-backfill-space/datafile 2024-09-16T04:19:51.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj551 td/osd-backfill-space/datafile 2024-09-16T04:19:51.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj551 td/osd-backfill-space/datafile 2024-09-16T04:19:51.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj551 td/osd-backfill-space/datafile 2024-09-16T04:19:51.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj551 td/osd-backfill-space/datafile 2024-09-16T04:19:51.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj551 td/osd-backfill-space/datafile 2024-09-16T04:19:51.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj551 td/osd-backfill-space/datafile 2024-09-16T04:19:51.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:51.814 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:51.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj552 td/osd-backfill-space/datafile 2024-09-16T04:19:51.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj552 td/osd-backfill-space/datafile 2024-09-16T04:19:51.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:51.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj552 td/osd-backfill-space/datafile 2024-09-16T04:19:52.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj552 td/osd-backfill-space/datafile 2024-09-16T04:19:52.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj552 td/osd-backfill-space/datafile 2024-09-16T04:19:52.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj552 td/osd-backfill-space/datafile 2024-09-16T04:19:52.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj552 td/osd-backfill-space/datafile 2024-09-16T04:19:52.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj552 td/osd-backfill-space/datafile 2024-09-16T04:19:52.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:52.367 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:52.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj553 td/osd-backfill-space/datafile 2024-09-16T04:19:52.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj553 td/osd-backfill-space/datafile 2024-09-16T04:19:52.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj553 td/osd-backfill-space/datafile 2024-09-16T04:19:52.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj553 td/osd-backfill-space/datafile 2024-09-16T04:19:52.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj553 td/osd-backfill-space/datafile 2024-09-16T04:19:52.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj553 td/osd-backfill-space/datafile 2024-09-16T04:19:52.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj553 td/osd-backfill-space/datafile 2024-09-16T04:19:52.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj553 td/osd-backfill-space/datafile 2024-09-16T04:19:52.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:52.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:52.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:52.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj554 td/osd-backfill-space/datafile 2024-09-16T04:19:53.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj554 td/osd-backfill-space/datafile 2024-09-16T04:19:53.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj554 td/osd-backfill-space/datafile 2024-09-16T04:19:53.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj554 td/osd-backfill-space/datafile 2024-09-16T04:19:53.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj554 td/osd-backfill-space/datafile 2024-09-16T04:19:53.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj554 td/osd-backfill-space/datafile 2024-09-16T04:19:53.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj554 td/osd-backfill-space/datafile 2024-09-16T04:19:53.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj554 td/osd-backfill-space/datafile 2024-09-16T04:19:53.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:53.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:53.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj555 td/osd-backfill-space/datafile 2024-09-16T04:19:53.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj555 td/osd-backfill-space/datafile 2024-09-16T04:19:53.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj555 td/osd-backfill-space/datafile 2024-09-16T04:19:53.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj555 td/osd-backfill-space/datafile 2024-09-16T04:19:53.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj555 td/osd-backfill-space/datafile 2024-09-16T04:19:53.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj555 td/osd-backfill-space/datafile 2024-09-16T04:19:53.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:53.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj555 td/osd-backfill-space/datafile 2024-09-16T04:19:54.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj555 td/osd-backfill-space/datafile 2024-09-16T04:19:54.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:54.134 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:54.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj556 td/osd-backfill-space/datafile 2024-09-16T04:19:54.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj556 td/osd-backfill-space/datafile 2024-09-16T04:19:54.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj556 td/osd-backfill-space/datafile 2024-09-16T04:19:54.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj556 td/osd-backfill-space/datafile 2024-09-16T04:19:54.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj556 td/osd-backfill-space/datafile 2024-09-16T04:19:54.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj556 td/osd-backfill-space/datafile 2024-09-16T04:19:54.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj556 td/osd-backfill-space/datafile 2024-09-16T04:19:54.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj556 td/osd-backfill-space/datafile 2024-09-16T04:19:54.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:54.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:54.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj557 td/osd-backfill-space/datafile 2024-09-16T04:19:54.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj557 td/osd-backfill-space/datafile 2024-09-16T04:19:54.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj557 td/osd-backfill-space/datafile 2024-09-16T04:19:54.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:54.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj557 td/osd-backfill-space/datafile 2024-09-16T04:19:55.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj557 td/osd-backfill-space/datafile 2024-09-16T04:19:55.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj557 td/osd-backfill-space/datafile 2024-09-16T04:19:55.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj557 td/osd-backfill-space/datafile 2024-09-16T04:19:55.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj557 td/osd-backfill-space/datafile 2024-09-16T04:19:55.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:55.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:55.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj558 td/osd-backfill-space/datafile 2024-09-16T04:19:55.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj558 td/osd-backfill-space/datafile 2024-09-16T04:19:55.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj558 td/osd-backfill-space/datafile 2024-09-16T04:19:55.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj558 td/osd-backfill-space/datafile 2024-09-16T04:19:55.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj558 td/osd-backfill-space/datafile 2024-09-16T04:19:55.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj558 td/osd-backfill-space/datafile 2024-09-16T04:19:55.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj558 td/osd-backfill-space/datafile 2024-09-16T04:19:55.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj558 td/osd-backfill-space/datafile 2024-09-16T04:19:55.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:55.917 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:55.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj559 td/osd-backfill-space/datafile 2024-09-16T04:19:55.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:55.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj559 td/osd-backfill-space/datafile 2024-09-16T04:19:56.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj559 td/osd-backfill-space/datafile 2024-09-16T04:19:56.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj559 td/osd-backfill-space/datafile 2024-09-16T04:19:56.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj559 td/osd-backfill-space/datafile 2024-09-16T04:19:56.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj559 td/osd-backfill-space/datafile 2024-09-16T04:19:56.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj559 td/osd-backfill-space/datafile 2024-09-16T04:19:56.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj559 td/osd-backfill-space/datafile 2024-09-16T04:19:56.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:56.461 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:56.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj560 td/osd-backfill-space/datafile 2024-09-16T04:19:56.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj560 td/osd-backfill-space/datafile 2024-09-16T04:19:56.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj560 td/osd-backfill-space/datafile 2024-09-16T04:19:56.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj560 td/osd-backfill-space/datafile 2024-09-16T04:19:56.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj560 td/osd-backfill-space/datafile 2024-09-16T04:19:56.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj560 td/osd-backfill-space/datafile 2024-09-16T04:19:56.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj560 td/osd-backfill-space/datafile 2024-09-16T04:19:56.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:56.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj560 td/osd-backfill-space/datafile 2024-09-16T04:19:57.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:57.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:57.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj561 td/osd-backfill-space/datafile 2024-09-16T04:19:57.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj561 td/osd-backfill-space/datafile 2024-09-16T04:19:57.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj561 td/osd-backfill-space/datafile 2024-09-16T04:19:57.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj561 td/osd-backfill-space/datafile 2024-09-16T04:19:57.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj561 td/osd-backfill-space/datafile 2024-09-16T04:19:57.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj561 td/osd-backfill-space/datafile 2024-09-16T04:19:57.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj561 td/osd-backfill-space/datafile 2024-09-16T04:19:57.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj561 td/osd-backfill-space/datafile 2024-09-16T04:19:57.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:57.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:57.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj562 td/osd-backfill-space/datafile 2024-09-16T04:19:57.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj562 td/osd-backfill-space/datafile 2024-09-16T04:19:57.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj562 td/osd-backfill-space/datafile 2024-09-16T04:19:57.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj562 td/osd-backfill-space/datafile 2024-09-16T04:19:57.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj562 td/osd-backfill-space/datafile 2024-09-16T04:19:57.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:57.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj562 td/osd-backfill-space/datafile 2024-09-16T04:19:58.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj562 td/osd-backfill-space/datafile 2024-09-16T04:19:58.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj562 td/osd-backfill-space/datafile 2024-09-16T04:19:58.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:58.213 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:58.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj563 td/osd-backfill-space/datafile 2024-09-16T04:19:58.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj563 td/osd-backfill-space/datafile 2024-09-16T04:19:58.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj563 td/osd-backfill-space/datafile 2024-09-16T04:19:58.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj563 td/osd-backfill-space/datafile 2024-09-16T04:19:58.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj563 td/osd-backfill-space/datafile 2024-09-16T04:19:58.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj563 td/osd-backfill-space/datafile 2024-09-16T04:19:58.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj563 td/osd-backfill-space/datafile 2024-09-16T04:19:58.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj563 td/osd-backfill-space/datafile 2024-09-16T04:19:58.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:58.814 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:58.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj564 td/osd-backfill-space/datafile 2024-09-16T04:19:58.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj564 td/osd-backfill-space/datafile 2024-09-16T04:19:58.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:58.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj564 td/osd-backfill-space/datafile 2024-09-16T04:19:59.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj564 td/osd-backfill-space/datafile 2024-09-16T04:19:59.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj564 td/osd-backfill-space/datafile 2024-09-16T04:19:59.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj564 td/osd-backfill-space/datafile 2024-09-16T04:19:59.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj564 td/osd-backfill-space/datafile 2024-09-16T04:19:59.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj564 td/osd-backfill-space/datafile 2024-09-16T04:19:59.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:59.375 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:59.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj565 td/osd-backfill-space/datafile 2024-09-16T04:19:59.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj565 td/osd-backfill-space/datafile 2024-09-16T04:19:59.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj565 td/osd-backfill-space/datafile 2024-09-16T04:19:59.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj565 td/osd-backfill-space/datafile 2024-09-16T04:19:59.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj565 td/osd-backfill-space/datafile 2024-09-16T04:19:59.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj565 td/osd-backfill-space/datafile 2024-09-16T04:19:59.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj565 td/osd-backfill-space/datafile 2024-09-16T04:19:59.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj565 td/osd-backfill-space/datafile 2024-09-16T04:19:59.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:19:59.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:19:59.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:19:59.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj566 td/osd-backfill-space/datafile 2024-09-16T04:20:00.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj566 td/osd-backfill-space/datafile 2024-09-16T04:20:00.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj566 td/osd-backfill-space/datafile 2024-09-16T04:20:00.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj566 td/osd-backfill-space/datafile 2024-09-16T04:20:00.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj566 td/osd-backfill-space/datafile 2024-09-16T04:20:00.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj566 td/osd-backfill-space/datafile 2024-09-16T04:20:00.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj566 td/osd-backfill-space/datafile 2024-09-16T04:20:00.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj566 td/osd-backfill-space/datafile 2024-09-16T04:20:00.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:00.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:00.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj567 td/osd-backfill-space/datafile 2024-09-16T04:20:00.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj567 td/osd-backfill-space/datafile 2024-09-16T04:20:00.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj567 td/osd-backfill-space/datafile 2024-09-16T04:20:00.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj567 td/osd-backfill-space/datafile 2024-09-16T04:20:00.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj567 td/osd-backfill-space/datafile 2024-09-16T04:20:00.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:00.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj567 td/osd-backfill-space/datafile 2024-09-16T04:20:01.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj567 td/osd-backfill-space/datafile 2024-09-16T04:20:01.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj567 td/osd-backfill-space/datafile 2024-09-16T04:20:01.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:01.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:01.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj568 td/osd-backfill-space/datafile 2024-09-16T04:20:01.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj568 td/osd-backfill-space/datafile 2024-09-16T04:20:01.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj568 td/osd-backfill-space/datafile 2024-09-16T04:20:01.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj568 td/osd-backfill-space/datafile 2024-09-16T04:20:01.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj568 td/osd-backfill-space/datafile 2024-09-16T04:20:01.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj568 td/osd-backfill-space/datafile 2024-09-16T04:20:01.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj568 td/osd-backfill-space/datafile 2024-09-16T04:20:01.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj568 td/osd-backfill-space/datafile 2024-09-16T04:20:01.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:01.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:01.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj569 td/osd-backfill-space/datafile 2024-09-16T04:20:01.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj569 td/osd-backfill-space/datafile 2024-09-16T04:20:01.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:01.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj569 td/osd-backfill-space/datafile 2024-09-16T04:20:02.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj569 td/osd-backfill-space/datafile 2024-09-16T04:20:02.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj569 td/osd-backfill-space/datafile 2024-09-16T04:20:02.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj569 td/osd-backfill-space/datafile 2024-09-16T04:20:02.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj569 td/osd-backfill-space/datafile 2024-09-16T04:20:02.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj569 td/osd-backfill-space/datafile 2024-09-16T04:20:02.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:02.380 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:02.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj570 td/osd-backfill-space/datafile 2024-09-16T04:20:02.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj570 td/osd-backfill-space/datafile 2024-09-16T04:20:02.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj570 td/osd-backfill-space/datafile 2024-09-16T04:20:02.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj570 td/osd-backfill-space/datafile 2024-09-16T04:20:02.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj570 td/osd-backfill-space/datafile 2024-09-16T04:20:02.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj570 td/osd-backfill-space/datafile 2024-09-16T04:20:02.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj570 td/osd-backfill-space/datafile 2024-09-16T04:20:02.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj570 td/osd-backfill-space/datafile 2024-09-16T04:20:02.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:02.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:02.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:02.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj571 td/osd-backfill-space/datafile 2024-09-16T04:20:03.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj571 td/osd-backfill-space/datafile 2024-09-16T04:20:03.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj571 td/osd-backfill-space/datafile 2024-09-16T04:20:03.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj571 td/osd-backfill-space/datafile 2024-09-16T04:20:03.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj571 td/osd-backfill-space/datafile 2024-09-16T04:20:03.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj571 td/osd-backfill-space/datafile 2024-09-16T04:20:03.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj571 td/osd-backfill-space/datafile 2024-09-16T04:20:03.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj571 td/osd-backfill-space/datafile 2024-09-16T04:20:03.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:03.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:03.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj572 td/osd-backfill-space/datafile 2024-09-16T04:20:03.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj572 td/osd-backfill-space/datafile 2024-09-16T04:20:03.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj572 td/osd-backfill-space/datafile 2024-09-16T04:20:03.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj572 td/osd-backfill-space/datafile 2024-09-16T04:20:03.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj572 td/osd-backfill-space/datafile 2024-09-16T04:20:03.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj572 td/osd-backfill-space/datafile 2024-09-16T04:20:03.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:03.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj572 td/osd-backfill-space/datafile 2024-09-16T04:20:04.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj572 td/osd-backfill-space/datafile 2024-09-16T04:20:04.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:04.097 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:04.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj573 td/osd-backfill-space/datafile 2024-09-16T04:20:04.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj573 td/osd-backfill-space/datafile 2024-09-16T04:20:04.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj573 td/osd-backfill-space/datafile 2024-09-16T04:20:04.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj573 td/osd-backfill-space/datafile 2024-09-16T04:20:04.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj573 td/osd-backfill-space/datafile 2024-09-16T04:20:04.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj573 td/osd-backfill-space/datafile 2024-09-16T04:20:04.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj573 td/osd-backfill-space/datafile 2024-09-16T04:20:04.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj573 td/osd-backfill-space/datafile 2024-09-16T04:20:04.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:04.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:04.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj574 td/osd-backfill-space/datafile 2024-09-16T04:20:04.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj574 td/osd-backfill-space/datafile 2024-09-16T04:20:04.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj574 td/osd-backfill-space/datafile 2024-09-16T04:20:04.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:04.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj574 td/osd-backfill-space/datafile 2024-09-16T04:20:05.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj574 td/osd-backfill-space/datafile 2024-09-16T04:20:05.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj574 td/osd-backfill-space/datafile 2024-09-16T04:20:05.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj574 td/osd-backfill-space/datafile 2024-09-16T04:20:05.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj574 td/osd-backfill-space/datafile 2024-09-16T04:20:05.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:05.302 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:05.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj575 td/osd-backfill-space/datafile 2024-09-16T04:20:05.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj575 td/osd-backfill-space/datafile 2024-09-16T04:20:05.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj575 td/osd-backfill-space/datafile 2024-09-16T04:20:05.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj575 td/osd-backfill-space/datafile 2024-09-16T04:20:05.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj575 td/osd-backfill-space/datafile 2024-09-16T04:20:05.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj575 td/osd-backfill-space/datafile 2024-09-16T04:20:05.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj575 td/osd-backfill-space/datafile 2024-09-16T04:20:05.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj575 td/osd-backfill-space/datafile 2024-09-16T04:20:05.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:05.906 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:05.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj576 td/osd-backfill-space/datafile 2024-09-16T04:20:05.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:05.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj576 td/osd-backfill-space/datafile 2024-09-16T04:20:06.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj576 td/osd-backfill-space/datafile 2024-09-16T04:20:06.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj576 td/osd-backfill-space/datafile 2024-09-16T04:20:06.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj576 td/osd-backfill-space/datafile 2024-09-16T04:20:06.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj576 td/osd-backfill-space/datafile 2024-09-16T04:20:06.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj576 td/osd-backfill-space/datafile 2024-09-16T04:20:06.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj576 td/osd-backfill-space/datafile 2024-09-16T04:20:06.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:06.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:06.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj577 td/osd-backfill-space/datafile 2024-09-16T04:20:06.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj577 td/osd-backfill-space/datafile 2024-09-16T04:20:06.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj577 td/osd-backfill-space/datafile 2024-09-16T04:20:06.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj577 td/osd-backfill-space/datafile 2024-09-16T04:20:06.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj577 td/osd-backfill-space/datafile 2024-09-16T04:20:06.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj577 td/osd-backfill-space/datafile 2024-09-16T04:20:06.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:06.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj577 td/osd-backfill-space/datafile 2024-09-16T04:20:07.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj577 td/osd-backfill-space/datafile 2024-09-16T04:20:07.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:07.103 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:07.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj578 td/osd-backfill-space/datafile 2024-09-16T04:20:07.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj578 td/osd-backfill-space/datafile 2024-09-16T04:20:07.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj578 td/osd-backfill-space/datafile 2024-09-16T04:20:07.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj578 td/osd-backfill-space/datafile 2024-09-16T04:20:07.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj578 td/osd-backfill-space/datafile 2024-09-16T04:20:07.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj578 td/osd-backfill-space/datafile 2024-09-16T04:20:07.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj578 td/osd-backfill-space/datafile 2024-09-16T04:20:07.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj578 td/osd-backfill-space/datafile 2024-09-16T04:20:07.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:07.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:07.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj579 td/osd-backfill-space/datafile 2024-09-16T04:20:07.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj579 td/osd-backfill-space/datafile 2024-09-16T04:20:07.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj579 td/osd-backfill-space/datafile 2024-09-16T04:20:07.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj579 td/osd-backfill-space/datafile 2024-09-16T04:20:07.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:07.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj579 td/osd-backfill-space/datafile 2024-09-16T04:20:08.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj579 td/osd-backfill-space/datafile 2024-09-16T04:20:08.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj579 td/osd-backfill-space/datafile 2024-09-16T04:20:08.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj579 td/osd-backfill-space/datafile 2024-09-16T04:20:08.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:08.300 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:08.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj580 td/osd-backfill-space/datafile 2024-09-16T04:20:08.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj580 td/osd-backfill-space/datafile 2024-09-16T04:20:08.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj580 td/osd-backfill-space/datafile 2024-09-16T04:20:08.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj580 td/osd-backfill-space/datafile 2024-09-16T04:20:08.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj580 td/osd-backfill-space/datafile 2024-09-16T04:20:08.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj580 td/osd-backfill-space/datafile 2024-09-16T04:20:08.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj580 td/osd-backfill-space/datafile 2024-09-16T04:20:08.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj580 td/osd-backfill-space/datafile 2024-09-16T04:20:08.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:08.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:08.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj581 td/osd-backfill-space/datafile 2024-09-16T04:20:08.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:08.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj581 td/osd-backfill-space/datafile 2024-09-16T04:20:09.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj581 td/osd-backfill-space/datafile 2024-09-16T04:20:09.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj581 td/osd-backfill-space/datafile 2024-09-16T04:20:09.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj581 td/osd-backfill-space/datafile 2024-09-16T04:20:09.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj581 td/osd-backfill-space/datafile 2024-09-16T04:20:09.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj581 td/osd-backfill-space/datafile 2024-09-16T04:20:09.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj581 td/osd-backfill-space/datafile 2024-09-16T04:20:09.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:09.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:09.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj582 td/osd-backfill-space/datafile 2024-09-16T04:20:09.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj582 td/osd-backfill-space/datafile 2024-09-16T04:20:09.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj582 td/osd-backfill-space/datafile 2024-09-16T04:20:09.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj582 td/osd-backfill-space/datafile 2024-09-16T04:20:09.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj582 td/osd-backfill-space/datafile 2024-09-16T04:20:09.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj582 td/osd-backfill-space/datafile 2024-09-16T04:20:09.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:09.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj582 td/osd-backfill-space/datafile 2024-09-16T04:20:10.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj582 td/osd-backfill-space/datafile 2024-09-16T04:20:10.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:10.083 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:10.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj583 td/osd-backfill-space/datafile 2024-09-16T04:20:10.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj583 td/osd-backfill-space/datafile 2024-09-16T04:20:10.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj583 td/osd-backfill-space/datafile 2024-09-16T04:20:10.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj583 td/osd-backfill-space/datafile 2024-09-16T04:20:10.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj583 td/osd-backfill-space/datafile 2024-09-16T04:20:10.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj583 td/osd-backfill-space/datafile 2024-09-16T04:20:10.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj583 td/osd-backfill-space/datafile 2024-09-16T04:20:10.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj583 td/osd-backfill-space/datafile 2024-09-16T04:20:10.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:10.710 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:10.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj584 td/osd-backfill-space/datafile 2024-09-16T04:20:10.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj584 td/osd-backfill-space/datafile 2024-09-16T04:20:10.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj584 td/osd-backfill-space/datafile 2024-09-16T04:20:10.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj584 td/osd-backfill-space/datafile 2024-09-16T04:20:10.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:10.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj584 td/osd-backfill-space/datafile 2024-09-16T04:20:11.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:11.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj584 td/osd-backfill-space/datafile 2024-09-16T04:20:11.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:11.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj584 td/osd-backfill-space/datafile 2024-09-16T04:20:11.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:11.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj584 td/osd-backfill-space/datafile 2024-09-16T04:20:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:11.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj585 td/osd-backfill-space/datafile 2024-09-16T04:20:11.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:11.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj585 td/osd-backfill-space/datafile 2024-09-16T04:20:11.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:11.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj585 td/osd-backfill-space/datafile 2024-09-16T04:20:11.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:11.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj585 td/osd-backfill-space/datafile 2024-09-16T04:20:11.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:11.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj585 td/osd-backfill-space/datafile 2024-09-16T04:20:11.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:11.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj585 td/osd-backfill-space/datafile 2024-09-16T04:20:11.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:11.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj585 td/osd-backfill-space/datafile 2024-09-16T04:20:11.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:11.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj585 td/osd-backfill-space/datafile 2024-09-16T04:20:11.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:11.967 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:11.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:11.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj586 td/osd-backfill-space/datafile 2024-09-16T04:20:12.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj586 td/osd-backfill-space/datafile 2024-09-16T04:20:12.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj586 td/osd-backfill-space/datafile 2024-09-16T04:20:12.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj586 td/osd-backfill-space/datafile 2024-09-16T04:20:12.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj586 td/osd-backfill-space/datafile 2024-09-16T04:20:12.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj586 td/osd-backfill-space/datafile 2024-09-16T04:20:12.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj586 td/osd-backfill-space/datafile 2024-09-16T04:20:12.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj586 td/osd-backfill-space/datafile 2024-09-16T04:20:12.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:12.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:12.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj587 td/osd-backfill-space/datafile 2024-09-16T04:20:12.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj587 td/osd-backfill-space/datafile 2024-09-16T04:20:12.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj587 td/osd-backfill-space/datafile 2024-09-16T04:20:12.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj587 td/osd-backfill-space/datafile 2024-09-16T04:20:12.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj587 td/osd-backfill-space/datafile 2024-09-16T04:20:12.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj587 td/osd-backfill-space/datafile 2024-09-16T04:20:12.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:12.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj587 td/osd-backfill-space/datafile 2024-09-16T04:20:13.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj587 td/osd-backfill-space/datafile 2024-09-16T04:20:13.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:13.113 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:13.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj588 td/osd-backfill-space/datafile 2024-09-16T04:20:13.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj588 td/osd-backfill-space/datafile 2024-09-16T04:20:13.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj588 td/osd-backfill-space/datafile 2024-09-16T04:20:13.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj588 td/osd-backfill-space/datafile 2024-09-16T04:20:13.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj588 td/osd-backfill-space/datafile 2024-09-16T04:20:13.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj588 td/osd-backfill-space/datafile 2024-09-16T04:20:13.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj588 td/osd-backfill-space/datafile 2024-09-16T04:20:13.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj588 td/osd-backfill-space/datafile 2024-09-16T04:20:13.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:13.717 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:13.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj589 td/osd-backfill-space/datafile 2024-09-16T04:20:13.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj589 td/osd-backfill-space/datafile 2024-09-16T04:20:13.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj589 td/osd-backfill-space/datafile 2024-09-16T04:20:13.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:13.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj589 td/osd-backfill-space/datafile 2024-09-16T04:20:14.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj589 td/osd-backfill-space/datafile 2024-09-16T04:20:14.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj589 td/osd-backfill-space/datafile 2024-09-16T04:20:14.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj589 td/osd-backfill-space/datafile 2024-09-16T04:20:14.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj589 td/osd-backfill-space/datafile 2024-09-16T04:20:14.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:14.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:14.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj590 td/osd-backfill-space/datafile 2024-09-16T04:20:14.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj590 td/osd-backfill-space/datafile 2024-09-16T04:20:14.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj590 td/osd-backfill-space/datafile 2024-09-16T04:20:14.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj590 td/osd-backfill-space/datafile 2024-09-16T04:20:14.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj590 td/osd-backfill-space/datafile 2024-09-16T04:20:14.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj590 td/osd-backfill-space/datafile 2024-09-16T04:20:14.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj590 td/osd-backfill-space/datafile 2024-09-16T04:20:14.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj590 td/osd-backfill-space/datafile 2024-09-16T04:20:14.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:14.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:14.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj591 td/osd-backfill-space/datafile 2024-09-16T04:20:14.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:14.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj591 td/osd-backfill-space/datafile 2024-09-16T04:20:15.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj591 td/osd-backfill-space/datafile 2024-09-16T04:20:15.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj591 td/osd-backfill-space/datafile 2024-09-16T04:20:15.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj591 td/osd-backfill-space/datafile 2024-09-16T04:20:15.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj591 td/osd-backfill-space/datafile 2024-09-16T04:20:15.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj591 td/osd-backfill-space/datafile 2024-09-16T04:20:15.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj591 td/osd-backfill-space/datafile 2024-09-16T04:20:15.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:15.416 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:15.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj592 td/osd-backfill-space/datafile 2024-09-16T04:20:15.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj592 td/osd-backfill-space/datafile 2024-09-16T04:20:15.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj592 td/osd-backfill-space/datafile 2024-09-16T04:20:15.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj592 td/osd-backfill-space/datafile 2024-09-16T04:20:15.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj592 td/osd-backfill-space/datafile 2024-09-16T04:20:15.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj592 td/osd-backfill-space/datafile 2024-09-16T04:20:15.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj592 td/osd-backfill-space/datafile 2024-09-16T04:20:15.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:15.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj592 td/osd-backfill-space/datafile 2024-09-16T04:20:16.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:16.028 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:16.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj593 td/osd-backfill-space/datafile 2024-09-16T04:20:16.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj593 td/osd-backfill-space/datafile 2024-09-16T04:20:16.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj593 td/osd-backfill-space/datafile 2024-09-16T04:20:16.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj593 td/osd-backfill-space/datafile 2024-09-16T04:20:16.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj593 td/osd-backfill-space/datafile 2024-09-16T04:20:16.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj593 td/osd-backfill-space/datafile 2024-09-16T04:20:16.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj593 td/osd-backfill-space/datafile 2024-09-16T04:20:16.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj593 td/osd-backfill-space/datafile 2024-09-16T04:20:16.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:16.639 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:16.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj594 td/osd-backfill-space/datafile 2024-09-16T04:20:16.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj594 td/osd-backfill-space/datafile 2024-09-16T04:20:16.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj594 td/osd-backfill-space/datafile 2024-09-16T04:20:16.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj594 td/osd-backfill-space/datafile 2024-09-16T04:20:16.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:16.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj594 td/osd-backfill-space/datafile 2024-09-16T04:20:17.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj594 td/osd-backfill-space/datafile 2024-09-16T04:20:17.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj594 td/osd-backfill-space/datafile 2024-09-16T04:20:17.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj594 td/osd-backfill-space/datafile 2024-09-16T04:20:17.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:17.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:17.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj595 td/osd-backfill-space/datafile 2024-09-16T04:20:17.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj595 td/osd-backfill-space/datafile 2024-09-16T04:20:17.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj595 td/osd-backfill-space/datafile 2024-09-16T04:20:17.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj595 td/osd-backfill-space/datafile 2024-09-16T04:20:17.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj595 td/osd-backfill-space/datafile 2024-09-16T04:20:17.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj595 td/osd-backfill-space/datafile 2024-09-16T04:20:17.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj595 td/osd-backfill-space/datafile 2024-09-16T04:20:17.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj595 td/osd-backfill-space/datafile 2024-09-16T04:20:17.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:17.861 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:17.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj596 td/osd-backfill-space/datafile 2024-09-16T04:20:17.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:17.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj596 td/osd-backfill-space/datafile 2024-09-16T04:20:18.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj596 td/osd-backfill-space/datafile 2024-09-16T04:20:18.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj596 td/osd-backfill-space/datafile 2024-09-16T04:20:18.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj596 td/osd-backfill-space/datafile 2024-09-16T04:20:18.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj596 td/osd-backfill-space/datafile 2024-09-16T04:20:18.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj596 td/osd-backfill-space/datafile 2024-09-16T04:20:18.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj596 td/osd-backfill-space/datafile 2024-09-16T04:20:18.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:18.430 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:18.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj597 td/osd-backfill-space/datafile 2024-09-16T04:20:18.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj597 td/osd-backfill-space/datafile 2024-09-16T04:20:18.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj597 td/osd-backfill-space/datafile 2024-09-16T04:20:18.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj597 td/osd-backfill-space/datafile 2024-09-16T04:20:18.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj597 td/osd-backfill-space/datafile 2024-09-16T04:20:18.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj597 td/osd-backfill-space/datafile 2024-09-16T04:20:18.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj597 td/osd-backfill-space/datafile 2024-09-16T04:20:18.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:18.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj597 td/osd-backfill-space/datafile 2024-09-16T04:20:18.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:18.999 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:19.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj598 td/osd-backfill-space/datafile 2024-09-16T04:20:19.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj598 td/osd-backfill-space/datafile 2024-09-16T04:20:19.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj598 td/osd-backfill-space/datafile 2024-09-16T04:20:19.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj598 td/osd-backfill-space/datafile 2024-09-16T04:20:19.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj598 td/osd-backfill-space/datafile 2024-09-16T04:20:19.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj598 td/osd-backfill-space/datafile 2024-09-16T04:20:19.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj598 td/osd-backfill-space/datafile 2024-09-16T04:20:19.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj598 td/osd-backfill-space/datafile 2024-09-16T04:20:19.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:19.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:19.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj599 td/osd-backfill-space/datafile 2024-09-16T04:20:19.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj599 td/osd-backfill-space/datafile 2024-09-16T04:20:19.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj599 td/osd-backfill-space/datafile 2024-09-16T04:20:19.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj599 td/osd-backfill-space/datafile 2024-09-16T04:20:19.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj599 td/osd-backfill-space/datafile 2024-09-16T04:20:19.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:19.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj599 td/osd-backfill-space/datafile 2024-09-16T04:20:20.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:20.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj599 td/osd-backfill-space/datafile 2024-09-16T04:20:20.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:20.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj599 td/osd-backfill-space/datafile 2024-09-16T04:20:20.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:216: TEST_backfill_test_multi: for o in $(seq 1 $objects) 2024-09-16T04:20:20.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:20.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:20.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test1 put obj600 td/osd-backfill-space/datafile 2024-09-16T04:20:20.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:20.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test2 put obj600 td/osd-backfill-space/datafile 2024-09-16T04:20:20.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:20.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test3 put obj600 td/osd-backfill-space/datafile 2024-09-16T04:20:20.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:20.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test4 put obj600 td/osd-backfill-space/datafile 2024-09-16T04:20:20.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:20.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test5 put obj600 td/osd-backfill-space/datafile 2024-09-16T04:20:20.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:20.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test6 put obj600 td/osd-backfill-space/datafile 2024-09-16T04:20:20.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:20.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test7 put obj600 td/osd-backfill-space/datafile 2024-09-16T04:20:20.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:218: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:20.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:220: TEST_backfill_test_multi: rados -p test8 put obj600 td/osd-backfill-space/datafile 2024-09-16T04:20:20.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:224: TEST_backfill_test_multi: ceph pg dump pgs 2024-09-16T04:20:21.200 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:20:21.200 INFO:tasks.workunit.client.0.smithi026.stdout:8.0 593 0 0 0 0 2428928 0 0 93 500 93 active+clean 2024-09-16T04:13:54.289052+0000 144'593 144:611 [3] 3 [3] 3 0'0 2024-09-16T04:13:51.564753+0000 0'0 2024-09-16T04:13:51.564753+0000 0 0 periodic scrub scheduled @ 2024-09-17T13:04:15.227801+0000 0 0 2024-09-16T04:20:21.200 INFO:tasks.workunit.client.0.smithi026.stdout:7.0 594 0 0 0 0 2433024 0 0 94 500 94 active+clean 2024-09-16T04:13:51.802416+0000 144'594 144:627 [5] 5 [5] 5 0'0 2024-09-16T04:13:48.124827+0000 0'0 2024-09-16T04:13:48.124827+0000 0 0 periodic scrub scheduled @ 2024-09-17T13:55:29.897030+0000 0 0 2024-09-16T04:20:21.200 INFO:tasks.workunit.client.0.smithi026.stdout:6.0 597 0 0 0 0 2445312 0 0 97 500 97 active+clean 2024-09-16T04:13:48.293520+0000 144'597 144:634 [7] 7 [7] 7 0'0 2024-09-16T04:13:45.036944+0000 0'0 2024-09-16T04:13:45.036944+0000 0 0 periodic scrub scheduled @ 2024-09-17T15:11:13.300241+0000 0 0 2024-09-16T04:20:21.200 INFO:tasks.workunit.client.0.smithi026.stdout:5.0 599 0 0 0 0 2453504 0 0 99 500 99 active+clean 2024-09-16T04:13:46.341702+0000 144'599 144:646 [12] 12 [12] 12 0'0 2024-09-16T04:13:41.886318+0000 0'0 2024-09-16T04:13:41.886318+0000 0 0 periodic scrub scheduled @ 2024-09-17T10:34:16.151933+0000 0 0 2024-09-16T04:20:21.200 INFO:tasks.workunit.client.0.smithi026.stdout:4.0 594 0 0 0 0 2433024 0 0 94 500 94 active+clean 2024-09-16T04:13:42.012757+0000 144'594 144:646 [4] 4 [4] 4 0'0 2024-09-16T04:13:38.503922+0000 0'0 2024-09-16T04:13:38.503922+0000 0 0 periodic scrub scheduled @ 2024-09-17T12:49:11.107772+0000 0 0 2024-09-16T04:20:21.200 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 599 0 0 0 0 2453504 0 0 99 500 99 active+clean 2024-09-16T04:13:38.393994+0000 144'599 144:663 [1] 1 [1] 1 0'0 2024-09-16T04:13:35.287943+0000 0'0 2024-09-16T04:13:35.287943+0000 0 0 periodic scrub scheduled @ 2024-09-17T11:50:28.038202+0000 0 0 2024-09-16T04:20:21.200 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 595 0 0 0 0 2437120 0 0 95 500 95 active+clean 2024-09-16T04:13:35.391688+0000 144'595 144:664 [17] 17 [17] 17 0'0 2024-09-16T04:13:32.186500+0000 0'0 2024-09-16T04:13:32.186500+0000 0 0 periodic scrub scheduled @ 2024-09-17T09:55:32.788884+0000 0 0 2024-09-16T04:20:21.200 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 597 0 0 0 0 2445312 0 0 97 500 97 active+clean 2024-09-16T04:13:31.843754+0000 144'597 144:681 [8] 8 [8] 8 0'0 2024-09-16T04:13:28.581849+0000 0'0 2024-09-16T04:13:28.581849+0000 0 0 periodic scrub scheduled @ 2024-09-17T12:21:00.867695+0000 0 0 2024-09-16T04:20:21.201 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:20:21.201 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:20:21.201 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:20:21.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:20:21.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:21.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test1 size 2 2024-09-16T04:20:22.577 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 2 2024-09-16T04:20:22.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:22.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test2 size 2 2024-09-16T04:20:23.972 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 2 size to 2 2024-09-16T04:20:23.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:23.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test3 size 2 2024-09-16T04:20:25.886 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 3 size to 2 2024-09-16T04:20:25.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:25.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test4 size 2 2024-09-16T04:20:27.900 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 4 size to 2 2024-09-16T04:20:27.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:27.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test5 size 2 2024-09-16T04:20:30.263 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 5 size to 2 2024-09-16T04:20:30.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:30.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test6 size 2 2024-09-16T04:20:32.686 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 6 size to 2 2024-09-16T04:20:32.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:32.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test7 size 2 2024-09-16T04:20:34.582 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 7 size to 2 2024-09-16T04:20:34.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:226: TEST_backfill_test_multi: for p in $(seq 1 $pools) 2024-09-16T04:20:34.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:228: TEST_backfill_test_multi: ceph osd pool set test8 size 2 2024-09-16T04:20:36.936 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 8 size to 2 2024-09-16T04:20:36.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:230: TEST_backfill_test_multi: sleep 30 2024-09-16T04:21:06.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:232: TEST_backfill_test_multi: wait_for_not_backfilling 1200 2024-09-16T04:21:06.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:83: wait_for_not_backfilling: local timeout=1200 2024-09-16T04:21:06.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:84: wait_for_not_backfilling: wait_for_not_state backfilling 1200 2024-09-16T04:21:06.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=backfilling 2024-09-16T04:21:06.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-09-16T04:21:06.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-09-16T04:21:06.955 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 1200 5 2024-09-16T04:21:06.955 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:21:06.955 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:21:06.955 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:21:06.955 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:21:06.956 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:21:07.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15') 2024-09-16T04:21:07.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-09-16T04:21:07.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-09-16T04:21:07.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-09-16T04:21:07.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:21:07.559 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:21:08.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:21:08.209 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:21:08.209 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:21:08.209 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:21:08.209 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T04:21:08.209 INFO:tasks.workunit.client.0.smithi026.stderr:5 2024-09-16T04:21:08.209 INFO:tasks.workunit.client.0.smithi026.stderr:6 2024-09-16T04:21:08.209 INFO:tasks.workunit.client.0.smithi026.stderr:7 2024-09-16T04:21:08.209 INFO:tasks.workunit.client.0.smithi026.stderr:8 2024-09-16T04:21:08.209 INFO:tasks.workunit.client.0.smithi026.stderr:9 2024-09-16T04:21:08.209 INFO:tasks.workunit.client.0.smithi026.stderr:10 2024-09-16T04:21:08.210 INFO:tasks.workunit.client.0.smithi026.stderr:11 2024-09-16T04:21:08.210 INFO:tasks.workunit.client.0.smithi026.stderr:12 2024-09-16T04:21:08.210 INFO:tasks.workunit.client.0.smithi026.stderr:13 2024-09-16T04:21:08.210 INFO:tasks.workunit.client.0.smithi026.stderr:14 2024-09-16T04:21:08.210 INFO:tasks.workunit.client.0.smithi026.stderr:15 2024-09-16T04:21:08.210 INFO:tasks.workunit.client.0.smithi026.stderr:16 2024-09-16T04:21:08.210 INFO:tasks.workunit.client.0.smithi026.stderr:17 2024-09-16T04:21:08.210 INFO:tasks.workunit.client.0.smithi026.stderr:18 2024-09-16T04:21:08.210 INFO:tasks.workunit.client.0.smithi026.stderr:19' 2024-09-16T04:21:08.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:21:08.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:08.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:21:08.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836717 2024-09-16T04:21:08.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836717 2024-09-16T04:21:08.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717' 2024-09-16T04:21:08.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:08.490 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:21:08.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673190 2024-09-16T04:21:08.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673190 2024-09-16T04:21:08.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190' 2024-09-16T04:21:08.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:08.614 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:21:08.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509668 2024-09-16T04:21:08.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509668 2024-09-16T04:21:08.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668' 2024-09-16T04:21:08.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:08.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:21:09.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899346136 2024-09-16T04:21:09.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899346136 2024-09-16T04:21:09.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136' 2024-09-16T04:21:09.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:09.092 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:21:09.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182608 2024-09-16T04:21:09.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182608 2024-09-16T04:21:09.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608' 2024-09-16T04:21:09.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:09.215 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T04:21:09.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849019081 2024-09-16T04:21:09.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849019081 2024-09-16T04:21:09.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081' 2024-09-16T04:21:09.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:09.339 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2024-09-16T04:21:09.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=150323855558 2024-09-16T04:21:09.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 150323855558 2024-09-16T04:21:09.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558' 2024-09-16T04:21:09.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:09.464 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2024-09-16T04:21:09.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=171798692027 2024-09-16T04:21:09.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 171798692027 2024-09-16T04:21:09.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027' 2024-09-16T04:21:09.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:09.588 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2024-09-16T04:21:09.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=193273528504 2024-09-16T04:21:09.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 193273528504 2024-09-16T04:21:09.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027 8-193273528504' 2024-09-16T04:21:09.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:09.782 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2024-09-16T04:21:09.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=214748364976 2024-09-16T04:21:09.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 214748364976 2024-09-16T04:21:09.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027 8-193273528504 9-214748364976' 2024-09-16T04:21:09.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:09.909 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2024-09-16T04:21:10.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=236223201445 2024-09-16T04:21:10.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 236223201445 2024-09-16T04:21:10.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027 8-193273528504 9-214748364976 10-236223201445' 2024-09-16T04:21:10.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:10.035 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.11 flush_pg_stats 2024-09-16T04:21:10.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=257698037920 2024-09-16T04:21:10.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 257698037920 2024-09-16T04:21:10.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027 8-193273528504 9-214748364976 10-236223201445 11-257698037920' 2024-09-16T04:21:10.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:10.159 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.12 flush_pg_stats 2024-09-16T04:21:10.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=279172874392 2024-09-16T04:21:10.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 279172874392 2024-09-16T04:21:10.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027 8-193273528504 9-214748364976 10-236223201445 11-257698037920 12-279172874392' 2024-09-16T04:21:10.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:10.285 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.13 flush_pg_stats 2024-09-16T04:21:10.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=300647710864 2024-09-16T04:21:10.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 300647710864 2024-09-16T04:21:10.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027 8-193273528504 9-214748364976 10-236223201445 11-257698037920 12-279172874392 13-300647710864' 2024-09-16T04:21:10.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:10.411 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.14 flush_pg_stats 2024-09-16T04:21:10.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=322122547338 2024-09-16T04:21:10.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 322122547338 2024-09-16T04:21:10.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027 8-193273528504 9-214748364976 10-236223201445 11-257698037920 12-279172874392 13-300647710864 14-322122547338' 2024-09-16T04:21:10.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:10.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.15 flush_pg_stats 2024-09-16T04:21:10.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=343597383812 2024-09-16T04:21:10.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 343597383812 2024-09-16T04:21:10.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027 8-193273528504 9-214748364976 10-236223201445 11-257698037920 12-279172874392 13-300647710864 14-322122547338 15-343597383812' 2024-09-16T04:21:10.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:10.659 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.16 flush_pg_stats 2024-09-16T04:21:10.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=365072220282 2024-09-16T04:21:10.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 365072220282 2024-09-16T04:21:10.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027 8-193273528504 9-214748364976 10-236223201445 11-257698037920 12-279172874392 13-300647710864 14-322122547338 15-343597383812 16-365072220282' 2024-09-16T04:21:10.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:10.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.17 flush_pg_stats 2024-09-16T04:21:11.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=386547056755 2024-09-16T04:21:11.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 386547056755 2024-09-16T04:21:11.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027 8-193273528504 9-214748364976 10-236223201445 11-257698037920 12-279172874392 13-300647710864 14-322122547338 15-343597383812 16-365072220282 17-386547056755' 2024-09-16T04:21:11.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:11.067 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.18 flush_pg_stats 2024-09-16T04:21:11.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=408021893230 2024-09-16T04:21:11.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 408021893230 2024-09-16T04:21:11.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027 8-193273528504 9-214748364976 10-236223201445 11-257698037920 12-279172874392 13-300647710864 14-322122547338 15-343597383812 16-365072220282 17-386547056755 18-408021893230' 2024-09-16T04:21:11.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:21:11.192 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.19 flush_pg_stats 2024-09-16T04:21:11.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=429496729701 2024-09-16T04:21:11.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 429496729701 2024-09-16T04:21:11.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836717 1-42949673190 2-64424509668 3-85899346136 4-107374182608 5-128849019081 6-150323855558 7-171798692027 8-193273528504 9-214748364976 10-236223201445 11-257698037920 12-279172874392 13-300647710864 14-322122547338 15-343597383812 16-365072220282 17-386547056755 18-408021893230 19-429496729701' 2024-09-16T04:21:11.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:11.320 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836717 2024-09-16T04:21:11.320 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:11.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:21:11.321 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836717 2024-09-16T04:21:11.321 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:11.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836717 2024-09-16T04:21:11.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836717' 2024-09-16T04:21:11.323 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836717 2024-09-16T04:21:11.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:21:11.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836717 -lt 21474836717 2024-09-16T04:21:11.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:11.893 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673190 2024-09-16T04:21:11.893 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:11.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:21:11.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673190 2024-09-16T04:21:11.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:11.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673190 2024-09-16T04:21:11.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673190' 2024-09-16T04:21:11.896 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673190 2024-09-16T04:21:11.896 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:21:12.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673191 -lt 42949673190 2024-09-16T04:21:12.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:12.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509668 2024-09-16T04:21:12.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:12.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:21:12.465 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509668 2024-09-16T04:21:12.465 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:12.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509668 2024-09-16T04:21:12.466 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509668 2024-09-16T04:21:12.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509668' 2024-09-16T04:21:12.467 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:21:13.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509669 -lt 64424509668 2024-09-16T04:21:13.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:13.059 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899346136 2024-09-16T04:21:13.059 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:13.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:21:13.060 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899346136 2024-09-16T04:21:13.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:13.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899346136 2024-09-16T04:21:13.062 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899346136 2024-09-16T04:21:13.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899346136' 2024-09-16T04:21:13.062 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:21:13.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899346137 -lt 85899346136 2024-09-16T04:21:13.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:13.713 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182608 2024-09-16T04:21:13.713 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:13.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:21:13.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182608 2024-09-16T04:21:13.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:13.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182608 2024-09-16T04:21:13.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182608' 2024-09-16T04:21:13.716 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182608 2024-09-16T04:21:13.716 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:21:14.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182609 -lt 107374182608 2024-09-16T04:21:14.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:14.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849019081 2024-09-16T04:21:14.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:14.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T04:21:14.278 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849019081 2024-09-16T04:21:14.278 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:14.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849019081 2024-09-16T04:21:14.280 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849019081 2024-09-16T04:21:14.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849019081' 2024-09-16T04:21:14.280 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T04:21:14.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849019081 -lt 128849019081 2024-09-16T04:21:14.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:14.713 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 6-150323855558 2024-09-16T04:21:14.713 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:14.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=6 2024-09-16T04:21:14.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 6-150323855558 2024-09-16T04:21:14.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:14.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=150323855558 2024-09-16T04:21:14.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.6 seq 150323855558' 2024-09-16T04:21:14.716 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.6 seq 150323855558 2024-09-16T04:21:14.717 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 6 2024-09-16T04:21:15.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 150323855559 -lt 150323855558 2024-09-16T04:21:15.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:15.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 7-171798692027 2024-09-16T04:21:15.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:15.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=7 2024-09-16T04:21:15.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 7-171798692027 2024-09-16T04:21:15.383 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:15.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=171798692027 2024-09-16T04:21:15.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.7 seq 171798692027' 2024-09-16T04:21:15.384 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.7 seq 171798692027 2024-09-16T04:21:15.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 7 2024-09-16T04:21:15.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 171798692028 -lt 171798692027 2024-09-16T04:21:15.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:15.883 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 8-193273528504 2024-09-16T04:21:15.883 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:15.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=8 2024-09-16T04:21:15.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 8-193273528504 2024-09-16T04:21:15.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:15.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=193273528504 2024-09-16T04:21:15.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.8 seq 193273528504' 2024-09-16T04:21:15.886 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.8 seq 193273528504 2024-09-16T04:21:15.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 8 2024-09-16T04:21:16.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 193273528505 -lt 193273528504 2024-09-16T04:21:16.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:16.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 9-214748364976 2024-09-16T04:21:16.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:16.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=9 2024-09-16T04:21:16.557 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 9-214748364976 2024-09-16T04:21:16.557 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:16.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=214748364976 2024-09-16T04:21:16.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.9 seq 214748364976' 2024-09-16T04:21:16.559 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.9 seq 214748364976 2024-09-16T04:21:16.559 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 9 2024-09-16T04:21:17.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 214748364977 -lt 214748364976 2024-09-16T04:21:17.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:17.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 10-236223201445 2024-09-16T04:21:17.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:17.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=10 2024-09-16T04:21:17.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 10-236223201445 2024-09-16T04:21:17.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:17.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=236223201445 2024-09-16T04:21:17.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.10 seq 236223201445' 2024-09-16T04:21:17.224 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.10 seq 236223201445 2024-09-16T04:21:17.224 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 10 2024-09-16T04:21:17.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 236223201447 -lt 236223201445 2024-09-16T04:21:17.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:17.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 11-257698037920 2024-09-16T04:21:17.676 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:17.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=11 2024-09-16T04:21:17.677 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 11-257698037920 2024-09-16T04:21:17.677 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:17.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=257698037920 2024-09-16T04:21:17.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.11 seq 257698037920' 2024-09-16T04:21:17.678 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.11 seq 257698037920 2024-09-16T04:21:17.679 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 11 2024-09-16T04:21:18.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 257698037921 -lt 257698037920 2024-09-16T04:21:18.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:18.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 12-279172874392 2024-09-16T04:21:18.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:18.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=12 2024-09-16T04:21:18.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 12-279172874392 2024-09-16T04:21:18.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:18.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=279172874392 2024-09-16T04:21:18.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.12 seq 279172874392' 2024-09-16T04:21:18.278 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.12 seq 279172874392 2024-09-16T04:21:18.279 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 12 2024-09-16T04:21:18.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 279172874393 -lt 279172874392 2024-09-16T04:21:18.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:18.936 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 13-300647710864 2024-09-16T04:21:18.936 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:18.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=13 2024-09-16T04:21:18.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 13-300647710864 2024-09-16T04:21:18.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:18.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=300647710864 2024-09-16T04:21:18.939 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.13 seq 300647710864 2024-09-16T04:21:18.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.13 seq 300647710864' 2024-09-16T04:21:18.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 13 2024-09-16T04:21:19.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 300647710866 -lt 300647710864 2024-09-16T04:21:19.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:19.617 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 14-322122547338 2024-09-16T04:21:19.617 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:19.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=14 2024-09-16T04:21:19.619 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 14-322122547338 2024-09-16T04:21:19.619 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:19.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=322122547338 2024-09-16T04:21:19.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.14 seq 322122547338' 2024-09-16T04:21:19.620 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.14 seq 322122547338 2024-09-16T04:21:19.620 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 14 2024-09-16T04:21:20.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 322122547340 -lt 322122547338 2024-09-16T04:21:20.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:20.189 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 15-343597383812 2024-09-16T04:21:20.189 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:20.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=15 2024-09-16T04:21:20.190 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 15-343597383812 2024-09-16T04:21:20.190 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:20.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=343597383812 2024-09-16T04:21:20.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.15 seq 343597383812' 2024-09-16T04:21:20.192 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.15 seq 343597383812 2024-09-16T04:21:20.192 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 15 2024-09-16T04:21:20.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 343597383814 -lt 343597383812 2024-09-16T04:21:20.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:20.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 16-365072220282 2024-09-16T04:21:20.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:20.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=16 2024-09-16T04:21:20.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 16-365072220282 2024-09-16T04:21:20.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:20.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=365072220282 2024-09-16T04:21:20.635 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.16 seq 365072220282 2024-09-16T04:21:20.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.16 seq 365072220282' 2024-09-16T04:21:20.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 16 2024-09-16T04:21:21.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 365072220284 -lt 365072220282 2024-09-16T04:21:21.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:21.273 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 17-386547056755 2024-09-16T04:21:21.273 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:21.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=17 2024-09-16T04:21:21.274 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 17-386547056755 2024-09-16T04:21:21.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:21.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=386547056755 2024-09-16T04:21:21.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.17 seq 386547056755' 2024-09-16T04:21:21.276 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.17 seq 386547056755 2024-09-16T04:21:21.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 17 2024-09-16T04:21:21.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 386547056757 -lt 386547056755 2024-09-16T04:21:21.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:21.736 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 18-408021893230 2024-09-16T04:21:21.736 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:21.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=18 2024-09-16T04:21:21.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 18-408021893230 2024-09-16T04:21:21.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:21.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=408021893230 2024-09-16T04:21:21.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.18 seq 408021893230' 2024-09-16T04:21:21.739 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.18 seq 408021893230 2024-09-16T04:21:21.739 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 18 2024-09-16T04:21:22.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 408021893232 -lt 408021893230 2024-09-16T04:21:22.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:21:22.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 19-429496729701 2024-09-16T04:21:22.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:21:22.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=19 2024-09-16T04:21:22.331 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 19-429496729701 2024-09-16T04:21:22.332 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:21:22.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=429496729701 2024-09-16T04:21:22.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.19 seq 429496729701' 2024-09-16T04:21:22.333 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.19 seq 429496729701 2024-09-16T04:21:22.333 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 19 2024-09-16T04:21:22.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 429496729703 -lt 429496729701 2024-09-16T04:21:22.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-09-16T04:21:22.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:21:22.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:21:23.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 8 == 0 2024-09-16T04:21:23.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:21:23.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:21:23.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:21:23.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:21:23.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:21:23.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:21:23.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:21:23.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=4 2024-09-16T04:21:23.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 4 = 0 2024-09-16T04:21:23.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 4 '!=' -1 2024-09-16T04:21:23.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:69: wait_for_not_state: loop=0 2024-09-16T04:21:23.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:70: wait_for_not_state: num_in_state=4 2024-09-16T04:21:23.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 5 2024-09-16T04:21:28.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-09-16T04:21:28.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:21:28.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:21:28.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:21:28.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:21:28.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:21:28.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:21:28.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:21:29.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=4 2024-09-16T04:21:29.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 4 = 0 2024-09-16T04:21:29.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 4 '!=' 4 2024-09-16T04:21:29.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:71: wait_for_not_state: (( 1 >= 81 )) 2024-09-16T04:21:29.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 10 2024-09-16T04:21:39.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-09-16T04:21:39.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:21:39.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:21:39.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:21:39.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:21:39.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:21:39.337 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:21:39.337 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:21:39.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=4 2024-09-16T04:21:39.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 4 = 0 2024-09-16T04:21:39.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 4 '!=' 4 2024-09-16T04:21:39.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:71: wait_for_not_state: (( 2 >= 81 )) 2024-09-16T04:21:39.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 15 2024-09-16T04:21:54.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-09-16T04:21:54.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:21:54.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:21:54.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:21:54.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:21:54.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:21:54.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:21:54.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:21:55.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=4 2024-09-16T04:21:55.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 4 = 0 2024-09-16T04:21:55.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 4 '!=' 4 2024-09-16T04:21:55.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:71: wait_for_not_state: (( 3 >= 81 )) 2024-09-16T04:21:55.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 15 2024-09-16T04:22:10.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-09-16T04:22:10.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:22:10.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:22:10.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:22:10.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:22:10.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:22:10.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:22:10.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:22:10.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=1 2024-09-16T04:22:10.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 1 = 0 2024-09-16T04:22:10.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 1 '!=' 4 2024-09-16T04:22:10.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:69: wait_for_not_state: loop=0 2024-09-16T04:22:10.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:70: wait_for_not_state: num_in_state=1 2024-09-16T04:22:10.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 5 2024-09-16T04:22:15.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-09-16T04:22:15.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:22:15.619 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:22:15.619 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:22:15.619 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:22:15.620 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:22:15.620 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:22:15.620 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:22:16.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-09-16T04:22:16.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-09-16T04:22:16.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-09-16T04:22:16.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-09-16T04:22:16.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:233: TEST_backfill_test_multi: wait_for_not_activating 60 2024-09-16T04:22:16.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:89: wait_for_not_activating: local timeout=60 2024-09-16T04:22:16.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:90: wait_for_not_activating: wait_for_not_state activating 60 2024-09-16T04:22:16.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=activating 2024-09-16T04:22:16.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-09-16T04:22:16.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-09-16T04:22:16.035 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 60 5 2024-09-16T04:22:16.035 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:22:16.035 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:22:16.035 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:22:16.035 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:22:16.035 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:22:16.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15') 2024-09-16T04:22:16.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-09-16T04:22:16.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-09-16T04:22:16.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-09-16T04:22:16.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:22:16.075 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:22:16.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:22:16.491 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:22:16.491 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:22:16.491 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:22:16.491 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T04:22:16.491 INFO:tasks.workunit.client.0.smithi026.stderr:5 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:6 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:7 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:8 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:9 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:10 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:11 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:12 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:13 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:14 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:15 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:16 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:17 2024-09-16T04:22:16.492 INFO:tasks.workunit.client.0.smithi026.stderr:18 2024-09-16T04:22:16.493 INFO:tasks.workunit.client.0.smithi026.stderr:19' 2024-09-16T04:22:16.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:22:16.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:16.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:22:16.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836733 2024-09-16T04:22:16.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836733 2024-09-16T04:22:16.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733' 2024-09-16T04:22:16.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:16.615 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:22:16.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673206 2024-09-16T04:22:16.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673206 2024-09-16T04:22:16.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206' 2024-09-16T04:22:16.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:16.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:22:16.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509684 2024-09-16T04:22:16.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509684 2024-09-16T04:22:16.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684' 2024-09-16T04:22:16.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:16.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:22:17.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899346152 2024-09-16T04:22:17.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899346152 2024-09-16T04:22:17.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152' 2024-09-16T04:22:17.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:17.004 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:22:17.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182623 2024-09-16T04:22:17.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182623 2024-09-16T04:22:17.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623' 2024-09-16T04:22:17.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:17.129 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T04:22:17.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849019096 2024-09-16T04:22:17.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849019096 2024-09-16T04:22:17.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096' 2024-09-16T04:22:17.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:17.251 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.6 flush_pg_stats 2024-09-16T04:22:17.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=150323855573 2024-09-16T04:22:17.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 150323855573 2024-09-16T04:22:17.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573' 2024-09-16T04:22:17.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:17.374 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.7 flush_pg_stats 2024-09-16T04:22:17.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=171798692042 2024-09-16T04:22:17.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 171798692042 2024-09-16T04:22:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042' 2024-09-16T04:22:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:17.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.8 flush_pg_stats 2024-09-16T04:22:17.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=193273528519 2024-09-16T04:22:17.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 193273528519 2024-09-16T04:22:17.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042 8-193273528519' 2024-09-16T04:22:17.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:17.627 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.9 flush_pg_stats 2024-09-16T04:22:17.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=214748364992 2024-09-16T04:22:17.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 214748364992 2024-09-16T04:22:17.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042 8-193273528519 9-214748364992' 2024-09-16T04:22:17.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:17.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.10 flush_pg_stats 2024-09-16T04:22:17.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=236223201461 2024-09-16T04:22:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 236223201461 2024-09-16T04:22:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042 8-193273528519 9-214748364992 10-236223201461' 2024-09-16T04:22:17.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:17.880 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.11 flush_pg_stats 2024-09-16T04:22:18.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=257698037935 2024-09-16T04:22:18.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 257698037935 2024-09-16T04:22:18.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042 8-193273528519 9-214748364992 10-236223201461 11-257698037935' 2024-09-16T04:22:18.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:18.003 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.12 flush_pg_stats 2024-09-16T04:22:18.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=279172874407 2024-09-16T04:22:18.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 279172874407 2024-09-16T04:22:18.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042 8-193273528519 9-214748364992 10-236223201461 11-257698037935 12-279172874407' 2024-09-16T04:22:18.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:18.127 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.13 flush_pg_stats 2024-09-16T04:22:18.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=300647710880 2024-09-16T04:22:18.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 300647710880 2024-09-16T04:22:18.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042 8-193273528519 9-214748364992 10-236223201461 11-257698037935 12-279172874407 13-300647710880' 2024-09-16T04:22:18.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:18.250 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.14 flush_pg_stats 2024-09-16T04:22:18.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=322122547354 2024-09-16T04:22:18.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 322122547354 2024-09-16T04:22:18.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042 8-193273528519 9-214748364992 10-236223201461 11-257698037935 12-279172874407 13-300647710880 14-322122547354' 2024-09-16T04:22:18.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:18.374 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.15 flush_pg_stats 2024-09-16T04:22:18.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=343597383827 2024-09-16T04:22:18.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 343597383827 2024-09-16T04:22:18.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042 8-193273528519 9-214748364992 10-236223201461 11-257698037935 12-279172874407 13-300647710880 14-322122547354 15-343597383827' 2024-09-16T04:22:18.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:18.497 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.16 flush_pg_stats 2024-09-16T04:22:18.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=365072220297 2024-09-16T04:22:18.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 365072220297 2024-09-16T04:22:18.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042 8-193273528519 9-214748364992 10-236223201461 11-257698037935 12-279172874407 13-300647710880 14-322122547354 15-343597383827 16-365072220297' 2024-09-16T04:22:18.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:18.621 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.17 flush_pg_stats 2024-09-16T04:22:18.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=386547056771 2024-09-16T04:22:18.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 386547056771 2024-09-16T04:22:18.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042 8-193273528519 9-214748364992 10-236223201461 11-257698037935 12-279172874407 13-300647710880 14-322122547354 15-343597383827 16-365072220297 17-386547056771' 2024-09-16T04:22:18.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:18.809 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.18 flush_pg_stats 2024-09-16T04:22:18.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=408021893245 2024-09-16T04:22:18.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 408021893245 2024-09-16T04:22:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042 8-193273528519 9-214748364992 10-236223201461 11-257698037935 12-279172874407 13-300647710880 14-322122547354 15-343597383827 16-365072220297 17-386547056771 18-408021893245' 2024-09-16T04:22:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:22:18.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.19 flush_pg_stats 2024-09-16T04:22:19.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=429496729717 2024-09-16T04:22:19.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 429496729717 2024-09-16T04:22:19.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836733 1-42949673206 2-64424509684 3-85899346152 4-107374182623 5-128849019096 6-150323855573 7-171798692042 8-193273528519 9-214748364992 10-236223201461 11-257698037935 12-279172874407 13-300647710880 14-322122547354 15-343597383827 16-365072220297 17-386547056771 18-408021893245 19-429496729717' 2024-09-16T04:22:19.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:19.056 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836733 2024-09-16T04:22:19.056 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:19.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:22:19.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836733 2024-09-16T04:22:19.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:19.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836733 2024-09-16T04:22:19.059 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836733 2024-09-16T04:22:19.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836733' 2024-09-16T04:22:19.059 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:22:19.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836733 -lt 21474836733 2024-09-16T04:22:19.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:19.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673206 2024-09-16T04:22:19.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:19.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:22:19.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673206 2024-09-16T04:22:19.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:19.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673206 2024-09-16T04:22:19.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673206' 2024-09-16T04:22:19.506 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673206 2024-09-16T04:22:19.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:22:19.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673206 -lt 42949673206 2024-09-16T04:22:19.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:19.963 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509684 2024-09-16T04:22:19.963 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:19.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:22:19.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509684 2024-09-16T04:22:19.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:19.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509684 2024-09-16T04:22:19.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509684' 2024-09-16T04:22:19.966 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509684 2024-09-16T04:22:19.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:22:20.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509684 -lt 64424509684 2024-09-16T04:22:20.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:20.414 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899346152 2024-09-16T04:22:20.414 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:20.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:22:20.416 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899346152 2024-09-16T04:22:20.416 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:20.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899346152 2024-09-16T04:22:20.417 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899346152 2024-09-16T04:22:20.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899346152' 2024-09-16T04:22:20.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:22:20.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899346152 -lt 85899346152 2024-09-16T04:22:20.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:20.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182623 2024-09-16T04:22:20.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:20.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:22:20.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182623 2024-09-16T04:22:20.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:20.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182623 2024-09-16T04:22:20.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182623' 2024-09-16T04:22:20.878 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182623 2024-09-16T04:22:20.879 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:22:21.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182624 -lt 107374182623 2024-09-16T04:22:21.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:21.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849019096 2024-09-16T04:22:21.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:21.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T04:22:21.378 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849019096 2024-09-16T04:22:21.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:21.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849019096 2024-09-16T04:22:21.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849019096' 2024-09-16T04:22:21.380 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849019096 2024-09-16T04:22:21.380 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T04:22:21.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849019097 -lt 128849019096 2024-09-16T04:22:21.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:21.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 6-150323855573 2024-09-16T04:22:21.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:21.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=6 2024-09-16T04:22:21.841 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 6-150323855573 2024-09-16T04:22:21.841 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:21.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=150323855573 2024-09-16T04:22:21.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.6 seq 150323855573' 2024-09-16T04:22:21.841 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.6 seq 150323855573 2024-09-16T04:22:21.841 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 6 2024-09-16T04:22:22.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 150323855574 -lt 150323855573 2024-09-16T04:22:22.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:22.331 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 7-171798692042 2024-09-16T04:22:22.331 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:22.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=7 2024-09-16T04:22:22.333 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 7-171798692042 2024-09-16T04:22:22.333 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:22.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=171798692042 2024-09-16T04:22:22.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.7 seq 171798692042' 2024-09-16T04:22:22.334 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.7 seq 171798692042 2024-09-16T04:22:22.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 7 2024-09-16T04:22:22.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 171798692043 -lt 171798692042 2024-09-16T04:22:22.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:22.808 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 8-193273528519 2024-09-16T04:22:22.808 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:22.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=8 2024-09-16T04:22:22.810 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 8-193273528519 2024-09-16T04:22:22.810 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:22.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=193273528519 2024-09-16T04:22:22.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.8 seq 193273528519' 2024-09-16T04:22:22.811 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.8 seq 193273528519 2024-09-16T04:22:22.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 8 2024-09-16T04:22:23.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 193273528520 -lt 193273528519 2024-09-16T04:22:23.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:23.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 9-214748364992 2024-09-16T04:22:23.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:23.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=9 2024-09-16T04:22:23.280 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 9-214748364992 2024-09-16T04:22:23.280 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:23.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=214748364992 2024-09-16T04:22:23.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.9 seq 214748364992' 2024-09-16T04:22:23.281 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.9 seq 214748364992 2024-09-16T04:22:23.281 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 9 2024-09-16T04:22:23.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 214748364993 -lt 214748364992 2024-09-16T04:22:23.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:23.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 10-236223201461 2024-09-16T04:22:23.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:23.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=10 2024-09-16T04:22:23.736 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 10-236223201461 2024-09-16T04:22:23.736 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:23.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=236223201461 2024-09-16T04:22:23.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.10 seq 236223201461' 2024-09-16T04:22:23.737 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.10 seq 236223201461 2024-09-16T04:22:23.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 10 2024-09-16T04:22:24.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 236223201462 -lt 236223201461 2024-09-16T04:22:24.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:24.190 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 11-257698037935 2024-09-16T04:22:24.190 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:24.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=11 2024-09-16T04:22:24.191 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 11-257698037935 2024-09-16T04:22:24.191 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:24.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=257698037935 2024-09-16T04:22:24.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.11 seq 257698037935' 2024-09-16T04:22:24.193 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.11 seq 257698037935 2024-09-16T04:22:24.193 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 11 2024-09-16T04:22:24.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 257698037936 -lt 257698037935 2024-09-16T04:22:24.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:24.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 12-279172874407 2024-09-16T04:22:24.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:24.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=12 2024-09-16T04:22:24.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 12-279172874407 2024-09-16T04:22:24.635 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:24.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=279172874407 2024-09-16T04:22:24.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.12 seq 279172874407' 2024-09-16T04:22:24.636 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.12 seq 279172874407 2024-09-16T04:22:24.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 12 2024-09-16T04:22:25.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 279172874408 -lt 279172874407 2024-09-16T04:22:25.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:25.085 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 13-300647710880 2024-09-16T04:22:25.085 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:25.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=13 2024-09-16T04:22:25.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 13-300647710880 2024-09-16T04:22:25.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:25.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=300647710880 2024-09-16T04:22:25.088 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.13 seq 300647710880 2024-09-16T04:22:25.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.13 seq 300647710880' 2024-09-16T04:22:25.088 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 13 2024-09-16T04:22:25.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 300647710881 -lt 300647710880 2024-09-16T04:22:25.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:25.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 14-322122547354 2024-09-16T04:22:25.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:25.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=14 2024-09-16T04:22:25.538 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 14-322122547354 2024-09-16T04:22:25.539 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:25.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=322122547354 2024-09-16T04:22:25.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.14 seq 322122547354' 2024-09-16T04:22:25.540 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.14 seq 322122547354 2024-09-16T04:22:25.540 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 14 2024-09-16T04:22:25.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 322122547355 -lt 322122547354 2024-09-16T04:22:25.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:25.989 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 15-343597383827 2024-09-16T04:22:25.989 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:25.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=15 2024-09-16T04:22:25.990 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 15-343597383827 2024-09-16T04:22:25.990 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:25.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=343597383827 2024-09-16T04:22:25.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.15 seq 343597383827' 2024-09-16T04:22:25.991 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.15 seq 343597383827 2024-09-16T04:22:25.992 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 15 2024-09-16T04:22:26.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 343597383829 -lt 343597383827 2024-09-16T04:22:26.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:26.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 16-365072220297 2024-09-16T04:22:26.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:26.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=16 2024-09-16T04:22:26.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 16-365072220297 2024-09-16T04:22:26.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:26.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=365072220297 2024-09-16T04:22:26.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.16 seq 365072220297' 2024-09-16T04:22:26.443 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.16 seq 365072220297 2024-09-16T04:22:26.444 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 16 2024-09-16T04:22:26.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 365072220299 -lt 365072220297 2024-09-16T04:22:26.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:26.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 17-386547056771 2024-09-16T04:22:26.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:26.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=17 2024-09-16T04:22:26.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 17-386547056771 2024-09-16T04:22:26.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:26.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=386547056771 2024-09-16T04:22:26.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.17 seq 386547056771' 2024-09-16T04:22:26.897 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.17 seq 386547056771 2024-09-16T04:22:26.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 17 2024-09-16T04:22:27.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 386547056772 -lt 386547056771 2024-09-16T04:22:27.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:27.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 18-408021893245 2024-09-16T04:22:27.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:27.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=18 2024-09-16T04:22:27.337 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 18-408021893245 2024-09-16T04:22:27.337 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:27.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=408021893245 2024-09-16T04:22:27.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.18 seq 408021893245' 2024-09-16T04:22:27.339 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.18 seq 408021893245 2024-09-16T04:22:27.339 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 18 2024-09-16T04:22:27.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 408021893247 -lt 408021893245 2024-09-16T04:22:27.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:22:27.750 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 19-429496729717 2024-09-16T04:22:27.750 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:22:27.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=19 2024-09-16T04:22:27.752 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 19-429496729717 2024-09-16T04:22:27.752 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:22:27.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=429496729717 2024-09-16T04:22:27.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.19 seq 429496729717' 2024-09-16T04:22:27.753 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.19 seq 429496729717 2024-09-16T04:22:27.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 19 2024-09-16T04:22:28.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 429496729718 -lt 429496729717 2024-09-16T04:22:28.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-09-16T04:22:28.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:22:28.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:22:28.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 8 == 0 2024-09-16T04:22:28.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:22:28.791 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state activating 2024-09-16T04:22:28.791 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=activating 2024-09-16T04:22:28.791 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:22:28.791 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("activating"))' 2024-09-16T04:22:28.791 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:22:28.791 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2024-09-16T04:22:29.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-09-16T04:22:29.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-09-16T04:22:29.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-09-16T04:22:29.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-09-16T04:22:29.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:235: TEST_backfill_test_multi: ERRORS=0 2024-09-16T04:22:29.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:236: TEST_backfill_test_multi: ceph pg dump pgs 2024-09-16T04:22:29.211 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:236: TEST_backfill_test_multi: grep +backfill_toofull 2024-09-16T04:22:29.211 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:236: TEST_backfill_test_multi: wc -l 2024-09-16T04:22:29.602 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:22:29.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:236: TEST_backfill_test_multi: full=4 2024-09-16T04:22:29.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:237: TEST_backfill_test_multi: '[' 4 -lt 1 ']' 2024-09-16T04:22:29.613 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:243: TEST_backfill_test_multi: expr 8 - 4 2024-09-16T04:22:29.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:243: TEST_backfill_test_multi: expected=4 2024-09-16T04:22:29.615 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:244: TEST_backfill_test_multi: ceph pg dump pgs 2024-09-16T04:22:29.615 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:244: TEST_backfill_test_multi: grep active+clean 2024-09-16T04:22:29.615 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:244: TEST_backfill_test_multi: wc -l 2024-09-16T04:22:30.006 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:22:30.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:244: TEST_backfill_test_multi: '[' 4 '!=' 4 ']' 2024-09-16T04:22:30.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:250: TEST_backfill_test_multi: ceph pg dump pgs 2024-09-16T04:22:30.408 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:22:30.408 INFO:tasks.workunit.client.0.smithi026.stdout:8.0 600 0 0 0 0 2457600 0 0 100 500 100 active+clean 2024-09-16T04:22:12.180259+0000 144'600 180:1892 [3,15] 3 [3,15] 3 0'0 2024-09-16T04:13:51.564753+0000 0'0 2024-09-16T04:13:51.564753+0000 0 0 periodic scrub scheduled @ 2024-09-17T10:38:36.375560+0000 0 0 2024-09-16T04:22:30.408 INFO:tasks.workunit.client.0.smithi026.stdout:7.0 600 0 600 0 0 2457600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-09-16T04:22:08.283874+0000 144'600 180:709 [5,1] 5 [5] 5 0'0 2024-09-16T04:13:48.124827+0000 0'0 2024-09-16T04:13:48.124827+0000 0 0 no scrub is scheduled 0 0 2024-09-16T04:22:30.409 INFO:tasks.workunit.client.0.smithi026.stdout:6.0 600 0 600 0 0 2457600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-09-16T04:22:06.022788+0000 144'600 180:713 [7,4] 7 [7] 7 0'0 2024-09-16T04:13:45.036944+0000 0'0 2024-09-16T04:13:45.036944+0000 0 0 no scrub is scheduled 0 0 2024-09-16T04:22:30.409 INFO:tasks.workunit.client.0.smithi026.stdout:5.0 600 0 0 0 0 2457600 0 0 100 500 100 active+clean 2024-09-16T04:22:10.537699+0000 144'600 180:1920 [12,19] 12 [12,19] 12 0'0 2024-09-16T04:13:41.886318+0000 0'0 2024-09-16T04:13:41.886318+0000 0 0 periodic scrub scheduled @ 2024-09-17T15:12:13.199685+0000 0 0 2024-09-16T04:22:30.409 INFO:tasks.workunit.client.0.smithi026.stdout:4.0 600 0 0 0 0 2457600 0 0 100 500 100 active+clean 2024-09-16T04:22:05.448409+0000 144'600 180:1925 [4,10] 4 [4,10] 4 0'0 2024-09-16T04:13:38.503922+0000 0'0 2024-09-16T04:13:38.503922+0000 0 0 periodic scrub scheduled @ 2024-09-17T09:30:06.972351+0000 0 0 2024-09-16T04:22:30.409 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 600 0 600 0 0 2457600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-09-16T04:21:59.970840+0000 144'600 180:740 [1,7] 1 [1] 1 0'0 2024-09-16T04:13:35.287943+0000 0'0 2024-09-16T04:13:35.287943+0000 0 0 no scrub is scheduled 0 0 2024-09-16T04:22:30.409 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 600 0 600 0 0 2457600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-09-16T04:21:58.062936+0000 144'600 180:744 [17,5] 17 [17] 17 0'0 2024-09-16T04:13:32.186500+0000 0'0 2024-09-16T04:13:32.186500+0000 0 0 no scrub is scheduled 0 0 2024-09-16T04:22:30.409 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 600 0 0 0 0 2457600 0 0 100 500 100 active+clean 2024-09-16T04:22:01.044391+0000 144'600 180:1962 [8,0] 8 [8,0] 8 0'0 2024-09-16T04:13:28.581849+0000 0'0 2024-09-16T04:13:28.581849+0000 0 0 periodic scrub scheduled @ 2024-09-17T09:17:54.389140+0000 0 0 2024-09-16T04:22:30.409 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:22:30.409 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:22:30.409 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:22:30.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:251: TEST_backfill_test_multi: ceph status 2024-09-16T04:22:30.982 INFO:tasks.workunit.client.0.smithi026.stdout: cluster: 2024-09-16T04:22:30.983 INFO:tasks.workunit.client.0.smithi026.stdout: id: c285045d-f173-454b-b858-a2830ec25049 2024-09-16T04:22:30.983 INFO:tasks.workunit.client.0.smithi026.stdout: health: HEALTH_WARN 2024-09-16T04:22:30.983 INFO:tasks.workunit.client.0.smithi026.stdout: Low space hindering backfill (add storage if this doesn't resolve itself): 4 pgs backfill_toofull 2024-09-16T04:22:30.983 INFO:tasks.workunit.client.0.smithi026.stdout: Degraded data redundancy: 2400/9600 objects degraded (25.000%), 4 pgs degraded, 4 pgs undersized 2024-09-16T04:22:30.983 INFO:tasks.workunit.client.0.smithi026.stdout: 8 pool(s) do not have an application enabled 2024-09-16T04:22:30.983 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:22:30.983 INFO:tasks.workunit.client.0.smithi026.stdout: services: 2024-09-16T04:22:30.983 INFO:tasks.workunit.client.0.smithi026.stdout: mon: 1 daemons, quorum a (age 21m) 2024-09-16T04:22:30.983 INFO:tasks.workunit.client.0.smithi026.stdout: mgr: x(active, since 20m) 2024-09-16T04:22:30.983 INFO:tasks.workunit.client.0.smithi026.stdout: osd: 20 osds: 20 up (since 9m), 20 in (since 9m); 4 remapped pgs 2024-09-16T04:22:30.983 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:22:30.983 INFO:tasks.workunit.client.0.smithi026.stdout: data: 2024-09-16T04:22:30.984 INFO:tasks.workunit.client.0.smithi026.stdout: pools: 8 pools, 8 pgs 2024-09-16T04:22:30.984 INFO:tasks.workunit.client.0.smithi026.stdout: objects: 4.80k objects, 19 MiB 2024-09-16T04:22:30.984 INFO:tasks.workunit.client.0.smithi026.stdout: usage: 28 MiB used, 42 MiB / 70 MiB avail 2024-09-16T04:22:30.984 INFO:tasks.workunit.client.0.smithi026.stdout: pgs: 2400/9600 objects degraded (25.000%) 2024-09-16T04:22:30.984 INFO:tasks.workunit.client.0.smithi026.stdout: 4 active+undersized+degraded+remapped+backfill_toofull 2024-09-16T04:22:30.984 INFO:tasks.workunit.client.0.smithi026.stdout: 4 active+clean 2024-09-16T04:22:30.984 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:22:30.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:253: TEST_backfill_test_multi: ceph status --format=json-pretty 2024-09-16T04:22:31.561 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:255: TEST_backfill_test_multi: jq .health.checks.PG_BACKFILL_FULL.severity td/osd-backfill-space/stat.json 2024-09-16T04:22:31.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:255: TEST_backfill_test_multi: eval 'SEV="HEALTH_WARN"' 2024-09-16T04:22:31.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:255: TEST_backfill_test_multi: SEV=HEALTH_WARN 2024-09-16T04:22:31.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:256: TEST_backfill_test_multi: '[' HEALTH_WARN '!=' HEALTH_WARN ']' 2024-09-16T04:22:31.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:260: TEST_backfill_test_multi: jq .health.checks.PG_BACKFILL_FULL.summary.message td/osd-backfill-space/stat.json 2024-09-16T04:22:31.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:260: TEST_backfill_test_multi: eval 'MSG="Low' space hindering backfill '(add' storage if this 'doesn'\''t' resolve 'itself):' 4 pgs 'backfill_toofull"' 2024-09-16T04:22:31.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:260: TEST_backfill_test_multi: MSG='Low space hindering backfill (add storage if this doesn'\''t resolve itself): 4 pgs backfill_toofull' 2024-09-16T04:22:31.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:261: TEST_backfill_test_multi: '[' 'Low space hindering backfill (add storage if this doesn'\''t resolve itself): 4 pgs backfill_toofull' '!=' 'Low space hindering backfill (add storage if this doesn'\''t resolve itself): 4 pgs backfill_toofull' ']' 2024-09-16T04:22:31.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:265: TEST_backfill_test_multi: rm -f td/osd-backfill-space/stat.json 2024-09-16T04:22:31.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:267: TEST_backfill_test_multi: '[' 0 '!=' 0 ']' 2024-09-16T04:22:31.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: seq 1 8 2024-09-16T04:22:31.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-09-16T04:22:31.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test1 2024-09-16T04:22:31.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test1 2024-09-16T04:22:31.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-09-16T04:22:32.132 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' does not exist 2024-09-16T04:22:32.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-09-16T04:22:32.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test2 2024-09-16T04:22:32.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test2 2024-09-16T04:22:32.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-09-16T04:22:32.696 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' does not exist 2024-09-16T04:22:32.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-09-16T04:22:32.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test3 2024-09-16T04:22:32.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test3 2024-09-16T04:22:32.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test3 test3 --yes-i-really-really-mean-it 2024-09-16T04:22:33.421 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test3' does not exist 2024-09-16T04:22:33.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-09-16T04:22:33.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test4 2024-09-16T04:22:33.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test4 2024-09-16T04:22:33.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test4 test4 --yes-i-really-really-mean-it 2024-09-16T04:22:34.249 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test4' does not exist 2024-09-16T04:22:34.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-09-16T04:22:34.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test5 2024-09-16T04:22:34.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test5 2024-09-16T04:22:34.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test5 test5 --yes-i-really-really-mean-it 2024-09-16T04:22:35.429 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test5' does not exist 2024-09-16T04:22:35.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-09-16T04:22:35.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test6 2024-09-16T04:22:35.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test6 2024-09-16T04:22:35.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test6 test6 --yes-i-really-really-mean-it 2024-09-16T04:22:36.670 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test6' does not exist 2024-09-16T04:22:36.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-09-16T04:22:36.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test7 2024-09-16T04:22:36.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test7 2024-09-16T04:22:36.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test7 test7 --yes-i-really-really-mean-it 2024-09-16T04:22:37.916 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test7' does not exist 2024-09-16T04:22:37.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:272: TEST_backfill_test_multi: for i in $(seq 1 $pools) 2024-09-16T04:22:37.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:274: TEST_backfill_test_multi: delete_pool test8 2024-09-16T04:22:37.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test8 2024-09-16T04:22:37.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test8 test8 --yes-i-really-really-mean-it 2024-09-16T04:22:39.196 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test8' does not exist 2024-09-16T04:22:39.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:277: TEST_backfill_test_multi: kill_daemons td/osd-backfill-space 2024-09-16T04:22:39.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:22:39.211 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:22:39.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:22:39.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:22:39.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:22:40.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:22:40.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:278: TEST_backfill_test_multi: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.10.log td/osd-backfill-space/osd.11.log td/osd-backfill-space/osd.12.log td/osd-backfill-space/osd.13.log td/osd-backfill-space/osd.14.log td/osd-backfill-space/osd.15.log td/osd-backfill-space/osd.16.log td/osd-backfill-space/osd.17.log td/osd-backfill-space/osd.18.log td/osd-backfill-space/osd.19.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log td/osd-backfill-space/osd.3.log td/osd-backfill-space/osd.4.log td/osd-backfill-space/osd.5.log td/osd-backfill-space/osd.6.log td/osd-backfill-space/osd.7.log td/osd-backfill-space/osd.8.log td/osd-backfill-space/osd.9.log 2024-09-16T04:22:40.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-09-16T04:22:40.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:22:40.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:22:40.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:22:40.777 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:22:40.777 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:22:40.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:22:40.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:22:40.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:22:40.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:22:40.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:22:40.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:22:40.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:22:40.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:22:40.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:22:40.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:22:40.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:22:40.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:22:40.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:22:40.798 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:22:40.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:22:40.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:22:40.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:22:41.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:22:41.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:22:41.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:22:41.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:22:41.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:22:41.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:22:41.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-09-16T04:22:41.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-09-16T04:22:41.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-space 2024-09-16T04:22:41.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-space 2024-09-16T04:22:41.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:22:41.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:22:41.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:22:41.103 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:22:41.103 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:22:41.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:22:41.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:22:41.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:22:41.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:22:41.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:22:41.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:22:41.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:22:41.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:22:41.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:22:41.107 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:22:41.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:22:41.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:22:41.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:22:41.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:22:41.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:22:41.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:22:41.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:22:41.111 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:22:41.111 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:22:41.112 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:22:41.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:22:41.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:22:41.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:22:41.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-space 2024-09-16T04:22:41.114 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:22:41.114 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:22:41.114 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:22:41.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.114688 2024-09-16T04:22:41.116 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:22:41.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:22:41.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:22:41.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-09-16T04:22:41.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_backfill_test_sametarget td/osd-backfill-space 2024-09-16T04:22:41.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:295: TEST_backfill_test_sametarget: local dir=td/osd-backfill-space 2024-09-16T04:22:41.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:296: TEST_backfill_test_sametarget: local pools=10 2024-09-16T04:22:41.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:297: TEST_backfill_test_sametarget: local OSDS=5 2024-09-16T04:22:41.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:299: TEST_backfill_test_sametarget: run_mon td/osd-backfill-space a 2024-09-16T04:22:41.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-space 2024-09-16T04:22:41.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:22:41.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:22:41.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:22:41.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-space/a 2024-09-16T04:22:41.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-09-16T04:22:41.580 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:22:41.580 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:22:41.580 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:22:41.580 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:22:41.580 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:22:41.580 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:22:41.580 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:22:41.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:22:41.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:22:41.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:22:41.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:22:41.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:22:41.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:22:41.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:22:41.774 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:22:41.774 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:22:41.775 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:22:41.775 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:22:41.775 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:22:41.775 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:22:41.775 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T04:22:41.775 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:22:41.775 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get fsid 2024-09-16T04:22:41.861 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:22:41.861 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:22:41.861 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:22:41.861 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:22:41.861 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:22:41.862 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:22:41.862 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:22:41.862 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:22:41.862 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:22:41.862 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:22:41.862 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:22:41.862 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T04:22:41.862 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:22:41.863 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get mon_host 2024-09-16T04:22:41.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:300: TEST_backfill_test_sametarget: run_mgr td/osd-backfill-space x 2024-09-16T04:22:41.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-space 2024-09-16T04:22:41.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:22:41.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:22:41.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:22:41.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-space/x 2024-09-16T04:22:41.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:22:42.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:22:42.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:22:42.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:22:42.815 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:22:42.815 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:22:42.815 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:22:42.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:22:42.816 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:22:42.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:22:42.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:301: TEST_backfill_test_sametarget: export CEPH_ARGS 2024-09-16T04:22:42.849 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: expr 5 - 1 2024-09-16T04:22:42.850 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: seq 0 4 2024-09-16T04:22:42.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:22:42.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:305: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 0 2024-09-16T04:22:42.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:22:42.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:22:42.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T04:22:42.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:22:42.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/0 2024-09-16T04:22:42.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:22:42.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:22:42.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:22:42.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:22:42.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-09-16T04:22:42.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-09-16T04:22:42.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:22:42.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:22:42.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:22:42.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:22:42.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:22:42.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:22:42.856 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:22:42.856 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:22:42.856 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:22:42.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:22:42.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/0 2024-09-16T04:22:42.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:22:42.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=94bb0f32-3b80-49a5-9ae9-c98c5d45e853 2024-09-16T04:22:42.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 94bb0f32-3b80-49a5-9ae9-c98c5d45e853' 2024-09-16T04:22:42.858 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 94bb0f32-3b80-49a5-9ae9-c98c5d45e853 2024-09-16T04:22:42.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:22:42.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCSsudmVApRNBAAVaCrC06ChbcidRM9s1qy+w== 2024-09-16T04:22:42.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCSsudmVApRNBAAVaCrC06ChbcidRM9s1qy+w=="}' 2024-09-16T04:22:42.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 94bb0f32-3b80-49a5-9ae9-c98c5d45e853 -i td/osd-backfill-space/0/new.json 2024-09-16T04:22:43.156 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:22:43.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/0/new.json 2024-09-16T04:22:43.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCSsudmVApRNBAAVaCrC06ChbcidRM9s1qy+w== --osd-uuid 94bb0f32-3b80-49a5-9ae9-c98c5d45e853 2024-09-16T04:22:43.203 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:22:43.201+0000 7f87f27cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:22:43.224 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:22:43.222+0000 7f87f27cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:22:43.225 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:22:43.223+0000 7f87f27cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:22:43.225 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:22:43.224+0000 7f87f27cc640 -1 bdev(0x55bda1cc1c00 td/osd-backfill-space/0/block) open stat got: (1) Operation not permitted 2024-09-16T04:22:43.225 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:22:43.224+0000 7f87f27cc640 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-09-16T04:22:48.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-09-16T04:22:48.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:22:48.703 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T04:22:48.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T04:22:48.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:22:49.272 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T04:22:49.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T04:22:49.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:22:49.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:22:49.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:22:49.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:22:49.308 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:22:49.305+0000 7f747d325640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:22:49.319 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:22:49.318+0000 7f747d325640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:22:49.320 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:22:49.319+0000 7f747d325640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:22:49.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T04:22:49.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:22:49.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:22:49.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:22:49.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:22:49.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:22:49.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:22:49.743 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:22:49.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:22:49.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:22:50.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:22:50.908 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:22:50.907+0000 7f747d325640 -1 Falling back to public interface 2024-09-16T04:22:51.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:22:51.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:22:51.186 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:22:51.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:22:51.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:22:51.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:22:51.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:22:52.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:22:52.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:22:52.636 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:22:52.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:22:52.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:22:52.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:22:53.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:22:53.473 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:22:53.471+0000 7f747d325640 -1 osd.0 0 log_to_monitors true 2024-09-16T04:22:54.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:22:54.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:22:54.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:22:54.059 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:22:54.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:22:54.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:22:54.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:22:55.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:22:55.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:22:55.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:22:55.556 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:22:55.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:22:55.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:22:55.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:22:56.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:22:56.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:22:56.977 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:22:56.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:22:56.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:22:56.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:22:57.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:22:58.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:22:58.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:22:58.421 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:22:58.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:22:58.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:22:58.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:22:58.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:22:59.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:22:59.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:22:59.861 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:22:59.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:22:59.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:22:59.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:23:00.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:01.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:01.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:01.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:23:01.349 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:23:01.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:01.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:23:01.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:02.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:02.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:02.808 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:23:02.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:23:02.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:02.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:23:03.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:04.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:04.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:04.352 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:23:04.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:23:04.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:04.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:23:04.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:05.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:05.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:05.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:23:05.798 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:23:05.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:05.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:23:06.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:07.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:07.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:07.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:23:07.563 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:23:07.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:07.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:23:08.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:09.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:09.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:09.518 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:23:09.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:23:09.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:09.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:23:10.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:11.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:11.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:11.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:23:11.359 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:23:11.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:11.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:23:12.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:13.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:13.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:13.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:23:13.325 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:23:13.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:13.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:23:14.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:15.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:15.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:15.342 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:23:15.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:23:15.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:15.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:23:15.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:16.839 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:23:16.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:23:16.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:16.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:23:17.317 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3550273151,v1:127.0.0.1:6803/3550273151] [v2:127.0.0.1:6804/3550273151,v1:127.0.0.1:6805/3550273151] exists,up 94bb0f32-3b80-49a5-9ae9-c98c5d45e853 2024-09-16T04:23:17.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:23:17.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:23:17.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:23:17.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:23:17.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:305: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 1 2024-09-16T04:23:17.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:23:17.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:23:17.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/1 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:23:17.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:23:17.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:23:17.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:23:17.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:23:17.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:23:17.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:23:17.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/1 2024-09-16T04:23:17.324 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:23:17.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a6ce03b4-a9d4-4dd2-be45-f223ce32caeb 2024-09-16T04:23:17.324 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 a6ce03b4-a9d4-4dd2-be45-f223ce32caeb 2024-09-16T04:23:17.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 a6ce03b4-a9d4-4dd2-be45-f223ce32caeb' 2024-09-16T04:23:17.325 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:23:17.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC1sudm75RzFBAAFAtZ2EHE0K+FcWrKNSdiHQ== 2024-09-16T04:23:17.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC1sudm75RzFBAAFAtZ2EHE0K+FcWrKNSdiHQ=="}' 2024-09-16T04:23:17.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a6ce03b4-a9d4-4dd2-be45-f223ce32caeb -i td/osd-backfill-space/1/new.json 2024-09-16T04:23:17.892 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:23:17.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/1/new.json 2024-09-16T04:23:17.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC1sudm75RzFBAAFAtZ2EHE0K+FcWrKNSdiHQ== --osd-uuid a6ce03b4-a9d4-4dd2-be45-f223ce32caeb 2024-09-16T04:23:17.939 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:17.938+0000 7ff5d9c11640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:23:17.941 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:17.940+0000 7ff5d9c11640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:23:17.942 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:17.941+0000 7ff5d9c11640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:23:17.942 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:17.941+0000 7ff5d9c11640 -1 bdev(0x5568e47cbc00 td/osd-backfill-space/1/block) open stat got: (1) Operation not permitted 2024-09-16T04:23:17.942 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:17.941+0000 7ff5d9c11640 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-09-16T04:23:24.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-09-16T04:23:24.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:23:24.177 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T04:23:24.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T04:23:24.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:23:24.747 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T04:23:24.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T04:23:24.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:23:24.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:23:24.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:23:24.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:23:24.782 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:24.780+0000 7f61de81a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:23:24.794 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:24.793+0000 7f61de81a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:23:24.795 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:24.794+0000 7f61de81a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:23:25.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T04:23:25.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:23:25.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:23:25.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:23:25.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:23:25.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:25.234 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:23:25.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:23:25.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:25.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:25.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:26.161 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:26.160+0000 7f61de81a640 -1 Falling back to public interface 2024-09-16T04:23:26.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:26.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:26.719 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:23:26.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:23:26.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:26.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:27.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:28.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:28.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:28.138 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:23:28.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:23:28.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:28.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:28.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:28.957 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:28.956+0000 7f61de81a640 -1 osd.1 0 log_to_monitors true 2024-09-16T04:23:29.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:29.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:29.557 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:23:29.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:23:29.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:29.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:30.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:31.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:31.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:31.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:23:31.135 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:23:31.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:31.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:31.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:32.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:32.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:32.569 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:23:32.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:23:32.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:32.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:33.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:34.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:34.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:34.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:23:34.009 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:23:34.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:34.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:34.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:35.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:35.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:35.469 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:23:35.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:23:35.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:35.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:35.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:36.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:36.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:36.946 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:23:36.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:23:36.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:36.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:37.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:38.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:38.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:38.371 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:23:38.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:23:38.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:38.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:38.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:39.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:39.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:39.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:23:39.918 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:23:39.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:39.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:40.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:41.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:41.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:41.349 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:23:41.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:23:41.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:41.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:41.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:42.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:42.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:42.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:23:42.851 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:23:42.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:42.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:43.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:44.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:44.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:44.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:23:44.357 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:23:44.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:44.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:45.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:46.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:46.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:46.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:23:46.164 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:23:46.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:46.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:47.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:48.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:48.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:48.058 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:23:48.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:23:48.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:48.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:48.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:49.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:49.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:49.726 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:23:49.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:23:49.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:49.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:50.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:51.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:51.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:51.496 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:23:51.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:23:51.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:51.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:52.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:23:53.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:23:53.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:23:53.196 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:23:53.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:23:53.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:23:53.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:23:53.617 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/106721808,v1:127.0.0.1:6811/106721808] [v2:127.0.0.1:6812/106721808,v1:127.0.0.1:6813/106721808] exists,up a6ce03b4-a9d4-4dd2-be45-f223ce32caeb 2024-09-16T04:23:53.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:23:53.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:23:53.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:23:53.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:23:53.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:305: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 2 2024-09-16T04:23:53.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:23:53.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:23:53.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T04:23:53.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:23:53.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/2 2024-09-16T04:23:53.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:23:53.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:23:53.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:23:53.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:23:53.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-09-16T04:23:53.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-09-16T04:23:53.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:23:53.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:23:53.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:23:53.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:23:53.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:23:53.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:23:53.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:23:53.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:23:53.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:23:53.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:23:53.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/2 2024-09-16T04:23:53.624 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:23:53.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=24e00bc0-90d9-499d-8ed4-fcc72d5ed312 2024-09-16T04:23:53.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 24e00bc0-90d9-499d-8ed4-fcc72d5ed312' 2024-09-16T04:23:53.625 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 24e00bc0-90d9-499d-8ed4-fcc72d5ed312 2024-09-16T04:23:53.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:23:53.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDZsudmQLpXJhAAkHlWSMEGBPtiZrrt7eidSw== 2024-09-16T04:23:53.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDZsudmQLpXJhAAkHlWSMEGBPtiZrrt7eidSw=="}' 2024-09-16T04:23:53.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 24e00bc0-90d9-499d-8ed4-fcc72d5ed312 -i td/osd-backfill-space/2/new.json 2024-09-16T04:23:54.215 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:23:54.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/2/new.json 2024-09-16T04:23:54.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDZsudmQLpXJhAAkHlWSMEGBPtiZrrt7eidSw== --osd-uuid 24e00bc0-90d9-499d-8ed4-fcc72d5ed312 2024-09-16T04:23:54.264 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:54.262+0000 7f3a8a1d4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:23:54.265 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:54.264+0000 7f3a8a1d4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:23:54.266 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:54.265+0000 7f3a8a1d4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:23:54.267 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:54.265+0000 7f3a8a1d4640 -1 bdev(0x5572c5521c00 td/osd-backfill-space/2/block) open stat got: (1) Operation not permitted 2024-09-16T04:23:54.267 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:23:54.265+0000 7f3a8a1d4640 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-09-16T04:24:00.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-09-16T04:24:00.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:24:00.020 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T04:24:00.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T04:24:00.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:24:00.584 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T04:24:00.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T04:24:00.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:24:00.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:24:00.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:24:00.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:24:00.619 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:00.617+0000 7f579bc1d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:24:00.620 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:00.619+0000 7f579bc1d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:24:00.622 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:00.620+0000 7f579bc1d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:24:01.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T04:24:01.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:24:01.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:24:01.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:24:01.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:24:01.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:01.043 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:24:01.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:24:01.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:01.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:01.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:01.978 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:01.976+0000 7f579bc1d640 -1 Falling back to public interface 2024-09-16T04:24:02.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:02.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:02.487 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:24:02.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:24:02.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:02.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:02.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:03.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:03.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:03.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:24:03.947 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:24:03.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:03.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:04.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:05.176 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:05.175+0000 7f579bc1d640 -1 osd.2 0 log_to_monitors true 2024-09-16T04:24:05.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:05.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:05.409 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:24:05.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:24:05.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:05.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:05.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:06.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:06.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:06.873 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:24:06.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:24:06.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:06.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:07.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:08.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:08.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:08.384 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:24:08.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:24:08.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:08.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:08.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:09.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:09.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:09.832 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:24:09.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:24:09.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:09.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:10.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:11.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:11.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:11.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:24:11.360 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:24:11.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:11.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:11.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:12.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:12.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:12.819 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:24:12.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:24:12.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:12.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:13.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:14.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:14.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:14.325 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:24:14.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:24:14.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:14.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:14.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:15.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:15.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:15.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:24:15.766 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:24:15.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:15.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:16.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:17.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:17.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:17.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:24:17.223 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:24:17.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:17.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:17.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:18.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:18.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:18.836 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:24:18.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:24:18.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:18.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:19.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:20.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:20.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:20.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:24:20.437 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:24:20.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:20.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:21.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:22.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:22.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:22.106 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:24:22.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:24:22.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:22.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:22.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:23.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:23.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:23.815 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:24:23.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:24:23.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:23.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:24.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:25.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:25.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:25.626 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:24:25.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:24:25.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:25.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:26.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:27.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:27.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:27.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:24:27.317 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:24:27.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:27.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:28.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:29.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:29.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:29.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:24:29.063 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:24:29.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:29.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:24:29.504 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1192010017,v1:127.0.0.1:6819/1192010017] [v2:127.0.0.1:6820/1192010017,v1:127.0.0.1:6821/1192010017] exists,up 24e00bc0-90d9-499d-8ed4-fcc72d5ed312 2024-09-16T04:24:29.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:24:29.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:24:29.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:24:29.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:24:29.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:305: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 3 2024-09-16T04:24:29.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/3 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:24:29.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:24:29.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:24:29.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:24:29.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:24:29.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:24:29.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:24:29.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:24:29.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/3 2024-09-16T04:24:29.511 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:24:29.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=06f4b418-04e4-47f4-aaa6-ca0b987ea595 2024-09-16T04:24:29.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 06f4b418-04e4-47f4-aaa6-ca0b987ea595' 2024-09-16T04:24:29.511 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 06f4b418-04e4-47f4-aaa6-ca0b987ea595 2024-09-16T04:24:29.512 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:24:29.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD9sudmmo2bHxAAWl7O/72HuLQEAUUc5zHgyQ== 2024-09-16T04:24:29.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD9sudmmo2bHxAAWl7O/72HuLQEAUUc5zHgyQ=="}' 2024-09-16T04:24:29.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 06f4b418-04e4-47f4-aaa6-ca0b987ea595 -i td/osd-backfill-space/3/new.json 2024-09-16T04:24:30.028 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:24:30.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/3/new.json 2024-09-16T04:24:30.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD9sudmmo2bHxAAWl7O/72HuLQEAUUc5zHgyQ== --osd-uuid 06f4b418-04e4-47f4-aaa6-ca0b987ea595 2024-09-16T04:24:30.077 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:30.075+0000 7fd3556b0640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:24:30.079 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:30.077+0000 7fd3556b0640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:24:30.080 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:30.078+0000 7fd3556b0640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:24:30.080 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:30.079+0000 7fd3556b0640 -1 bdev(0x5635d5315c00 td/osd-backfill-space/3/block) open stat got: (1) Operation not permitted 2024-09-16T04:24:30.080 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:30.079+0000 7fd3556b0640 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2024-09-16T04:24:36.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2024-09-16T04:24:36.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:24:36.010 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T04:24:36.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T04:24:36.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:24:36.584 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T04:24:36.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T04:24:36.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:24:36.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:24:36.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:24:36.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:24:36.619 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:36.617+0000 7f36b69a8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:24:36.621 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:36.620+0000 7f36b69a8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:24:36.622 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:36.621+0000 7f36b69a8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:24:37.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T04:24:37.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:24:37.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T04:24:37.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:24:37.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:24:37.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:37.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:24:37.028 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:24:37.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:37.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:37.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:37.955 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:37.954+0000 7f36b69a8640 -1 Falling back to public interface 2024-09-16T04:24:38.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:38.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:38.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:24:38.472 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:24:38.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:38.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:38.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:39.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:39.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:39.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:24:39.941 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:24:39.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:39.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:40.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:40.752 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:24:40.750+0000 7f36b69a8640 -1 osd.3 0 log_to_monitors true 2024-09-16T04:24:41.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:41.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:41.367 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:24:41.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:24:41.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:41.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:41.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:42.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:42.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:42.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:24:42.946 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:24:42.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:42.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:43.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:44.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:44.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:44.372 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:24:44.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:24:44.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:44.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:44.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:45.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:45.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:45.865 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:24:45.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:24:45.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:45.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:46.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:47.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:47.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:47.400 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:24:47.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:24:47.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:47.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:47.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:48.879 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:24:48.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:24:48.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:48.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:49.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:50.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:50.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:50.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:24:50.307 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:24:50.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:50.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:50.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:51.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:51.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:51.747 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:24:51.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:24:51.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:51.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:52.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:53.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:53.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:53.206 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:24:53.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:24:53.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:53.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:54.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:55.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:55.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:55.094 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:24:55.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:24:55.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:55.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:55.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:56.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:56.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:56.978 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:24:56.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:24:56.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:56.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:57.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:24:58.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:24:58.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:24:58.498 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:24:58.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:24:58.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:24:58.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:24:59.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:00.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:00.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:00.315 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:25:00.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:25:00.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:00.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:25:00.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:01.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:01.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:01.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:25:01.990 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:25:01.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:01.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:25:02.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:03.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:03.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:03.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:25:03.786 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:25:03.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:03.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:25:04.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:05.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:05.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:05.655 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:25:05.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:25:05.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:05.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:25:06.088 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2437018993,v1:127.0.0.1:6827/2437018993] [v2:127.0.0.1:6828/2437018993,v1:127.0.0.1:6829/2437018993] exists,up 06f4b418-04e4-47f4-aaa6-ca0b987ea595 2024-09-16T04:25:06.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:25:06.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:25:06.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:25:06.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:303: TEST_backfill_test_sametarget: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:25:06.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:305: TEST_backfill_test_sametarget: run_osd td/osd-backfill-space 4 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/4 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:25:06.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:25:06.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:25:06.094 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:25:06.094 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:25:06.094 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:25:06.094 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:25:06.094 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:25:06.094 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:25:06.094 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:25:06.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:25:06.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:25:06.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:25:06.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:25:06.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:25:06.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:25:06.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:25:06.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:25:06.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:25:06.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:25:06.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:25:06.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:25:06.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/4 2024-09-16T04:25:06.095 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:25:06.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=44823096-410c-4216-a958-ef7e29fb863d 2024-09-16T04:25:06.096 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 44823096-410c-4216-a958-ef7e29fb863d 2024-09-16T04:25:06.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 44823096-410c-4216-a958-ef7e29fb863d' 2024-09-16T04:25:06.096 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:25:06.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAis+dmHbfTBhAALviRIezAcQwcTfu7QmEAyg== 2024-09-16T04:25:06.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAis+dmHbfTBhAALviRIezAcQwcTfu7QmEAyg=="}' 2024-09-16T04:25:06.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 44823096-410c-4216-a958-ef7e29fb863d -i td/osd-backfill-space/4/new.json 2024-09-16T04:25:06.603 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:25:06.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/4/new.json 2024-09-16T04:25:06.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAis+dmHbfTBhAALviRIezAcQwcTfu7QmEAyg== --osd-uuid 44823096-410c-4216-a958-ef7e29fb863d 2024-09-16T04:25:06.652 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:25:06.650+0000 7f4f6182f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:25:06.659 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:25:06.658+0000 7f4f6182f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:25:06.660 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:25:06.659+0000 7f4f6182f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:25:06.661 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:25:06.659+0000 7f4f6182f640 -1 bdev(0x555ee32ffc00 td/osd-backfill-space/4/block) open stat got: (1) Operation not permitted 2024-09-16T04:25:06.661 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:25:06.659+0000 7f4f6182f640 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2024-09-16T04:25:12.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2024-09-16T04:25:12.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:25:12.935 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T04:25:12.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T04:25:12.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:25:13.506 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T04:25:13.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T04:25:13.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:25:13.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:25:13.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:25:13.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:25:13.540 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:25:13.539+0000 7f93237b2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:25:13.548 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:25:13.547+0000 7f93237b2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:25:13.550 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:25:13.548+0000 7f93237b2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:25:13.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T04:25:13.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:25:13.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T04:25:13.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:25:13.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:25:13.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:13.980 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:25:13.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:25:13.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:13.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:14.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:14.931 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:25:14.930+0000 7f93237b2640 -1 Falling back to public interface 2024-09-16T04:25:15.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:15.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:15.406 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:25:15.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:25:15.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:15.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:15.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:16.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:16.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:16.858 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:25:16.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:25:16.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:16.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:17.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:17.527 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:25:17.525+0000 7f93237b2640 -1 osd.4 0 log_to_monitors true 2024-09-16T04:25:18.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:18.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:18.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:25:18.276 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:25:18.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:18.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:18.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:19.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:19.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:19.707 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:25:19.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:25:19.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:19.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:20.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:21.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:21.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:21.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:25:21.234 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:25:21.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:21.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:21.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:22.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:22.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:22.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:25:22.656 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:25:22.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:22.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:23.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:24.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:24.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:24.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:25:24.096 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:25:24.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:24.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:24.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:25.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:25.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:25.544 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:25:25.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:25:25.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:25.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:25.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:26.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:26.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:26.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:25:26.975 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:25:26.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:26.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:27.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:28.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:28.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:28.500 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:25:28.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:25:28.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:28.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:28.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:29.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:29.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:29.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:25:29.938 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:25:29.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:29.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:30.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:31.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:31.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:31.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:25:31.744 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:25:31.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:31.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:32.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:33.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:33.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:33.359 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:25:33.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:25:33.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:33.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:34.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:35.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:35.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:35.217 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:25:35.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:25:35.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:35.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:36.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:37.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:37.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:37.174 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:25:37.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:25:37.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:37.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:37.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:38.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:38.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:38.850 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:25:38.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:25:38.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:38.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:39.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:25:40.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:25:40.685 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:25:40.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:25:40.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:25:40.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:25:40.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:25:41.113 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1285475363,v1:127.0.0.1:6835/1285475363] [v2:127.0.0.1:6836/1285475363,v1:127.0.0.1:6837/1285475363] exists,up 44823096-410c-4216-a958-ef7e29fb863d 2024-09-16T04:25:41.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:25:41.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:25:41.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:25:41.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:308: TEST_backfill_test_sametarget: ceph osd set-backfillfull-ratio .85 2024-09-16T04:25:41.915 INFO:tasks.workunit.client.0.smithi026.stderr:osd set-backfillfull-ratio 0.85 2024-09-16T04:25:41.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: seq 1 10 2024-09-16T04:25:41.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:25:41.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test1 1 1 2024-09-16T04:25:41.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test1 1 1 2024-09-16T04:25:42.496 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' already exists 2024-09-16T04:25:42.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:25:43.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test1 size 2 2024-09-16T04:25:44.520 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 2 2024-09-16T04:25:44.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:25:44.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test2 1 1 2024-09-16T04:25:44.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test2 1 1 2024-09-16T04:25:45.222 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' already exists 2024-09-16T04:25:45.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:25:46.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test2 size 2 2024-09-16T04:25:47.052 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 2 size to 2 2024-09-16T04:25:47.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:25:47.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test3 1 1 2024-09-16T04:25:47.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test3 1 1 2024-09-16T04:25:48.033 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test3' already exists 2024-09-16T04:25:48.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:25:49.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test3 size 2 2024-09-16T04:25:49.786 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 3 size to 2 2024-09-16T04:25:49.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:25:49.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test4 1 1 2024-09-16T04:25:49.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test4 1 1 2024-09-16T04:25:50.497 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test4' already exists 2024-09-16T04:25:50.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:25:51.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test4 size 2 2024-09-16T04:25:52.496 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 4 size to 2 2024-09-16T04:25:52.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:25:52.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test5 1 1 2024-09-16T04:25:52.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test5 1 1 2024-09-16T04:25:53.202 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test5' already exists 2024-09-16T04:25:53.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:25:54.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test5 size 2 2024-09-16T04:25:55.134 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 5 size to 2 2024-09-16T04:25:55.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:25:55.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test6 1 1 2024-09-16T04:25:55.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test6 1 1 2024-09-16T04:25:55.983 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test6' already exists 2024-09-16T04:25:55.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:25:56.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test6 size 2 2024-09-16T04:25:57.658 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 6 size to 2 2024-09-16T04:25:57.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:25:57.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test7 1 1 2024-09-16T04:25:57.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test7 1 1 2024-09-16T04:25:58.799 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test7' already exists 2024-09-16T04:25:58.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:25:59.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test7 size 2 2024-09-16T04:26:01.232 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 7 size to 2 2024-09-16T04:26:01.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:01.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test8 1 1 2024-09-16T04:26:01.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test8 1 1 2024-09-16T04:26:01.952 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test8' already exists 2024-09-16T04:26:01.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:26:02.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test8 size 2 2024-09-16T04:26:03.877 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 8 size to 2 2024-09-16T04:26:03.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:03.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test9 1 1 2024-09-16T04:26:03.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test9 1 1 2024-09-16T04:26:04.944 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test9' already exists 2024-09-16T04:26:04.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:26:05.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test9 size 2 2024-09-16T04:26:06.777 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 9 size to 2 2024-09-16T04:26:06.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:310: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:06.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:312: TEST_backfill_test_sametarget: create_pool test10 1 1 2024-09-16T04:26:06.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test10 1 1 2024-09-16T04:26:07.572 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test10' already exists 2024-09-16T04:26:07.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:26:08.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:313: TEST_backfill_test_sametarget: ceph osd pool set test10 size 2 2024-09-16T04:26:09.510 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 10 size to 2 2024-09-16T04:26:09.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:315: TEST_backfill_test_sametarget: sleep 5 2024-09-16T04:26:14.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:317: TEST_backfill_test_sametarget: wait_for_clean 2024-09-16T04:26:14.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T04:26:14.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T04:26:14.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T04:26:14.526 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T04:26:14.526 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:26:14.526 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:26:14.526 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:26:14.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:26:14.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:26:14.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T04:26:14.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T04:26:14.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T04:26:14.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T04:26:14.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:26:14.630 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:26:15.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:26:15.076 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:26:15.076 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:26:15.076 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:26:15.076 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T04:26:15.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:26:15.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:26:15.077 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:26:15.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836523 2024-09-16T04:26:15.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836523 2024-09-16T04:26:15.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523' 2024-09-16T04:26:15.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:26:15.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:26:15.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672994 2024-09-16T04:26:15.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672994 2024-09-16T04:26:15.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672994' 2024-09-16T04:26:15.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:26:15.327 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:26:15.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509469 2024-09-16T04:26:15.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509469 2024-09-16T04:26:15.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672994 2-64424509469' 2024-09-16T04:26:15.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:26:15.453 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:26:15.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345944 2024-09-16T04:26:15.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345944 2024-09-16T04:26:15.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672994 2-64424509469 3-85899345944' 2024-09-16T04:26:15.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:26:15.577 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:26:15.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182411 2024-09-16T04:26:15.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182411 2024-09-16T04:26:15.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672994 2-64424509469 3-85899345944 4-107374182411' 2024-09-16T04:26:15.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:26:15.699 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836523 2024-09-16T04:26:15.700 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:26:15.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:26:15.701 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836523 2024-09-16T04:26:15.701 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:26:15.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836523 2024-09-16T04:26:15.702 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836523 2024-09-16T04:26:15.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836523' 2024-09-16T04:26:15.702 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:26:16.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836521 -lt 21474836523 2024-09-16T04:26:16.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:26:17.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:26:17.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:26:17.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836524 -lt 21474836523 2024-09-16T04:26:17.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:26:17.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672994 2024-09-16T04:26:17.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:26:17.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:26:17.574 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672994 2024-09-16T04:26:17.574 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:26:17.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672994 2024-09-16T04:26:17.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672994' 2024-09-16T04:26:17.575 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672994 2024-09-16T04:26:17.575 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:26:18.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672994 -lt 42949672994 2024-09-16T04:26:18.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:26:18.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509469 2024-09-16T04:26:18.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:26:18.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:26:18.017 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509469 2024-09-16T04:26:18.017 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:26:18.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509469 2024-09-16T04:26:18.018 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509469 2024-09-16T04:26:18.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509469' 2024-09-16T04:26:18.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:26:18.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509469 -lt 64424509469 2024-09-16T04:26:18.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:26:18.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345944 2024-09-16T04:26:18.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:26:18.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:26:18.467 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345944 2024-09-16T04:26:18.467 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:26:18.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345944 2024-09-16T04:26:18.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345944' 2024-09-16T04:26:18.469 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345944 2024-09-16T04:26:18.469 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:26:18.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345944 -lt 85899345944 2024-09-16T04:26:18.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:26:18.917 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182411 2024-09-16T04:26:18.917 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:26:18.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:26:18.919 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182411 2024-09-16T04:26:18.919 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:26:18.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182411 2024-09-16T04:26:18.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182411' 2024-09-16T04:26:18.921 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182411 2024-09-16T04:26:18.921 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:26:19.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182412 -lt 107374182411 2024-09-16T04:26:19.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T04:26:19.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:26:19.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:26:19.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 10 == 0 2024-09-16T04:26:19.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:26:19.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:26:19.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:26:19.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:26:19.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:26:19.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:26:19.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:26:20.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=10 2024-09-16T04:26:20.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:26:20.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:26:20.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:26:20.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 10 = 10 2024-09-16T04:26:20.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T04:26:20.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T04:26:20.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:319: TEST_backfill_test_sametarget: ceph pg dump pgs 2024-09-16T04:26:21.247 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:26:21.247 INFO:tasks.workunit.client.0.smithi026.stdout:10.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T04:26:10.313551+0000 0'0 82:17 [2,1] 2 [2,1] 2 0'0 2024-09-16T04:26:07.262460+0000 0'0 2024-09-16T04:26:07.262460+0000 0 0 periodic scrub scheduled @ 2024-09-17T06:08:17.099864+0000 0 0 2024-09-16T04:26:21.247 INFO:tasks.workunit.client.0.smithi026.stdout:9.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T04:26:07.884918+0000 0'0 82:32 [1,2] 1 [1,2] 1 0'0 2024-09-16T04:26:04.312336+0000 0'0 2024-09-16T04:26:04.312336+0000 0 0 periodic scrub scheduled @ 2024-09-17T13:31:52.714505+0000 0 0 2024-09-16T04:26:21.247 INFO:tasks.workunit.client.0.smithi026.stdout:8.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T04:26:04.557328+0000 0'0 82:35 [3,4] 3 [3,4] 3 0'0 2024-09-16T04:26:01.641432+0000 0'0 2024-09-16T04:26:01.641432+0000 0 0 periodic scrub scheduled @ 2024-09-17T06:07:55.992277+0000 0 0 2024-09-16T04:26:21.247 INFO:tasks.workunit.client.0.smithi026.stdout:7.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T04:26:01.317362+0000 0'0 82:55 [1,4] 1 [1,4] 1 0'0 2024-09-16T04:25:58.345827+0000 0'0 2024-09-16T04:25:58.345827+0000 0 0 periodic scrub scheduled @ 2024-09-17T08:28:04.903834+0000 0 0 2024-09-16T04:26:21.247 INFO:tasks.workunit.client.0.smithi026.stdout:6.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T04:25:58.567322+0000 0'0 82:61 [4,2] 4 [4,2] 4 0'0 2024-09-16T04:25:55.620026+0000 0'0 2024-09-16T04:25:55.620026+0000 0 0 periodic scrub scheduled @ 2024-09-17T12:28:52.096324+0000 0 0 2024-09-16T04:26:21.247 INFO:tasks.workunit.client.0.smithi026.stdout:5.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T04:25:56.400557+0000 0'0 82:71 [3,4] 3 [3,4] 3 0'0 2024-09-16T04:25:52.903250+0000 0'0 2024-09-16T04:25:52.903250+0000 0 0 periodic scrub scheduled @ 2024-09-17T13:51:54.977875+0000 0 0 2024-09-16T04:26:21.247 INFO:tasks.workunit.client.0.smithi026.stdout:4.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T04:25:53.205980+0000 0'0 82:75 [4,0] 4 [4,0] 4 0'0 2024-09-16T04:25:50.147195+0000 0'0 2024-09-16T04:25:50.147195+0000 0 0 periodic scrub scheduled @ 2024-09-17T07:35:51.080312+0000 0 0 2024-09-16T04:26:21.247 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T04:25:50.031113+0000 0'0 82:92 [1,2] 1 [1,2] 1 0'0 2024-09-16T04:25:47.609049+0000 0'0 2024-09-16T04:25:47.609049+0000 0 0 periodic scrub scheduled @ 2024-09-17T09:12:51.658099+0000 0 0 2024-09-16T04:26:21.247 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T04:25:47.739747+0000 0'0 82:95 [3,1] 3 [3,1] 3 0'0 2024-09-16T04:25:44.936878+0000 0'0 2024-09-16T04:25:44.936878+0000 0 0 periodic scrub scheduled @ 2024-09-17T05:28:17.455250+0000 0 0 2024-09-16T04:26:21.248 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T04:25:45.442034+0000 0'0 82:104 [1,0] 1 [1,0] 1 0'0 2024-09-16T04:25:42.334183+0000 0'0 2024-09-16T04:25:42.334183+0000 0 0 periodic scrub scheduled @ 2024-09-17T05:31:46.041955+0000 0 0 2024-09-16T04:26:21.248 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:26:21.248 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:26:21.248 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:26:21.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:323: TEST_backfill_test_sametarget: local PG1 2024-09-16T04:26:21.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:324: TEST_backfill_test_sametarget: local POOLNUM1 2024-09-16T04:26:21.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:325: TEST_backfill_test_sametarget: local pool1 2024-09-16T04:26:21.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:326: TEST_backfill_test_sametarget: local chk_osd1 2024-09-16T04:26:21.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:327: TEST_backfill_test_sametarget: local chk_osd2 2024-09-16T04:26:21.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:329: TEST_backfill_test_sametarget: local PG2 2024-09-16T04:26:21.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:330: TEST_backfill_test_sametarget: local POOLNUM2 2024-09-16T04:26:21.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:331: TEST_backfill_test_sametarget: local pool2 2024-09-16T04:26:21.260 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:332: TEST_backfill_test_sametarget: seq 1 10 2024-09-16T04:26:21.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:332: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:21.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: ceph pg map 1.0 --format=json 2024-09-16T04:26:21.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: jq '.acting[]' 2024-09-16T04:26:21.699 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: head -1 td/osd-backfill-space/acting 2024-09-16T04:26:21.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: local test_osd1=1 2024-09-16T04:26:21.700 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: tail -1 td/osd-backfill-space/acting 2024-09-16T04:26:21.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: local test_osd2=0 2024-09-16T04:26:21.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:337: TEST_backfill_test_sametarget: '[' 1 = 1 ']' 2024-09-16T04:26:21.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:339: TEST_backfill_test_sametarget: PG1=1.0 2024-09-16T04:26:21.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:340: TEST_backfill_test_sametarget: POOLNUM1=1 2024-09-16T04:26:21.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:341: TEST_backfill_test_sametarget: pool1=test1 2024-09-16T04:26:21.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:342: TEST_backfill_test_sametarget: chk_osd1=1 2024-09-16T04:26:21.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:343: TEST_backfill_test_sametarget: chk_osd2=0 2024-09-16T04:26:21.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:332: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:21.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: ceph pg map 2.0 --format=json 2024-09-16T04:26:21.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: jq '.acting[]' 2024-09-16T04:26:22.152 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: head -1 td/osd-backfill-space/acting 2024-09-16T04:26:22.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: local test_osd1=3 2024-09-16T04:26:22.152 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: tail -1 td/osd-backfill-space/acting 2024-09-16T04:26:22.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: local test_osd2=1 2024-09-16T04:26:22.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:337: TEST_backfill_test_sametarget: '[' 2 = 1 ']' 2024-09-16T04:26:22.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:344: TEST_backfill_test_sametarget: '[' 1 '!=' 3 -a 0 = 1 ']' 2024-09-16T04:26:22.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:332: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:22.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: ceph pg map 3.0 --format=json 2024-09-16T04:26:22.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: jq '.acting[]' 2024-09-16T04:26:22.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: head -1 td/osd-backfill-space/acting 2024-09-16T04:26:22.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: local test_osd1=1 2024-09-16T04:26:22.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: tail -1 td/osd-backfill-space/acting 2024-09-16T04:26:22.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: local test_osd2=2 2024-09-16T04:26:22.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:337: TEST_backfill_test_sametarget: '[' 3 = 1 ']' 2024-09-16T04:26:22.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:344: TEST_backfill_test_sametarget: '[' 1 '!=' 1 -a 0 = 2 ']' 2024-09-16T04:26:22.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:332: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:22.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: ceph pg map 4.0 --format=json 2024-09-16T04:26:22.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:334: TEST_backfill_test_sametarget: jq '.acting[]' 2024-09-16T04:26:23.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: head -1 td/osd-backfill-space/acting 2024-09-16T04:26:23.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:335: TEST_backfill_test_sametarget: local test_osd1=4 2024-09-16T04:26:23.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: tail -1 td/osd-backfill-space/acting 2024-09-16T04:26:23.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:336: TEST_backfill_test_sametarget: local test_osd2=0 2024-09-16T04:26:23.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:337: TEST_backfill_test_sametarget: '[' 4 = 1 ']' 2024-09-16T04:26:23.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:344: TEST_backfill_test_sametarget: '[' 1 '!=' 4 -a 0 = 0 ']' 2024-09-16T04:26:23.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:346: TEST_backfill_test_sametarget: PG2=4.0 2024-09-16T04:26:23.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:347: TEST_backfill_test_sametarget: POOLNUM2=4 2024-09-16T04:26:23.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:348: TEST_backfill_test_sametarget: pool2=test4 2024-09-16T04:26:23.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:349: TEST_backfill_test_sametarget: break 2024-09-16T04:26:23.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:352: TEST_backfill_test_sametarget: rm -f td/osd-backfill-space/acting 2024-09-16T04:26:23.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:354: TEST_backfill_test_sametarget: '[' test4 = '' ']' 2024-09-16T04:26:23.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: seq 1 10 2024-09-16T04:26:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 1 '!=' 1 -a 1 '!=' 4 ']' 2024-09-16T04:26:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 2 '!=' 1 -a 2 '!=' 4 ']' 2024-09-16T04:26:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test2 2024-09-16T04:26:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test2 2024-09-16T04:26:23.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-09-16T04:26:23.581 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' does not exist 2024-09-16T04:26:23.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:23.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 3 '!=' 1 -a 3 '!=' 4 ']' 2024-09-16T04:26:23.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test3 2024-09-16T04:26:23.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test3 2024-09-16T04:26:23.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test3 test3 --yes-i-really-really-mean-it 2024-09-16T04:26:24.192 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test3' does not exist 2024-09-16T04:26:24.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:24.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 4 '!=' 1 -a 4 '!=' 4 ']' 2024-09-16T04:26:24.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:24.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 5 '!=' 1 -a 5 '!=' 4 ']' 2024-09-16T04:26:24.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test5 2024-09-16T04:26:24.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test5 2024-09-16T04:26:24.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test5 test5 --yes-i-really-really-mean-it 2024-09-16T04:26:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test5' does not exist 2024-09-16T04:26:24.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:24.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 6 '!=' 1 -a 6 '!=' 4 ']' 2024-09-16T04:26:24.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test6 2024-09-16T04:26:24.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test6 2024-09-16T04:26:24.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test6 test6 --yes-i-really-really-mean-it 2024-09-16T04:26:25.440 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test6' does not exist 2024-09-16T04:26:25.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:25.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 7 '!=' 1 -a 7 '!=' 4 ']' 2024-09-16T04:26:25.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test7 2024-09-16T04:26:25.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test7 2024-09-16T04:26:25.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test7 test7 --yes-i-really-really-mean-it 2024-09-16T04:26:26.172 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test7' does not exist 2024-09-16T04:26:26.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:26.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 8 '!=' 1 -a 8 '!=' 4 ']' 2024-09-16T04:26:26.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test8 2024-09-16T04:26:26.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test8 2024-09-16T04:26:26.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test8 test8 --yes-i-really-really-mean-it 2024-09-16T04:26:26.752 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test8' does not exist 2024-09-16T04:26:26.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:26.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 9 '!=' 1 -a 9 '!=' 4 ']' 2024-09-16T04:26:26.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test9 2024-09-16T04:26:26.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test9 2024-09-16T04:26:26.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test9 test9 --yes-i-really-really-mean-it 2024-09-16T04:26:27.319 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test9' does not exist 2024-09-16T04:26:27.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:360: TEST_backfill_test_sametarget: for p in $(seq 1 $pools) 2024-09-16T04:26:27.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:362: TEST_backfill_test_sametarget: '[' 10 '!=' 1 -a 10 '!=' 4 ']' 2024-09-16T04:26:27.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:364: TEST_backfill_test_sametarget: delete_pool test10 2024-09-16T04:26:27.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test10 2024-09-16T04:26:27.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test10 test10 --yes-i-really-really-mean-it 2024-09-16T04:26:27.986 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test10' does not exist 2024-09-16T04:26:27.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:368: TEST_backfill_test_sametarget: ceph osd pool set test1 size 1 --yes-i-really-mean-it 2024-09-16T04:26:28.756 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 1 2024-09-16T04:26:28.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:369: TEST_backfill_test_sametarget: ceph osd pool set test4 size 1 --yes-i-really-mean-it 2024-09-16T04:26:30.045 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 4 size to 1 2024-09-16T04:26:30.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:371: TEST_backfill_test_sametarget: wait_for_clean 2024-09-16T04:26:30.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T04:26:30.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T04:26:30.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T04:26:30.060 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T04:26:30.060 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:26:30.060 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:26:30.060 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:26:30.060 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:26:30.060 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:26:30.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T04:26:30.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T04:26:30.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T04:26:30.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T04:26:30.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:26:30.155 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:26:30.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:26:30.691 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:26:30.691 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:26:30.691 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:26:30.691 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T04:26:30.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:26:30.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:26:30.692 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:26:30.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836528 2024-09-16T04:26:30.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836528 2024-09-16T04:26:30.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528' 2024-09-16T04:26:30.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:26:30.884 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:26:31.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672999 2024-09-16T04:26:31.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672999 2024-09-16T04:26:31.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949672999' 2024-09-16T04:26:31.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:26:31.008 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:26:31.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509474 2024-09-16T04:26:31.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509474 2024-09-16T04:26:31.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949672999 2-64424509474' 2024-09-16T04:26:31.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:26:31.141 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:26:31.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345949 2024-09-16T04:26:31.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345949 2024-09-16T04:26:31.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949672999 2-64424509474 3-85899345949' 2024-09-16T04:26:31.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:26:31.265 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:26:31.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182417 2024-09-16T04:26:31.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182417 2024-09-16T04:26:31.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836528 1-42949672999 2-64424509474 3-85899345949 4-107374182417' 2024-09-16T04:26:31.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:26:31.388 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836528 2024-09-16T04:26:31.388 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:26:31.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:26:31.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836528 2024-09-16T04:26:31.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:26:31.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836528 2024-09-16T04:26:31.391 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836528 2024-09-16T04:26:31.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836528' 2024-09-16T04:26:31.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:26:31.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836528 -lt 21474836528 2024-09-16T04:26:31.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:26:31.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672999 2024-09-16T04:26:31.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:26:31.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:26:31.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672999 2024-09-16T04:26:31.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:26:31.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672999 2024-09-16T04:26:31.830 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672999 2024-09-16T04:26:31.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672999' 2024-09-16T04:26:31.830 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:26:32.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672999 -lt 42949672999 2024-09-16T04:26:32.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:26:32.278 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509474 2024-09-16T04:26:32.279 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:26:32.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:26:32.280 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509474 2024-09-16T04:26:32.280 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:26:32.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509474 2024-09-16T04:26:32.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509474' 2024-09-16T04:26:32.281 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509474 2024-09-16T04:26:32.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:26:32.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509472 -lt 64424509474 2024-09-16T04:26:32.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:26:33.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:26:33.723 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:26:34.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509474 -lt 64424509474 2024-09-16T04:26:34.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:26:34.200 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345949 2024-09-16T04:26:34.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:26:34.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:26:34.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345949 2024-09-16T04:26:34.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:26:34.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345949 2024-09-16T04:26:34.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345949' 2024-09-16T04:26:34.202 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345949 2024-09-16T04:26:34.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:26:34.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345949 -lt 85899345949 2024-09-16T04:26:34.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:26:34.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182417 2024-09-16T04:26:34.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:26:34.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:26:34.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182417 2024-09-16T04:26:34.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:26:34.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182417 2024-09-16T04:26:34.654 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182417 2024-09-16T04:26:34.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182417' 2024-09-16T04:26:34.654 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:26:35.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182417 -lt 107374182417 2024-09-16T04:26:35.117 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T04:26:35.117 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:26:35.117 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:26:35.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 2 == 0 2024-09-16T04:26:35.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:26:35.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:26:35.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:26:35.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:26:35.716 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:26:35.716 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:26:35.716 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:26:36.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T04:26:36.122 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:26:36.122 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:26:36.122 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:26:36.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 2 2024-09-16T04:26:36.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T04:26:36.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T04:26:36.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:373: TEST_backfill_test_sametarget: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=4 2024-09-16T04:26:36.678 INFO:tasks.workunit.client.0.smithi026.stderr:4+0 records in 2024-09-16T04:26:36.678 INFO:tasks.workunit.client.0.smithi026.stderr:4+0 records out 2024-09-16T04:26:36.679 INFO:tasks.workunit.client.0.smithi026.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 6.4091e-05 s, 63.9 MB/s 2024-09-16T04:26:36.679 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: seq 1 600 2024-09-16T04:26:36.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:36.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:26:36.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:26:36.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:36.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:26:37.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:26:37.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:37.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:26:37.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:26:37.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:37.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:26:37.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:26:37.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:37.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:26:37.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:26:37.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:37.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:26:37.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:26:37.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:37.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:26:37.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:26:38.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:38.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:26:38.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:26:38.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:38.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:26:38.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:26:38.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:38.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:26:38.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:26:38.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:38.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:26:38.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:26:38.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:38.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:26:38.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:26:38.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:38.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:26:39.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:26:39.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:39.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:26:39.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:26:39.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:39.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:26:39.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:26:39.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:39.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:26:39.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:26:39.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:39.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:26:39.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:26:39.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:39.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:26:39.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:26:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:26:40.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:26:40.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:40.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:26:40.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:26:40.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:40.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:26:40.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:26:40.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:40.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:26:40.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:26:40.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:40.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:26:40.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:26:40.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:40.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:26:41.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:26:41.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:41.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:26:41.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:26:41.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:41.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:26:41.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:26:41.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:41.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:26:41.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:26:41.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:41.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:26:41.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:26:41.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:41.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:26:41.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:26:42.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:42.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:26:42.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:26:42.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:42.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:26:42.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:26:42.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:42.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:26:42.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:26:42.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:42.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:26:42.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:26:42.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:42.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:26:42.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:26:42.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:42.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:26:43.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:26:43.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:43.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:26:43.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:26:43.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:43.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:26:43.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:26:43.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:43.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:26:43.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:26:43.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:43.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:26:43.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:26:43.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:43.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:26:43.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:26:44.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:44.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:26:44.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:26:44.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:44.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:26:44.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:26:44.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:44.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:26:44.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:26:44.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:44.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:26:44.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:26:44.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:44.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:26:44.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:26:44.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:44.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:26:44.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:26:45.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:45.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:26:45.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:26:45.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:45.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:26:45.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:26:45.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:45.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:26:45.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:26:45.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:45.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:26:45.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:26:45.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:45.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:26:45.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:26:45.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:45.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:26:46.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:26:46.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:46.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:26:46.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:26:46.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:46.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:26:46.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:26:46.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:46.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:26:46.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:26:46.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:46.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:26:46.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:26:46.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:46.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:26:46.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:26:46.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:46.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:26:47.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:26:47.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:47.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:26:47.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:26:47.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:47.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:26:47.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:26:47.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:47.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:26:47.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:26:47.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:47.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:26:47.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:26:47.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:47.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:26:47.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:26:48.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:48.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:26:48.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:26:48.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:48.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:26:48.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:26:48.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:48.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:26:48.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:26:48.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:48.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:26:48.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:26:48.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:48.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:26:48.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:26:48.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:48.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:26:49.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:26:49.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:49.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:26:49.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:26:49.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:49.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:26:49.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:26:49.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:49.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:26:49.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:26:49.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:49.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:26:49.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:26:49.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:49.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:26:49.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:26:50.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:50.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:26:50.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:26:50.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:50.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:26:50.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:26:50.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:50.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:26:50.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:26:50.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:50.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:26:50.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:26:50.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:50.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:26:50.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:26:50.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:50.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:26:51.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:26:51.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:51.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:26:51.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:26:51.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:51.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:26:51.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:26:51.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:51.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:26:51.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:26:51.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:51.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:26:52.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:26:52.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:52.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:26:52.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:26:52.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:52.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:26:52.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:26:52.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:52.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:26:52.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:26:52.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:52.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:26:52.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:26:52.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:52.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:26:52.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:26:53.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:53.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:26:53.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:26:53.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:53.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:26:53.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:26:53.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:53.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:26:53.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:26:53.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:53.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:26:53.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:26:53.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:53.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:26:53.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:26:53.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:53.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:26:54.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:26:54.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:54.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:26:54.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:26:54.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:54.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:26:54.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:26:54.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:54.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:26:54.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:26:54.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:54.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:26:54.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:26:54.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:54.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:26:54.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:26:54.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:54.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:26:55.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:26:55.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:55.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:26:55.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:26:55.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:55.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:26:55.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:26:55.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:55.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:26:55.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:26:55.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:55.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:26:55.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:26:55.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:55.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:26:55.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:26:56.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:56.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:26:56.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:26:56.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:56.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:26:56.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:26:56.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:56.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:26:56.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:26:56.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:56.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:26:56.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:26:56.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:56.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:26:56.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:26:56.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:56.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:26:57.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:26:57.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:57.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:26:57.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:26:57.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:57.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:26:57.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:26:57.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:57.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:26:57.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:26:57.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:57.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:26:57.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:26:57.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:57.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:26:57.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:26:58.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:58.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:26:58.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:26:58.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:58.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:26:58.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:26:58.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:58.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:26:58.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:26:58.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:58.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:26:58.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:26:58.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:58.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:26:58.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:26:58.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:58.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:26:58.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:26:59.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:59.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:26:59.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:26:59.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:59.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:26:59.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:26:59.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:59.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:26:59.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:26:59.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:59.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:26:59.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:26:59.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:59.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:26:59.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:26:59.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:26:59.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:27:00.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:27:00.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:00.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:27:00.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:27:00.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:00.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:27:00.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:27:00.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:00.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:27:00.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:27:00.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:00.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:27:00.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:27:00.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:00.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:27:00.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:27:00.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:00.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:27:01.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:27:01.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:01.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:27:01.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:27:01.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:01.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:27:01.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:27:01.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:01.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:27:01.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:27:01.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:01.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:27:01.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:27:01.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:01.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:27:02.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:27:02.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:02.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:27:02.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:27:02.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:02.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:27:02.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:27:02.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:02.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:27:02.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:27:02.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:02.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:27:02.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:27:02.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:02.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:27:02.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:27:02.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:02.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:27:03.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:27:03.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:03.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:27:03.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:27:03.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:03.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:27:03.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:27:03.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:03.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:27:03.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:27:03.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:03.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:27:03.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:27:03.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:03.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:27:03.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:27:04.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:04.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:27:04.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:27:04.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:04.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:27:04.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:27:04.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:04.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:27:04.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:27:04.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:04.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:27:04.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:27:04.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:04.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:27:04.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:27:04.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:04.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:27:05.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:27:05.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:05.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:27:05.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:27:05.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:05.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:27:05.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:27:05.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:05.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:27:05.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:27:05.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:05.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:27:05.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:27:05.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:05.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:27:05.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:27:06.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:06.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:27:06.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:27:06.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:06.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:27:06.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:27:06.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:06.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:27:06.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:27:06.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:06.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:27:06.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:27:06.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:06.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:27:06.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:27:06.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:06.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:27:06.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:27:07.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:07.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:27:07.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:27:07.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:07.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:27:07.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:27:07.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:07.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:27:07.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:27:07.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:07.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:27:07.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:27:07.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:07.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:27:07.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:27:08.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:08.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:27:08.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:27:08.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:08.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:27:08.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:27:08.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:08.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:27:08.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:27:08.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:08.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:27:08.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:27:08.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:08.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:27:08.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:27:08.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:08.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:27:09.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:27:09.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:09.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:27:09.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:27:09.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:09.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:27:09.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:27:09.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:09.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:27:09.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:27:09.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:09.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:27:09.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:27:09.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:09.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:27:09.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:27:10.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:10.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:27:10.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:27:10.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:10.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:27:10.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:27:10.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:10.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:27:10.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:27:10.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:10.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:27:10.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:27:10.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:10.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:27:10.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:27:10.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:10.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:27:11.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:27:11.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:11.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:27:11.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:27:11.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:11.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:27:11.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:27:11.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:11.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:27:11.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:27:11.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:11.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:27:11.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:27:11.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:11.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:27:11.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:27:12.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:12.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:27:12.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:27:12.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:12.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:27:12.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:27:12.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:12.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:27:12.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:27:12.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:12.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:27:12.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:27:12.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:12.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:27:12.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:27:12.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:12.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj201 td/osd-backfill-space/datafile 2024-09-16T04:27:13.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj201 td/osd-backfill-space/datafile 2024-09-16T04:27:13.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:13.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj202 td/osd-backfill-space/datafile 2024-09-16T04:27:13.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj202 td/osd-backfill-space/datafile 2024-09-16T04:27:13.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:13.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj203 td/osd-backfill-space/datafile 2024-09-16T04:27:13.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj203 td/osd-backfill-space/datafile 2024-09-16T04:27:13.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:13.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj204 td/osd-backfill-space/datafile 2024-09-16T04:27:13.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj204 td/osd-backfill-space/datafile 2024-09-16T04:27:13.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:13.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj205 td/osd-backfill-space/datafile 2024-09-16T04:27:13.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj205 td/osd-backfill-space/datafile 2024-09-16T04:27:13.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:13.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj206 td/osd-backfill-space/datafile 2024-09-16T04:27:14.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj206 td/osd-backfill-space/datafile 2024-09-16T04:27:14.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:14.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj207 td/osd-backfill-space/datafile 2024-09-16T04:27:14.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj207 td/osd-backfill-space/datafile 2024-09-16T04:27:14.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:14.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj208 td/osd-backfill-space/datafile 2024-09-16T04:27:14.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj208 td/osd-backfill-space/datafile 2024-09-16T04:27:14.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:14.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj209 td/osd-backfill-space/datafile 2024-09-16T04:27:14.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj209 td/osd-backfill-space/datafile 2024-09-16T04:27:14.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:14.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj210 td/osd-backfill-space/datafile 2024-09-16T04:27:14.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj210 td/osd-backfill-space/datafile 2024-09-16T04:27:14.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:14.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj211 td/osd-backfill-space/datafile 2024-09-16T04:27:14.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj211 td/osd-backfill-space/datafile 2024-09-16T04:27:14.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:14.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj212 td/osd-backfill-space/datafile 2024-09-16T04:27:15.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj212 td/osd-backfill-space/datafile 2024-09-16T04:27:15.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:15.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj213 td/osd-backfill-space/datafile 2024-09-16T04:27:15.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj213 td/osd-backfill-space/datafile 2024-09-16T04:27:15.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:15.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj214 td/osd-backfill-space/datafile 2024-09-16T04:27:15.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj214 td/osd-backfill-space/datafile 2024-09-16T04:27:15.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:15.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj215 td/osd-backfill-space/datafile 2024-09-16T04:27:15.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj215 td/osd-backfill-space/datafile 2024-09-16T04:27:15.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:15.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj216 td/osd-backfill-space/datafile 2024-09-16T04:27:15.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj216 td/osd-backfill-space/datafile 2024-09-16T04:27:15.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:15.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj217 td/osd-backfill-space/datafile 2024-09-16T04:27:16.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj217 td/osd-backfill-space/datafile 2024-09-16T04:27:16.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:16.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj218 td/osd-backfill-space/datafile 2024-09-16T04:27:16.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj218 td/osd-backfill-space/datafile 2024-09-16T04:27:16.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:16.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj219 td/osd-backfill-space/datafile 2024-09-16T04:27:16.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj219 td/osd-backfill-space/datafile 2024-09-16T04:27:16.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:16.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj220 td/osd-backfill-space/datafile 2024-09-16T04:27:16.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj220 td/osd-backfill-space/datafile 2024-09-16T04:27:16.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:16.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj221 td/osd-backfill-space/datafile 2024-09-16T04:27:16.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj221 td/osd-backfill-space/datafile 2024-09-16T04:27:16.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:16.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj222 td/osd-backfill-space/datafile 2024-09-16T04:27:16.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj222 td/osd-backfill-space/datafile 2024-09-16T04:27:16.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:16.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj223 td/osd-backfill-space/datafile 2024-09-16T04:27:17.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj223 td/osd-backfill-space/datafile 2024-09-16T04:27:17.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:17.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj224 td/osd-backfill-space/datafile 2024-09-16T04:27:17.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj224 td/osd-backfill-space/datafile 2024-09-16T04:27:17.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:17.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj225 td/osd-backfill-space/datafile 2024-09-16T04:27:17.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj225 td/osd-backfill-space/datafile 2024-09-16T04:27:17.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:17.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj226 td/osd-backfill-space/datafile 2024-09-16T04:27:17.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj226 td/osd-backfill-space/datafile 2024-09-16T04:27:17.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:17.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj227 td/osd-backfill-space/datafile 2024-09-16T04:27:17.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj227 td/osd-backfill-space/datafile 2024-09-16T04:27:17.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:17.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj228 td/osd-backfill-space/datafile 2024-09-16T04:27:17.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj228 td/osd-backfill-space/datafile 2024-09-16T04:27:18.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:18.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj229 td/osd-backfill-space/datafile 2024-09-16T04:27:18.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj229 td/osd-backfill-space/datafile 2024-09-16T04:27:18.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:18.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj230 td/osd-backfill-space/datafile 2024-09-16T04:27:18.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj230 td/osd-backfill-space/datafile 2024-09-16T04:27:18.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:18.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj231 td/osd-backfill-space/datafile 2024-09-16T04:27:18.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj231 td/osd-backfill-space/datafile 2024-09-16T04:27:18.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:18.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj232 td/osd-backfill-space/datafile 2024-09-16T04:27:18.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj232 td/osd-backfill-space/datafile 2024-09-16T04:27:18.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:18.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj233 td/osd-backfill-space/datafile 2024-09-16T04:27:18.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj233 td/osd-backfill-space/datafile 2024-09-16T04:27:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj234 td/osd-backfill-space/datafile 2024-09-16T04:27:19.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj234 td/osd-backfill-space/datafile 2024-09-16T04:27:19.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:19.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj235 td/osd-backfill-space/datafile 2024-09-16T04:27:19.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj235 td/osd-backfill-space/datafile 2024-09-16T04:27:19.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:19.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj236 td/osd-backfill-space/datafile 2024-09-16T04:27:19.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj236 td/osd-backfill-space/datafile 2024-09-16T04:27:19.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:19.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj237 td/osd-backfill-space/datafile 2024-09-16T04:27:19.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj237 td/osd-backfill-space/datafile 2024-09-16T04:27:19.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:19.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj238 td/osd-backfill-space/datafile 2024-09-16T04:27:19.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj238 td/osd-backfill-space/datafile 2024-09-16T04:27:19.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:19.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj239 td/osd-backfill-space/datafile 2024-09-16T04:27:19.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj239 td/osd-backfill-space/datafile 2024-09-16T04:27:20.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:20.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj240 td/osd-backfill-space/datafile 2024-09-16T04:27:20.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj240 td/osd-backfill-space/datafile 2024-09-16T04:27:20.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:20.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj241 td/osd-backfill-space/datafile 2024-09-16T04:27:20.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj241 td/osd-backfill-space/datafile 2024-09-16T04:27:20.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:20.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj242 td/osd-backfill-space/datafile 2024-09-16T04:27:20.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj242 td/osd-backfill-space/datafile 2024-09-16T04:27:20.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:20.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj243 td/osd-backfill-space/datafile 2024-09-16T04:27:20.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj243 td/osd-backfill-space/datafile 2024-09-16T04:27:20.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:20.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj244 td/osd-backfill-space/datafile 2024-09-16T04:27:20.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj244 td/osd-backfill-space/datafile 2024-09-16T04:27:20.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:20.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj245 td/osd-backfill-space/datafile 2024-09-16T04:27:21.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj245 td/osd-backfill-space/datafile 2024-09-16T04:27:21.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:21.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj246 td/osd-backfill-space/datafile 2024-09-16T04:27:21.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj246 td/osd-backfill-space/datafile 2024-09-16T04:27:21.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:21.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj247 td/osd-backfill-space/datafile 2024-09-16T04:27:21.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj247 td/osd-backfill-space/datafile 2024-09-16T04:27:21.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:21.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj248 td/osd-backfill-space/datafile 2024-09-16T04:27:21.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj248 td/osd-backfill-space/datafile 2024-09-16T04:27:21.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:21.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj249 td/osd-backfill-space/datafile 2024-09-16T04:27:21.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj249 td/osd-backfill-space/datafile 2024-09-16T04:27:21.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:21.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj250 td/osd-backfill-space/datafile 2024-09-16T04:27:21.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj250 td/osd-backfill-space/datafile 2024-09-16T04:27:21.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:21.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj251 td/osd-backfill-space/datafile 2024-09-16T04:27:22.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj251 td/osd-backfill-space/datafile 2024-09-16T04:27:22.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:22.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj252 td/osd-backfill-space/datafile 2024-09-16T04:27:22.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj252 td/osd-backfill-space/datafile 2024-09-16T04:27:22.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:22.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj253 td/osd-backfill-space/datafile 2024-09-16T04:27:22.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj253 td/osd-backfill-space/datafile 2024-09-16T04:27:22.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:22.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj254 td/osd-backfill-space/datafile 2024-09-16T04:27:22.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj254 td/osd-backfill-space/datafile 2024-09-16T04:27:22.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:22.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj255 td/osd-backfill-space/datafile 2024-09-16T04:27:22.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj255 td/osd-backfill-space/datafile 2024-09-16T04:27:23.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:23.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj256 td/osd-backfill-space/datafile 2024-09-16T04:27:23.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj256 td/osd-backfill-space/datafile 2024-09-16T04:27:23.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:23.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj257 td/osd-backfill-space/datafile 2024-09-16T04:27:23.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj257 td/osd-backfill-space/datafile 2024-09-16T04:27:23.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:23.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj258 td/osd-backfill-space/datafile 2024-09-16T04:27:23.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj258 td/osd-backfill-space/datafile 2024-09-16T04:27:23.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:23.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj259 td/osd-backfill-space/datafile 2024-09-16T04:27:23.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj259 td/osd-backfill-space/datafile 2024-09-16T04:27:24.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:24.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj260 td/osd-backfill-space/datafile 2024-09-16T04:27:24.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj260 td/osd-backfill-space/datafile 2024-09-16T04:27:24.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:24.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj261 td/osd-backfill-space/datafile 2024-09-16T04:27:24.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj261 td/osd-backfill-space/datafile 2024-09-16T04:27:24.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:24.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj262 td/osd-backfill-space/datafile 2024-09-16T04:27:24.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj262 td/osd-backfill-space/datafile 2024-09-16T04:27:24.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:24.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj263 td/osd-backfill-space/datafile 2024-09-16T04:27:24.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj263 td/osd-backfill-space/datafile 2024-09-16T04:27:24.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:24.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj264 td/osd-backfill-space/datafile 2024-09-16T04:27:24.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj264 td/osd-backfill-space/datafile 2024-09-16T04:27:24.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:24.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj265 td/osd-backfill-space/datafile 2024-09-16T04:27:25.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj265 td/osd-backfill-space/datafile 2024-09-16T04:27:25.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:25.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj266 td/osd-backfill-space/datafile 2024-09-16T04:27:25.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj266 td/osd-backfill-space/datafile 2024-09-16T04:27:25.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:25.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj267 td/osd-backfill-space/datafile 2024-09-16T04:27:25.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj267 td/osd-backfill-space/datafile 2024-09-16T04:27:25.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:25.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj268 td/osd-backfill-space/datafile 2024-09-16T04:27:25.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj268 td/osd-backfill-space/datafile 2024-09-16T04:27:25.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:25.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj269 td/osd-backfill-space/datafile 2024-09-16T04:27:25.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj269 td/osd-backfill-space/datafile 2024-09-16T04:27:25.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:25.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj270 td/osd-backfill-space/datafile 2024-09-16T04:27:25.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj270 td/osd-backfill-space/datafile 2024-09-16T04:27:26.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:26.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj271 td/osd-backfill-space/datafile 2024-09-16T04:27:26.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj271 td/osd-backfill-space/datafile 2024-09-16T04:27:26.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:26.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj272 td/osd-backfill-space/datafile 2024-09-16T04:27:26.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj272 td/osd-backfill-space/datafile 2024-09-16T04:27:26.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:26.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj273 td/osd-backfill-space/datafile 2024-09-16T04:27:26.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj273 td/osd-backfill-space/datafile 2024-09-16T04:27:26.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:26.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj274 td/osd-backfill-space/datafile 2024-09-16T04:27:26.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj274 td/osd-backfill-space/datafile 2024-09-16T04:27:26.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:26.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj275 td/osd-backfill-space/datafile 2024-09-16T04:27:26.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj275 td/osd-backfill-space/datafile 2024-09-16T04:27:26.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:26.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj276 td/osd-backfill-space/datafile 2024-09-16T04:27:27.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj276 td/osd-backfill-space/datafile 2024-09-16T04:27:27.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:27.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj277 td/osd-backfill-space/datafile 2024-09-16T04:27:27.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj277 td/osd-backfill-space/datafile 2024-09-16T04:27:27.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:27.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj278 td/osd-backfill-space/datafile 2024-09-16T04:27:27.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj278 td/osd-backfill-space/datafile 2024-09-16T04:27:27.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:27.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj279 td/osd-backfill-space/datafile 2024-09-16T04:27:27.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj279 td/osd-backfill-space/datafile 2024-09-16T04:27:27.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:27.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj280 td/osd-backfill-space/datafile 2024-09-16T04:27:27.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj280 td/osd-backfill-space/datafile 2024-09-16T04:27:27.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:27.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj281 td/osd-backfill-space/datafile 2024-09-16T04:27:27.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj281 td/osd-backfill-space/datafile 2024-09-16T04:27:28.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:28.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj282 td/osd-backfill-space/datafile 2024-09-16T04:27:28.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj282 td/osd-backfill-space/datafile 2024-09-16T04:27:28.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:28.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj283 td/osd-backfill-space/datafile 2024-09-16T04:27:28.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj283 td/osd-backfill-space/datafile 2024-09-16T04:27:28.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:28.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj284 td/osd-backfill-space/datafile 2024-09-16T04:27:28.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj284 td/osd-backfill-space/datafile 2024-09-16T04:27:28.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:28.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj285 td/osd-backfill-space/datafile 2024-09-16T04:27:28.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj285 td/osd-backfill-space/datafile 2024-09-16T04:27:28.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:28.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj286 td/osd-backfill-space/datafile 2024-09-16T04:27:28.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj286 td/osd-backfill-space/datafile 2024-09-16T04:27:28.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:28.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj287 td/osd-backfill-space/datafile 2024-09-16T04:27:29.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj287 td/osd-backfill-space/datafile 2024-09-16T04:27:29.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:29.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj288 td/osd-backfill-space/datafile 2024-09-16T04:27:29.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj288 td/osd-backfill-space/datafile 2024-09-16T04:27:29.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:29.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj289 td/osd-backfill-space/datafile 2024-09-16T04:27:29.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj289 td/osd-backfill-space/datafile 2024-09-16T04:27:29.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:29.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj290 td/osd-backfill-space/datafile 2024-09-16T04:27:29.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj290 td/osd-backfill-space/datafile 2024-09-16T04:27:29.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:29.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj291 td/osd-backfill-space/datafile 2024-09-16T04:27:29.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj291 td/osd-backfill-space/datafile 2024-09-16T04:27:29.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:29.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj292 td/osd-backfill-space/datafile 2024-09-16T04:27:29.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj292 td/osd-backfill-space/datafile 2024-09-16T04:27:30.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:30.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj293 td/osd-backfill-space/datafile 2024-09-16T04:27:30.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj293 td/osd-backfill-space/datafile 2024-09-16T04:27:30.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:30.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj294 td/osd-backfill-space/datafile 2024-09-16T04:27:30.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj294 td/osd-backfill-space/datafile 2024-09-16T04:27:30.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:30.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj295 td/osd-backfill-space/datafile 2024-09-16T04:27:30.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj295 td/osd-backfill-space/datafile 2024-09-16T04:27:30.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:30.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj296 td/osd-backfill-space/datafile 2024-09-16T04:27:30.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj296 td/osd-backfill-space/datafile 2024-09-16T04:27:30.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:30.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj297 td/osd-backfill-space/datafile 2024-09-16T04:27:30.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj297 td/osd-backfill-space/datafile 2024-09-16T04:27:30.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:30.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj298 td/osd-backfill-space/datafile 2024-09-16T04:27:31.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj298 td/osd-backfill-space/datafile 2024-09-16T04:27:31.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:31.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj299 td/osd-backfill-space/datafile 2024-09-16T04:27:31.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj299 td/osd-backfill-space/datafile 2024-09-16T04:27:31.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:31.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj300 td/osd-backfill-space/datafile 2024-09-16T04:27:31.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj300 td/osd-backfill-space/datafile 2024-09-16T04:27:31.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:31.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj301 td/osd-backfill-space/datafile 2024-09-16T04:27:31.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj301 td/osd-backfill-space/datafile 2024-09-16T04:27:31.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:31.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj302 td/osd-backfill-space/datafile 2024-09-16T04:27:31.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj302 td/osd-backfill-space/datafile 2024-09-16T04:27:31.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:31.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj303 td/osd-backfill-space/datafile 2024-09-16T04:27:31.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj303 td/osd-backfill-space/datafile 2024-09-16T04:27:32.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:32.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj304 td/osd-backfill-space/datafile 2024-09-16T04:27:32.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj304 td/osd-backfill-space/datafile 2024-09-16T04:27:32.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:32.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj305 td/osd-backfill-space/datafile 2024-09-16T04:27:32.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj305 td/osd-backfill-space/datafile 2024-09-16T04:27:32.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:32.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj306 td/osd-backfill-space/datafile 2024-09-16T04:27:32.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj306 td/osd-backfill-space/datafile 2024-09-16T04:27:32.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:32.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj307 td/osd-backfill-space/datafile 2024-09-16T04:27:32.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj307 td/osd-backfill-space/datafile 2024-09-16T04:27:32.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:32.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj308 td/osd-backfill-space/datafile 2024-09-16T04:27:32.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj308 td/osd-backfill-space/datafile 2024-09-16T04:27:32.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:32.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj309 td/osd-backfill-space/datafile 2024-09-16T04:27:32.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj309 td/osd-backfill-space/datafile 2024-09-16T04:27:33.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:33.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj310 td/osd-backfill-space/datafile 2024-09-16T04:27:33.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj310 td/osd-backfill-space/datafile 2024-09-16T04:27:33.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:33.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj311 td/osd-backfill-space/datafile 2024-09-16T04:27:33.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj311 td/osd-backfill-space/datafile 2024-09-16T04:27:33.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:33.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj312 td/osd-backfill-space/datafile 2024-09-16T04:27:33.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj312 td/osd-backfill-space/datafile 2024-09-16T04:27:33.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:33.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj313 td/osd-backfill-space/datafile 2024-09-16T04:27:33.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj313 td/osd-backfill-space/datafile 2024-09-16T04:27:33.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:33.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj314 td/osd-backfill-space/datafile 2024-09-16T04:27:33.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj314 td/osd-backfill-space/datafile 2024-09-16T04:27:33.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:33.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj315 td/osd-backfill-space/datafile 2024-09-16T04:27:33.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj315 td/osd-backfill-space/datafile 2024-09-16T04:27:33.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:33.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj316 td/osd-backfill-space/datafile 2024-09-16T04:27:34.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj316 td/osd-backfill-space/datafile 2024-09-16T04:27:34.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:34.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj317 td/osd-backfill-space/datafile 2024-09-16T04:27:34.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj317 td/osd-backfill-space/datafile 2024-09-16T04:27:34.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:34.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj318 td/osd-backfill-space/datafile 2024-09-16T04:27:34.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj318 td/osd-backfill-space/datafile 2024-09-16T04:27:34.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:34.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj319 td/osd-backfill-space/datafile 2024-09-16T04:27:34.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj319 td/osd-backfill-space/datafile 2024-09-16T04:27:34.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:34.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj320 td/osd-backfill-space/datafile 2024-09-16T04:27:34.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj320 td/osd-backfill-space/datafile 2024-09-16T04:27:34.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:34.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj321 td/osd-backfill-space/datafile 2024-09-16T04:27:34.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj321 td/osd-backfill-space/datafile 2024-09-16T04:27:34.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:34.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj322 td/osd-backfill-space/datafile 2024-09-16T04:27:35.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj322 td/osd-backfill-space/datafile 2024-09-16T04:27:35.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:35.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj323 td/osd-backfill-space/datafile 2024-09-16T04:27:35.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj323 td/osd-backfill-space/datafile 2024-09-16T04:27:35.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:35.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj324 td/osd-backfill-space/datafile 2024-09-16T04:27:35.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj324 td/osd-backfill-space/datafile 2024-09-16T04:27:35.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:35.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj325 td/osd-backfill-space/datafile 2024-09-16T04:27:35.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj325 td/osd-backfill-space/datafile 2024-09-16T04:27:35.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:35.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj326 td/osd-backfill-space/datafile 2024-09-16T04:27:35.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj326 td/osd-backfill-space/datafile 2024-09-16T04:27:35.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:35.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj327 td/osd-backfill-space/datafile 2024-09-16T04:27:35.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj327 td/osd-backfill-space/datafile 2024-09-16T04:27:35.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:35.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj328 td/osd-backfill-space/datafile 2024-09-16T04:27:36.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj328 td/osd-backfill-space/datafile 2024-09-16T04:27:36.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:36.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj329 td/osd-backfill-space/datafile 2024-09-16T04:27:36.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj329 td/osd-backfill-space/datafile 2024-09-16T04:27:36.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:36.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj330 td/osd-backfill-space/datafile 2024-09-16T04:27:36.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj330 td/osd-backfill-space/datafile 2024-09-16T04:27:36.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:36.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj331 td/osd-backfill-space/datafile 2024-09-16T04:27:36.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj331 td/osd-backfill-space/datafile 2024-09-16T04:27:36.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:36.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj332 td/osd-backfill-space/datafile 2024-09-16T04:27:36.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj332 td/osd-backfill-space/datafile 2024-09-16T04:27:36.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:36.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj333 td/osd-backfill-space/datafile 2024-09-16T04:27:36.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj333 td/osd-backfill-space/datafile 2024-09-16T04:27:36.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:36.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj334 td/osd-backfill-space/datafile 2024-09-16T04:27:36.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj334 td/osd-backfill-space/datafile 2024-09-16T04:27:36.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:36.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj335 td/osd-backfill-space/datafile 2024-09-16T04:27:37.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj335 td/osd-backfill-space/datafile 2024-09-16T04:27:37.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:37.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj336 td/osd-backfill-space/datafile 2024-09-16T04:27:37.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj336 td/osd-backfill-space/datafile 2024-09-16T04:27:37.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:37.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj337 td/osd-backfill-space/datafile 2024-09-16T04:27:37.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj337 td/osd-backfill-space/datafile 2024-09-16T04:27:37.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:37.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj338 td/osd-backfill-space/datafile 2024-09-16T04:27:37.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj338 td/osd-backfill-space/datafile 2024-09-16T04:27:37.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:37.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj339 td/osd-backfill-space/datafile 2024-09-16T04:27:37.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj339 td/osd-backfill-space/datafile 2024-09-16T04:27:37.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:37.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj340 td/osd-backfill-space/datafile 2024-09-16T04:27:37.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj340 td/osd-backfill-space/datafile 2024-09-16T04:27:37.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:37.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj341 td/osd-backfill-space/datafile 2024-09-16T04:27:37.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj341 td/osd-backfill-space/datafile 2024-09-16T04:27:37.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:37.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj342 td/osd-backfill-space/datafile 2024-09-16T04:27:37.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj342 td/osd-backfill-space/datafile 2024-09-16T04:27:38.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:38.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj343 td/osd-backfill-space/datafile 2024-09-16T04:27:38.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj343 td/osd-backfill-space/datafile 2024-09-16T04:27:38.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:38.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj344 td/osd-backfill-space/datafile 2024-09-16T04:27:38.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj344 td/osd-backfill-space/datafile 2024-09-16T04:27:38.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:38.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj345 td/osd-backfill-space/datafile 2024-09-16T04:27:38.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj345 td/osd-backfill-space/datafile 2024-09-16T04:27:38.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:38.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj346 td/osd-backfill-space/datafile 2024-09-16T04:27:38.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj346 td/osd-backfill-space/datafile 2024-09-16T04:27:38.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:38.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj347 td/osd-backfill-space/datafile 2024-09-16T04:27:38.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj347 td/osd-backfill-space/datafile 2024-09-16T04:27:38.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:38.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj348 td/osd-backfill-space/datafile 2024-09-16T04:27:38.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj348 td/osd-backfill-space/datafile 2024-09-16T04:27:38.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:38.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj349 td/osd-backfill-space/datafile 2024-09-16T04:27:38.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj349 td/osd-backfill-space/datafile 2024-09-16T04:27:39.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:39.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj350 td/osd-backfill-space/datafile 2024-09-16T04:27:39.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj350 td/osd-backfill-space/datafile 2024-09-16T04:27:39.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:39.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj351 td/osd-backfill-space/datafile 2024-09-16T04:27:39.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj351 td/osd-backfill-space/datafile 2024-09-16T04:27:39.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:39.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj352 td/osd-backfill-space/datafile 2024-09-16T04:27:39.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj352 td/osd-backfill-space/datafile 2024-09-16T04:27:39.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:39.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj353 td/osd-backfill-space/datafile 2024-09-16T04:27:39.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj353 td/osd-backfill-space/datafile 2024-09-16T04:27:39.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:39.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj354 td/osd-backfill-space/datafile 2024-09-16T04:27:39.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj354 td/osd-backfill-space/datafile 2024-09-16T04:27:39.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:39.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj355 td/osd-backfill-space/datafile 2024-09-16T04:27:39.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj355 td/osd-backfill-space/datafile 2024-09-16T04:27:39.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:39.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj356 td/osd-backfill-space/datafile 2024-09-16T04:27:39.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj356 td/osd-backfill-space/datafile 2024-09-16T04:27:40.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:40.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj357 td/osd-backfill-space/datafile 2024-09-16T04:27:40.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj357 td/osd-backfill-space/datafile 2024-09-16T04:27:40.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:40.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj358 td/osd-backfill-space/datafile 2024-09-16T04:27:40.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj358 td/osd-backfill-space/datafile 2024-09-16T04:27:40.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:40.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj359 td/osd-backfill-space/datafile 2024-09-16T04:27:40.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj359 td/osd-backfill-space/datafile 2024-09-16T04:27:40.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:40.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj360 td/osd-backfill-space/datafile 2024-09-16T04:27:40.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj360 td/osd-backfill-space/datafile 2024-09-16T04:27:40.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:40.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj361 td/osd-backfill-space/datafile 2024-09-16T04:27:40.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj361 td/osd-backfill-space/datafile 2024-09-16T04:27:40.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:40.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj362 td/osd-backfill-space/datafile 2024-09-16T04:27:40.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj362 td/osd-backfill-space/datafile 2024-09-16T04:27:40.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:40.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj363 td/osd-backfill-space/datafile 2024-09-16T04:27:40.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj363 td/osd-backfill-space/datafile 2024-09-16T04:27:40.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:40.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj364 td/osd-backfill-space/datafile 2024-09-16T04:27:41.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj364 td/osd-backfill-space/datafile 2024-09-16T04:27:41.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:41.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj365 td/osd-backfill-space/datafile 2024-09-16T04:27:41.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj365 td/osd-backfill-space/datafile 2024-09-16T04:27:41.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:41.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj366 td/osd-backfill-space/datafile 2024-09-16T04:27:41.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj366 td/osd-backfill-space/datafile 2024-09-16T04:27:41.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:41.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj367 td/osd-backfill-space/datafile 2024-09-16T04:27:41.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj367 td/osd-backfill-space/datafile 2024-09-16T04:27:41.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:41.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj368 td/osd-backfill-space/datafile 2024-09-16T04:27:41.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj368 td/osd-backfill-space/datafile 2024-09-16T04:27:41.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:41.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj369 td/osd-backfill-space/datafile 2024-09-16T04:27:41.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj369 td/osd-backfill-space/datafile 2024-09-16T04:27:41.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:41.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj370 td/osd-backfill-space/datafile 2024-09-16T04:27:41.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj370 td/osd-backfill-space/datafile 2024-09-16T04:27:41.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:41.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj371 td/osd-backfill-space/datafile 2024-09-16T04:27:42.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj371 td/osd-backfill-space/datafile 2024-09-16T04:27:42.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:42.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj372 td/osd-backfill-space/datafile 2024-09-16T04:27:42.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj372 td/osd-backfill-space/datafile 2024-09-16T04:27:42.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:42.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj373 td/osd-backfill-space/datafile 2024-09-16T04:27:42.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj373 td/osd-backfill-space/datafile 2024-09-16T04:27:42.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:42.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj374 td/osd-backfill-space/datafile 2024-09-16T04:27:42.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj374 td/osd-backfill-space/datafile 2024-09-16T04:27:42.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:42.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj375 td/osd-backfill-space/datafile 2024-09-16T04:27:42.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj375 td/osd-backfill-space/datafile 2024-09-16T04:27:42.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:42.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj376 td/osd-backfill-space/datafile 2024-09-16T04:27:42.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj376 td/osd-backfill-space/datafile 2024-09-16T04:27:42.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:42.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj377 td/osd-backfill-space/datafile 2024-09-16T04:27:42.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj377 td/osd-backfill-space/datafile 2024-09-16T04:27:42.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:42.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj378 td/osd-backfill-space/datafile 2024-09-16T04:27:42.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj378 td/osd-backfill-space/datafile 2024-09-16T04:27:43.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:43.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj379 td/osd-backfill-space/datafile 2024-09-16T04:27:43.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj379 td/osd-backfill-space/datafile 2024-09-16T04:27:43.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:43.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj380 td/osd-backfill-space/datafile 2024-09-16T04:27:43.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj380 td/osd-backfill-space/datafile 2024-09-16T04:27:43.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:43.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj381 td/osd-backfill-space/datafile 2024-09-16T04:27:43.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj381 td/osd-backfill-space/datafile 2024-09-16T04:27:43.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:43.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj382 td/osd-backfill-space/datafile 2024-09-16T04:27:43.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj382 td/osd-backfill-space/datafile 2024-09-16T04:27:43.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:43.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj383 td/osd-backfill-space/datafile 2024-09-16T04:27:43.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj383 td/osd-backfill-space/datafile 2024-09-16T04:27:43.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:43.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj384 td/osd-backfill-space/datafile 2024-09-16T04:27:43.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj384 td/osd-backfill-space/datafile 2024-09-16T04:27:43.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:43.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj385 td/osd-backfill-space/datafile 2024-09-16T04:27:44.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj385 td/osd-backfill-space/datafile 2024-09-16T04:27:44.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:44.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj386 td/osd-backfill-space/datafile 2024-09-16T04:27:44.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj386 td/osd-backfill-space/datafile 2024-09-16T04:27:44.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:44.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj387 td/osd-backfill-space/datafile 2024-09-16T04:27:44.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj387 td/osd-backfill-space/datafile 2024-09-16T04:27:44.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:44.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj388 td/osd-backfill-space/datafile 2024-09-16T04:27:44.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj388 td/osd-backfill-space/datafile 2024-09-16T04:27:44.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:44.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj389 td/osd-backfill-space/datafile 2024-09-16T04:27:44.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj389 td/osd-backfill-space/datafile 2024-09-16T04:27:44.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:44.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj390 td/osd-backfill-space/datafile 2024-09-16T04:27:44.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj390 td/osd-backfill-space/datafile 2024-09-16T04:27:44.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:44.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj391 td/osd-backfill-space/datafile 2024-09-16T04:27:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj391 td/osd-backfill-space/datafile 2024-09-16T04:27:45.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:45.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj392 td/osd-backfill-space/datafile 2024-09-16T04:27:45.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj392 td/osd-backfill-space/datafile 2024-09-16T04:27:45.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:45.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj393 td/osd-backfill-space/datafile 2024-09-16T04:27:45.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj393 td/osd-backfill-space/datafile 2024-09-16T04:27:45.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:45.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj394 td/osd-backfill-space/datafile 2024-09-16T04:27:45.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj394 td/osd-backfill-space/datafile 2024-09-16T04:27:45.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:45.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj395 td/osd-backfill-space/datafile 2024-09-16T04:27:45.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj395 td/osd-backfill-space/datafile 2024-09-16T04:27:45.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:45.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj396 td/osd-backfill-space/datafile 2024-09-16T04:27:45.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj396 td/osd-backfill-space/datafile 2024-09-16T04:27:45.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:45.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj397 td/osd-backfill-space/datafile 2024-09-16T04:27:45.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj397 td/osd-backfill-space/datafile 2024-09-16T04:27:45.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:45.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj398 td/osd-backfill-space/datafile 2024-09-16T04:27:46.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj398 td/osd-backfill-space/datafile 2024-09-16T04:27:46.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:46.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj399 td/osd-backfill-space/datafile 2024-09-16T04:27:46.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj399 td/osd-backfill-space/datafile 2024-09-16T04:27:46.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:46.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj400 td/osd-backfill-space/datafile 2024-09-16T04:27:46.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj400 td/osd-backfill-space/datafile 2024-09-16T04:27:46.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:46.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj401 td/osd-backfill-space/datafile 2024-09-16T04:27:46.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj401 td/osd-backfill-space/datafile 2024-09-16T04:27:46.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:46.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj402 td/osd-backfill-space/datafile 2024-09-16T04:27:46.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj402 td/osd-backfill-space/datafile 2024-09-16T04:27:46.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:46.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj403 td/osd-backfill-space/datafile 2024-09-16T04:27:46.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj403 td/osd-backfill-space/datafile 2024-09-16T04:27:46.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:46.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj404 td/osd-backfill-space/datafile 2024-09-16T04:27:46.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj404 td/osd-backfill-space/datafile 2024-09-16T04:27:46.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:46.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj405 td/osd-backfill-space/datafile 2024-09-16T04:27:46.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj405 td/osd-backfill-space/datafile 2024-09-16T04:27:47.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:47.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj406 td/osd-backfill-space/datafile 2024-09-16T04:27:47.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj406 td/osd-backfill-space/datafile 2024-09-16T04:27:47.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:47.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj407 td/osd-backfill-space/datafile 2024-09-16T04:27:47.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj407 td/osd-backfill-space/datafile 2024-09-16T04:27:47.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:47.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj408 td/osd-backfill-space/datafile 2024-09-16T04:27:47.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj408 td/osd-backfill-space/datafile 2024-09-16T04:27:47.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:47.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj409 td/osd-backfill-space/datafile 2024-09-16T04:27:47.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj409 td/osd-backfill-space/datafile 2024-09-16T04:27:47.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:47.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj410 td/osd-backfill-space/datafile 2024-09-16T04:27:47.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj410 td/osd-backfill-space/datafile 2024-09-16T04:27:47.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:47.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj411 td/osd-backfill-space/datafile 2024-09-16T04:27:47.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj411 td/osd-backfill-space/datafile 2024-09-16T04:27:47.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:47.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj412 td/osd-backfill-space/datafile 2024-09-16T04:27:48.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj412 td/osd-backfill-space/datafile 2024-09-16T04:27:48.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:48.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj413 td/osd-backfill-space/datafile 2024-09-16T04:27:48.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj413 td/osd-backfill-space/datafile 2024-09-16T04:27:48.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:48.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj414 td/osd-backfill-space/datafile 2024-09-16T04:27:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj414 td/osd-backfill-space/datafile 2024-09-16T04:27:48.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:48.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj415 td/osd-backfill-space/datafile 2024-09-16T04:27:48.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj415 td/osd-backfill-space/datafile 2024-09-16T04:27:48.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:48.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj416 td/osd-backfill-space/datafile 2024-09-16T04:27:48.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj416 td/osd-backfill-space/datafile 2024-09-16T04:27:48.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:48.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj417 td/osd-backfill-space/datafile 2024-09-16T04:27:48.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj417 td/osd-backfill-space/datafile 2024-09-16T04:27:48.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:48.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj418 td/osd-backfill-space/datafile 2024-09-16T04:27:48.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj418 td/osd-backfill-space/datafile 2024-09-16T04:27:48.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:48.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj419 td/osd-backfill-space/datafile 2024-09-16T04:27:48.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj419 td/osd-backfill-space/datafile 2024-09-16T04:27:49.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:49.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj420 td/osd-backfill-space/datafile 2024-09-16T04:27:49.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj420 td/osd-backfill-space/datafile 2024-09-16T04:27:49.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:49.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj421 td/osd-backfill-space/datafile 2024-09-16T04:27:49.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj421 td/osd-backfill-space/datafile 2024-09-16T04:27:49.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:49.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj422 td/osd-backfill-space/datafile 2024-09-16T04:27:49.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj422 td/osd-backfill-space/datafile 2024-09-16T04:27:49.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:49.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj423 td/osd-backfill-space/datafile 2024-09-16T04:27:49.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj423 td/osd-backfill-space/datafile 2024-09-16T04:27:49.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:49.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj424 td/osd-backfill-space/datafile 2024-09-16T04:27:49.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj424 td/osd-backfill-space/datafile 2024-09-16T04:27:49.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:49.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj425 td/osd-backfill-space/datafile 2024-09-16T04:27:49.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj425 td/osd-backfill-space/datafile 2024-09-16T04:27:49.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:49.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj426 td/osd-backfill-space/datafile 2024-09-16T04:27:49.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj426 td/osd-backfill-space/datafile 2024-09-16T04:27:50.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:50.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj427 td/osd-backfill-space/datafile 2024-09-16T04:27:50.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj427 td/osd-backfill-space/datafile 2024-09-16T04:27:50.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:50.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj428 td/osd-backfill-space/datafile 2024-09-16T04:27:50.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj428 td/osd-backfill-space/datafile 2024-09-16T04:27:50.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:50.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj429 td/osd-backfill-space/datafile 2024-09-16T04:27:50.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj429 td/osd-backfill-space/datafile 2024-09-16T04:27:50.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:50.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj430 td/osd-backfill-space/datafile 2024-09-16T04:27:50.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj430 td/osd-backfill-space/datafile 2024-09-16T04:27:50.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:50.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj431 td/osd-backfill-space/datafile 2024-09-16T04:27:50.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj431 td/osd-backfill-space/datafile 2024-09-16T04:27:50.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:50.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj432 td/osd-backfill-space/datafile 2024-09-16T04:27:50.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj432 td/osd-backfill-space/datafile 2024-09-16T04:27:50.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:50.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj433 td/osd-backfill-space/datafile 2024-09-16T04:27:50.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj433 td/osd-backfill-space/datafile 2024-09-16T04:27:50.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:50.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj434 td/osd-backfill-space/datafile 2024-09-16T04:27:51.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj434 td/osd-backfill-space/datafile 2024-09-16T04:27:51.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:51.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj435 td/osd-backfill-space/datafile 2024-09-16T04:27:51.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj435 td/osd-backfill-space/datafile 2024-09-16T04:27:51.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:51.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj436 td/osd-backfill-space/datafile 2024-09-16T04:27:51.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj436 td/osd-backfill-space/datafile 2024-09-16T04:27:51.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:51.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj437 td/osd-backfill-space/datafile 2024-09-16T04:27:51.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj437 td/osd-backfill-space/datafile 2024-09-16T04:27:51.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:51.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj438 td/osd-backfill-space/datafile 2024-09-16T04:27:51.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj438 td/osd-backfill-space/datafile 2024-09-16T04:27:51.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:51.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj439 td/osd-backfill-space/datafile 2024-09-16T04:27:51.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj439 td/osd-backfill-space/datafile 2024-09-16T04:27:51.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:51.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj440 td/osd-backfill-space/datafile 2024-09-16T04:27:51.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj440 td/osd-backfill-space/datafile 2024-09-16T04:27:51.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:51.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj441 td/osd-backfill-space/datafile 2024-09-16T04:27:52.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj441 td/osd-backfill-space/datafile 2024-09-16T04:27:52.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:52.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj442 td/osd-backfill-space/datafile 2024-09-16T04:27:52.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj442 td/osd-backfill-space/datafile 2024-09-16T04:27:52.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:52.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj443 td/osd-backfill-space/datafile 2024-09-16T04:27:52.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj443 td/osd-backfill-space/datafile 2024-09-16T04:27:52.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:52.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj444 td/osd-backfill-space/datafile 2024-09-16T04:27:52.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj444 td/osd-backfill-space/datafile 2024-09-16T04:27:52.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:52.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj445 td/osd-backfill-space/datafile 2024-09-16T04:27:52.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj445 td/osd-backfill-space/datafile 2024-09-16T04:27:52.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:52.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj446 td/osd-backfill-space/datafile 2024-09-16T04:27:52.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj446 td/osd-backfill-space/datafile 2024-09-16T04:27:52.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:52.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj447 td/osd-backfill-space/datafile 2024-09-16T04:27:52.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj447 td/osd-backfill-space/datafile 2024-09-16T04:27:52.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:52.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj448 td/osd-backfill-space/datafile 2024-09-16T04:27:53.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj448 td/osd-backfill-space/datafile 2024-09-16T04:27:53.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:53.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj449 td/osd-backfill-space/datafile 2024-09-16T04:27:53.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj449 td/osd-backfill-space/datafile 2024-09-16T04:27:53.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:53.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj450 td/osd-backfill-space/datafile 2024-09-16T04:27:53.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj450 td/osd-backfill-space/datafile 2024-09-16T04:27:53.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:53.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj451 td/osd-backfill-space/datafile 2024-09-16T04:27:53.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj451 td/osd-backfill-space/datafile 2024-09-16T04:27:53.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:53.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj452 td/osd-backfill-space/datafile 2024-09-16T04:27:53.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj452 td/osd-backfill-space/datafile 2024-09-16T04:27:53.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:53.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj453 td/osd-backfill-space/datafile 2024-09-16T04:27:53.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj453 td/osd-backfill-space/datafile 2024-09-16T04:27:53.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:53.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj454 td/osd-backfill-space/datafile 2024-09-16T04:27:53.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj454 td/osd-backfill-space/datafile 2024-09-16T04:27:53.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:53.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj455 td/osd-backfill-space/datafile 2024-09-16T04:27:54.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj455 td/osd-backfill-space/datafile 2024-09-16T04:27:54.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:54.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj456 td/osd-backfill-space/datafile 2024-09-16T04:27:54.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj456 td/osd-backfill-space/datafile 2024-09-16T04:27:54.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:54.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj457 td/osd-backfill-space/datafile 2024-09-16T04:27:54.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj457 td/osd-backfill-space/datafile 2024-09-16T04:27:54.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:54.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj458 td/osd-backfill-space/datafile 2024-09-16T04:27:54.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj458 td/osd-backfill-space/datafile 2024-09-16T04:27:55.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:55.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj459 td/osd-backfill-space/datafile 2024-09-16T04:27:55.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj459 td/osd-backfill-space/datafile 2024-09-16T04:27:55.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:55.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj460 td/osd-backfill-space/datafile 2024-09-16T04:27:55.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj460 td/osd-backfill-space/datafile 2024-09-16T04:27:55.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:55.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj461 td/osd-backfill-space/datafile 2024-09-16T04:27:55.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj461 td/osd-backfill-space/datafile 2024-09-16T04:27:55.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:55.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj462 td/osd-backfill-space/datafile 2024-09-16T04:27:55.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj462 td/osd-backfill-space/datafile 2024-09-16T04:27:55.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:55.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj463 td/osd-backfill-space/datafile 2024-09-16T04:27:55.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj463 td/osd-backfill-space/datafile 2024-09-16T04:27:55.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:55.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj464 td/osd-backfill-space/datafile 2024-09-16T04:27:55.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj464 td/osd-backfill-space/datafile 2024-09-16T04:27:55.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:55.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj465 td/osd-backfill-space/datafile 2024-09-16T04:27:55.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj465 td/osd-backfill-space/datafile 2024-09-16T04:27:55.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:55.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj466 td/osd-backfill-space/datafile 2024-09-16T04:27:56.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj466 td/osd-backfill-space/datafile 2024-09-16T04:27:56.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:56.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj467 td/osd-backfill-space/datafile 2024-09-16T04:27:56.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj467 td/osd-backfill-space/datafile 2024-09-16T04:27:56.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:56.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj468 td/osd-backfill-space/datafile 2024-09-16T04:27:56.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj468 td/osd-backfill-space/datafile 2024-09-16T04:27:56.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:56.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj469 td/osd-backfill-space/datafile 2024-09-16T04:27:56.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj469 td/osd-backfill-space/datafile 2024-09-16T04:27:56.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:56.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj470 td/osd-backfill-space/datafile 2024-09-16T04:27:56.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj470 td/osd-backfill-space/datafile 2024-09-16T04:27:56.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:56.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj471 td/osd-backfill-space/datafile 2024-09-16T04:27:56.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj471 td/osd-backfill-space/datafile 2024-09-16T04:27:56.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:56.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj472 td/osd-backfill-space/datafile 2024-09-16T04:27:56.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj472 td/osd-backfill-space/datafile 2024-09-16T04:27:57.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:57.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj473 td/osd-backfill-space/datafile 2024-09-16T04:27:57.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj473 td/osd-backfill-space/datafile 2024-09-16T04:27:57.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:57.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj474 td/osd-backfill-space/datafile 2024-09-16T04:27:57.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj474 td/osd-backfill-space/datafile 2024-09-16T04:27:57.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:57.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj475 td/osd-backfill-space/datafile 2024-09-16T04:27:57.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj475 td/osd-backfill-space/datafile 2024-09-16T04:27:57.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:57.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj476 td/osd-backfill-space/datafile 2024-09-16T04:27:57.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj476 td/osd-backfill-space/datafile 2024-09-16T04:27:57.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:57.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj477 td/osd-backfill-space/datafile 2024-09-16T04:27:57.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj477 td/osd-backfill-space/datafile 2024-09-16T04:27:57.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:57.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj478 td/osd-backfill-space/datafile 2024-09-16T04:27:57.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj478 td/osd-backfill-space/datafile 2024-09-16T04:27:57.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:57.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj479 td/osd-backfill-space/datafile 2024-09-16T04:27:57.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj479 td/osd-backfill-space/datafile 2024-09-16T04:27:57.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:57.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj480 td/osd-backfill-space/datafile 2024-09-16T04:27:58.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj480 td/osd-backfill-space/datafile 2024-09-16T04:27:58.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:58.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj481 td/osd-backfill-space/datafile 2024-09-16T04:27:58.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj481 td/osd-backfill-space/datafile 2024-09-16T04:27:58.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:58.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj482 td/osd-backfill-space/datafile 2024-09-16T04:27:58.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj482 td/osd-backfill-space/datafile 2024-09-16T04:27:58.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:58.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj483 td/osd-backfill-space/datafile 2024-09-16T04:27:58.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj483 td/osd-backfill-space/datafile 2024-09-16T04:27:58.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:58.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj484 td/osd-backfill-space/datafile 2024-09-16T04:27:58.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj484 td/osd-backfill-space/datafile 2024-09-16T04:27:58.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:58.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj485 td/osd-backfill-space/datafile 2024-09-16T04:27:58.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj485 td/osd-backfill-space/datafile 2024-09-16T04:27:58.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:58.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj486 td/osd-backfill-space/datafile 2024-09-16T04:27:58.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj486 td/osd-backfill-space/datafile 2024-09-16T04:27:58.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:58.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj487 td/osd-backfill-space/datafile 2024-09-16T04:27:59.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj487 td/osd-backfill-space/datafile 2024-09-16T04:27:59.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:59.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj488 td/osd-backfill-space/datafile 2024-09-16T04:27:59.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj488 td/osd-backfill-space/datafile 2024-09-16T04:27:59.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:59.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj489 td/osd-backfill-space/datafile 2024-09-16T04:27:59.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj489 td/osd-backfill-space/datafile 2024-09-16T04:27:59.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:59.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj490 td/osd-backfill-space/datafile 2024-09-16T04:27:59.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj490 td/osd-backfill-space/datafile 2024-09-16T04:27:59.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:59.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj491 td/osd-backfill-space/datafile 2024-09-16T04:27:59.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj491 td/osd-backfill-space/datafile 2024-09-16T04:27:59.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:59.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj492 td/osd-backfill-space/datafile 2024-09-16T04:27:59.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj492 td/osd-backfill-space/datafile 2024-09-16T04:27:59.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:27:59.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj493 td/osd-backfill-space/datafile 2024-09-16T04:27:59.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj493 td/osd-backfill-space/datafile 2024-09-16T04:28:00.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:00.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj494 td/osd-backfill-space/datafile 2024-09-16T04:28:00.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj494 td/osd-backfill-space/datafile 2024-09-16T04:28:00.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:00.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj495 td/osd-backfill-space/datafile 2024-09-16T04:28:00.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj495 td/osd-backfill-space/datafile 2024-09-16T04:28:00.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:00.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj496 td/osd-backfill-space/datafile 2024-09-16T04:28:00.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj496 td/osd-backfill-space/datafile 2024-09-16T04:28:00.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:00.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj497 td/osd-backfill-space/datafile 2024-09-16T04:28:00.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj497 td/osd-backfill-space/datafile 2024-09-16T04:28:00.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:00.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj498 td/osd-backfill-space/datafile 2024-09-16T04:28:00.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj498 td/osd-backfill-space/datafile 2024-09-16T04:28:00.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:00.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj499 td/osd-backfill-space/datafile 2024-09-16T04:28:00.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj499 td/osd-backfill-space/datafile 2024-09-16T04:28:00.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:00.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj500 td/osd-backfill-space/datafile 2024-09-16T04:28:00.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj500 td/osd-backfill-space/datafile 2024-09-16T04:28:01.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:01.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj501 td/osd-backfill-space/datafile 2024-09-16T04:28:01.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj501 td/osd-backfill-space/datafile 2024-09-16T04:28:01.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:01.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj502 td/osd-backfill-space/datafile 2024-09-16T04:28:01.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj502 td/osd-backfill-space/datafile 2024-09-16T04:28:01.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:01.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj503 td/osd-backfill-space/datafile 2024-09-16T04:28:01.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj503 td/osd-backfill-space/datafile 2024-09-16T04:28:01.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:01.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj504 td/osd-backfill-space/datafile 2024-09-16T04:28:01.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj504 td/osd-backfill-space/datafile 2024-09-16T04:28:01.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:01.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj505 td/osd-backfill-space/datafile 2024-09-16T04:28:01.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj505 td/osd-backfill-space/datafile 2024-09-16T04:28:01.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:01.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj506 td/osd-backfill-space/datafile 2024-09-16T04:28:01.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj506 td/osd-backfill-space/datafile 2024-09-16T04:28:01.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:01.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj507 td/osd-backfill-space/datafile 2024-09-16T04:28:02.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj507 td/osd-backfill-space/datafile 2024-09-16T04:28:02.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:02.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj508 td/osd-backfill-space/datafile 2024-09-16T04:28:02.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj508 td/osd-backfill-space/datafile 2024-09-16T04:28:02.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:02.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj509 td/osd-backfill-space/datafile 2024-09-16T04:28:02.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj509 td/osd-backfill-space/datafile 2024-09-16T04:28:02.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:02.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj510 td/osd-backfill-space/datafile 2024-09-16T04:28:02.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj510 td/osd-backfill-space/datafile 2024-09-16T04:28:02.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:02.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj511 td/osd-backfill-space/datafile 2024-09-16T04:28:02.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj511 td/osd-backfill-space/datafile 2024-09-16T04:28:02.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:02.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj512 td/osd-backfill-space/datafile 2024-09-16T04:28:02.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj512 td/osd-backfill-space/datafile 2024-09-16T04:28:02.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:02.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj513 td/osd-backfill-space/datafile 2024-09-16T04:28:02.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj513 td/osd-backfill-space/datafile 2024-09-16T04:28:02.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:02.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj514 td/osd-backfill-space/datafile 2024-09-16T04:28:03.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj514 td/osd-backfill-space/datafile 2024-09-16T04:28:03.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:03.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj515 td/osd-backfill-space/datafile 2024-09-16T04:28:03.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj515 td/osd-backfill-space/datafile 2024-09-16T04:28:03.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:03.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj516 td/osd-backfill-space/datafile 2024-09-16T04:28:03.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj516 td/osd-backfill-space/datafile 2024-09-16T04:28:03.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:03.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj517 td/osd-backfill-space/datafile 2024-09-16T04:28:03.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj517 td/osd-backfill-space/datafile 2024-09-16T04:28:03.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:03.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj518 td/osd-backfill-space/datafile 2024-09-16T04:28:03.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj518 td/osd-backfill-space/datafile 2024-09-16T04:28:03.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:03.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj519 td/osd-backfill-space/datafile 2024-09-16T04:28:03.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj519 td/osd-backfill-space/datafile 2024-09-16T04:28:03.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:03.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj520 td/osd-backfill-space/datafile 2024-09-16T04:28:03.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj520 td/osd-backfill-space/datafile 2024-09-16T04:28:03.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:03.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj521 td/osd-backfill-space/datafile 2024-09-16T04:28:04.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj521 td/osd-backfill-space/datafile 2024-09-16T04:28:04.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:04.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj522 td/osd-backfill-space/datafile 2024-09-16T04:28:04.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj522 td/osd-backfill-space/datafile 2024-09-16T04:28:04.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:04.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj523 td/osd-backfill-space/datafile 2024-09-16T04:28:04.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj523 td/osd-backfill-space/datafile 2024-09-16T04:28:04.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:04.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj524 td/osd-backfill-space/datafile 2024-09-16T04:28:04.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj524 td/osd-backfill-space/datafile 2024-09-16T04:28:04.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:04.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj525 td/osd-backfill-space/datafile 2024-09-16T04:28:04.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj525 td/osd-backfill-space/datafile 2024-09-16T04:28:04.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:04.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj526 td/osd-backfill-space/datafile 2024-09-16T04:28:04.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj526 td/osd-backfill-space/datafile 2024-09-16T04:28:04.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:04.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj527 td/osd-backfill-space/datafile 2024-09-16T04:28:04.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj527 td/osd-backfill-space/datafile 2024-09-16T04:28:04.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:04.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj528 td/osd-backfill-space/datafile 2024-09-16T04:28:05.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj528 td/osd-backfill-space/datafile 2024-09-16T04:28:05.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:05.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj529 td/osd-backfill-space/datafile 2024-09-16T04:28:05.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj529 td/osd-backfill-space/datafile 2024-09-16T04:28:05.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:05.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj530 td/osd-backfill-space/datafile 2024-09-16T04:28:05.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj530 td/osd-backfill-space/datafile 2024-09-16T04:28:05.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:05.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj531 td/osd-backfill-space/datafile 2024-09-16T04:28:05.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj531 td/osd-backfill-space/datafile 2024-09-16T04:28:05.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:05.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj532 td/osd-backfill-space/datafile 2024-09-16T04:28:05.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj532 td/osd-backfill-space/datafile 2024-09-16T04:28:05.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:05.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj533 td/osd-backfill-space/datafile 2024-09-16T04:28:05.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj533 td/osd-backfill-space/datafile 2024-09-16T04:28:05.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:05.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj534 td/osd-backfill-space/datafile 2024-09-16T04:28:05.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj534 td/osd-backfill-space/datafile 2024-09-16T04:28:06.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:06.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj535 td/osd-backfill-space/datafile 2024-09-16T04:28:06.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj535 td/osd-backfill-space/datafile 2024-09-16T04:28:06.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:06.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj536 td/osd-backfill-space/datafile 2024-09-16T04:28:06.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj536 td/osd-backfill-space/datafile 2024-09-16T04:28:06.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:06.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj537 td/osd-backfill-space/datafile 2024-09-16T04:28:06.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj537 td/osd-backfill-space/datafile 2024-09-16T04:28:06.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:06.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj538 td/osd-backfill-space/datafile 2024-09-16T04:28:06.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj538 td/osd-backfill-space/datafile 2024-09-16T04:28:06.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:06.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj539 td/osd-backfill-space/datafile 2024-09-16T04:28:06.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj539 td/osd-backfill-space/datafile 2024-09-16T04:28:06.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:06.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj540 td/osd-backfill-space/datafile 2024-09-16T04:28:06.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj540 td/osd-backfill-space/datafile 2024-09-16T04:28:06.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:06.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj541 td/osd-backfill-space/datafile 2024-09-16T04:28:06.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj541 td/osd-backfill-space/datafile 2024-09-16T04:28:07.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:07.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj542 td/osd-backfill-space/datafile 2024-09-16T04:28:07.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj542 td/osd-backfill-space/datafile 2024-09-16T04:28:07.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:07.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj543 td/osd-backfill-space/datafile 2024-09-16T04:28:07.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj543 td/osd-backfill-space/datafile 2024-09-16T04:28:07.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:07.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj544 td/osd-backfill-space/datafile 2024-09-16T04:28:07.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj544 td/osd-backfill-space/datafile 2024-09-16T04:28:07.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:07.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj545 td/osd-backfill-space/datafile 2024-09-16T04:28:07.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj545 td/osd-backfill-space/datafile 2024-09-16T04:28:07.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:07.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj546 td/osd-backfill-space/datafile 2024-09-16T04:28:07.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj546 td/osd-backfill-space/datafile 2024-09-16T04:28:07.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:07.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj547 td/osd-backfill-space/datafile 2024-09-16T04:28:07.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj547 td/osd-backfill-space/datafile 2024-09-16T04:28:07.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:07.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj548 td/osd-backfill-space/datafile 2024-09-16T04:28:08.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj548 td/osd-backfill-space/datafile 2024-09-16T04:28:08.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:08.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj549 td/osd-backfill-space/datafile 2024-09-16T04:28:08.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj549 td/osd-backfill-space/datafile 2024-09-16T04:28:08.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:08.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj550 td/osd-backfill-space/datafile 2024-09-16T04:28:08.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj550 td/osd-backfill-space/datafile 2024-09-16T04:28:08.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:08.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj551 td/osd-backfill-space/datafile 2024-09-16T04:28:08.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj551 td/osd-backfill-space/datafile 2024-09-16T04:28:08.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:08.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj552 td/osd-backfill-space/datafile 2024-09-16T04:28:08.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj552 td/osd-backfill-space/datafile 2024-09-16T04:28:08.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:08.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj553 td/osd-backfill-space/datafile 2024-09-16T04:28:08.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj553 td/osd-backfill-space/datafile 2024-09-16T04:28:08.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:08.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj554 td/osd-backfill-space/datafile 2024-09-16T04:28:08.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj554 td/osd-backfill-space/datafile 2024-09-16T04:28:09.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:09.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj555 td/osd-backfill-space/datafile 2024-09-16T04:28:09.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj555 td/osd-backfill-space/datafile 2024-09-16T04:28:09.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:09.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj556 td/osd-backfill-space/datafile 2024-09-16T04:28:09.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj556 td/osd-backfill-space/datafile 2024-09-16T04:28:09.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:09.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj557 td/osd-backfill-space/datafile 2024-09-16T04:28:09.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj557 td/osd-backfill-space/datafile 2024-09-16T04:28:09.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:09.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj558 td/osd-backfill-space/datafile 2024-09-16T04:28:09.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj558 td/osd-backfill-space/datafile 2024-09-16T04:28:09.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:09.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj559 td/osd-backfill-space/datafile 2024-09-16T04:28:09.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj559 td/osd-backfill-space/datafile 2024-09-16T04:28:09.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:09.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj560 td/osd-backfill-space/datafile 2024-09-16T04:28:09.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj560 td/osd-backfill-space/datafile 2024-09-16T04:28:09.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:09.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj561 td/osd-backfill-space/datafile 2024-09-16T04:28:10.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj561 td/osd-backfill-space/datafile 2024-09-16T04:28:10.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:10.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj562 td/osd-backfill-space/datafile 2024-09-16T04:28:10.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj562 td/osd-backfill-space/datafile 2024-09-16T04:28:10.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:10.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj563 td/osd-backfill-space/datafile 2024-09-16T04:28:10.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj563 td/osd-backfill-space/datafile 2024-09-16T04:28:10.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:10.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj564 td/osd-backfill-space/datafile 2024-09-16T04:28:10.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj564 td/osd-backfill-space/datafile 2024-09-16T04:28:10.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:10.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj565 td/osd-backfill-space/datafile 2024-09-16T04:28:10.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj565 td/osd-backfill-space/datafile 2024-09-16T04:28:10.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:10.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj566 td/osd-backfill-space/datafile 2024-09-16T04:28:10.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj566 td/osd-backfill-space/datafile 2024-09-16T04:28:10.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:10.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj567 td/osd-backfill-space/datafile 2024-09-16T04:28:10.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj567 td/osd-backfill-space/datafile 2024-09-16T04:28:10.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:10.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj568 td/osd-backfill-space/datafile 2024-09-16T04:28:11.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj568 td/osd-backfill-space/datafile 2024-09-16T04:28:11.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:11.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj569 td/osd-backfill-space/datafile 2024-09-16T04:28:11.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj569 td/osd-backfill-space/datafile 2024-09-16T04:28:11.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:11.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj570 td/osd-backfill-space/datafile 2024-09-16T04:28:11.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj570 td/osd-backfill-space/datafile 2024-09-16T04:28:11.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:11.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj571 td/osd-backfill-space/datafile 2024-09-16T04:28:11.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj571 td/osd-backfill-space/datafile 2024-09-16T04:28:11.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:11.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj572 td/osd-backfill-space/datafile 2024-09-16T04:28:11.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj572 td/osd-backfill-space/datafile 2024-09-16T04:28:11.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:11.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj573 td/osd-backfill-space/datafile 2024-09-16T04:28:11.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj573 td/osd-backfill-space/datafile 2024-09-16T04:28:11.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:11.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj574 td/osd-backfill-space/datafile 2024-09-16T04:28:11.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj574 td/osd-backfill-space/datafile 2024-09-16T04:28:12.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:12.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj575 td/osd-backfill-space/datafile 2024-09-16T04:28:12.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj575 td/osd-backfill-space/datafile 2024-09-16T04:28:12.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:12.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj576 td/osd-backfill-space/datafile 2024-09-16T04:28:12.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj576 td/osd-backfill-space/datafile 2024-09-16T04:28:12.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:12.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj577 td/osd-backfill-space/datafile 2024-09-16T04:28:12.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj577 td/osd-backfill-space/datafile 2024-09-16T04:28:12.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:12.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj578 td/osd-backfill-space/datafile 2024-09-16T04:28:12.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj578 td/osd-backfill-space/datafile 2024-09-16T04:28:12.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:12.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj579 td/osd-backfill-space/datafile 2024-09-16T04:28:12.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj579 td/osd-backfill-space/datafile 2024-09-16T04:28:12.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:12.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj580 td/osd-backfill-space/datafile 2024-09-16T04:28:12.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj580 td/osd-backfill-space/datafile 2024-09-16T04:28:12.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:12.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj581 td/osd-backfill-space/datafile 2024-09-16T04:28:12.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj581 td/osd-backfill-space/datafile 2024-09-16T04:28:13.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:13.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj582 td/osd-backfill-space/datafile 2024-09-16T04:28:13.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj582 td/osd-backfill-space/datafile 2024-09-16T04:28:13.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:13.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj583 td/osd-backfill-space/datafile 2024-09-16T04:28:13.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj583 td/osd-backfill-space/datafile 2024-09-16T04:28:13.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:13.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj584 td/osd-backfill-space/datafile 2024-09-16T04:28:13.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj584 td/osd-backfill-space/datafile 2024-09-16T04:28:13.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:13.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj585 td/osd-backfill-space/datafile 2024-09-16T04:28:13.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj585 td/osd-backfill-space/datafile 2024-09-16T04:28:13.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:13.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj586 td/osd-backfill-space/datafile 2024-09-16T04:28:13.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj586 td/osd-backfill-space/datafile 2024-09-16T04:28:13.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:13.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj587 td/osd-backfill-space/datafile 2024-09-16T04:28:13.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj587 td/osd-backfill-space/datafile 2024-09-16T04:28:13.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:13.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj588 td/osd-backfill-space/datafile 2024-09-16T04:28:13.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj588 td/osd-backfill-space/datafile 2024-09-16T04:28:14.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:14.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj589 td/osd-backfill-space/datafile 2024-09-16T04:28:14.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj589 td/osd-backfill-space/datafile 2024-09-16T04:28:14.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:14.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj590 td/osd-backfill-space/datafile 2024-09-16T04:28:14.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj590 td/osd-backfill-space/datafile 2024-09-16T04:28:14.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:14.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj591 td/osd-backfill-space/datafile 2024-09-16T04:28:14.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj591 td/osd-backfill-space/datafile 2024-09-16T04:28:14.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:14.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj592 td/osd-backfill-space/datafile 2024-09-16T04:28:14.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj592 td/osd-backfill-space/datafile 2024-09-16T04:28:14.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:14.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj593 td/osd-backfill-space/datafile 2024-09-16T04:28:14.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj593 td/osd-backfill-space/datafile 2024-09-16T04:28:14.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:14.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj594 td/osd-backfill-space/datafile 2024-09-16T04:28:14.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj594 td/osd-backfill-space/datafile 2024-09-16T04:28:14.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:14.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj595 td/osd-backfill-space/datafile 2024-09-16T04:28:14.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj595 td/osd-backfill-space/datafile 2024-09-16T04:28:14.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:14.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj596 td/osd-backfill-space/datafile 2024-09-16T04:28:15.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj596 td/osd-backfill-space/datafile 2024-09-16T04:28:15.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:15.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj597 td/osd-backfill-space/datafile 2024-09-16T04:28:15.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj597 td/osd-backfill-space/datafile 2024-09-16T04:28:15.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:15.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj598 td/osd-backfill-space/datafile 2024-09-16T04:28:15.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj598 td/osd-backfill-space/datafile 2024-09-16T04:28:15.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:15.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj599 td/osd-backfill-space/datafile 2024-09-16T04:28:15.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj599 td/osd-backfill-space/datafile 2024-09-16T04:28:15.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:374: TEST_backfill_test_sametarget: for i in $(seq 1 $objects) 2024-09-16T04:28:15.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:376: TEST_backfill_test_sametarget: rados -p test1 put obj600 td/osd-backfill-space/datafile 2024-09-16T04:28:15.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:377: TEST_backfill_test_sametarget: rados -p test4 put obj600 td/osd-backfill-space/datafile 2024-09-16T04:28:15.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:380: TEST_backfill_test_sametarget: ceph osd pool set test1 size 2 2024-09-16T04:28:16.449 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 2 2024-09-16T04:28:16.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:381: TEST_backfill_test_sametarget: ceph osd pool set test4 size 2 2024-09-16T04:28:17.464 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 4 size to 2 2024-09-16T04:28:17.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:382: TEST_backfill_test_sametarget: sleep 30 2024-09-16T04:28:47.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:384: TEST_backfill_test_sametarget: wait_for_not_backfilling 1200 2024-09-16T04:28:47.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:83: wait_for_not_backfilling: local timeout=1200 2024-09-16T04:28:47.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:84: wait_for_not_backfilling: wait_for_not_state backfilling 1200 2024-09-16T04:28:47.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=backfilling 2024-09-16T04:28:47.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-09-16T04:28:47.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-09-16T04:28:47.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 1200 5 2024-09-16T04:28:47.480 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:28:47.480 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:28:47.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:28:47.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:28:47.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:28:48.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15') 2024-09-16T04:28:48.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-09-16T04:28:48.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-09-16T04:28:48.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-09-16T04:28:48.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:28:48.078 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:28:48.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:28:48.488 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:28:48.488 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:28:48.488 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:28:48.488 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T04:28:48.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:28:48.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:28:48.489 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:28:48.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836558 2024-09-16T04:28:48.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836558 2024-09-16T04:28:48.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836558' 2024-09-16T04:28:48.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:28:48.654 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:28:48.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673029 2024-09-16T04:28:48.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673029 2024-09-16T04:28:48.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836558 1-42949673029' 2024-09-16T04:28:48.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:28:48.781 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:28:48.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509504 2024-09-16T04:28:48.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509504 2024-09-16T04:28:48.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836558 1-42949673029 2-64424509504' 2024-09-16T04:28:48.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:28:48.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:28:49.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345978 2024-09-16T04:28:49.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345978 2024-09-16T04:28:49.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836558 1-42949673029 2-64424509504 3-85899345978' 2024-09-16T04:28:49.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:28:49.027 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:28:49.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182446 2024-09-16T04:28:49.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182446 2024-09-16T04:28:49.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836558 1-42949673029 2-64424509504 3-85899345978 4-107374182446' 2024-09-16T04:28:49.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:28:49.174 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836558 2024-09-16T04:28:49.174 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:28:49.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:28:49.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836558 2024-09-16T04:28:49.176 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:28:49.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836558 2024-09-16T04:28:49.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836558' 2024-09-16T04:28:49.177 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836558 2024-09-16T04:28:49.177 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:28:49.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836558 -lt 21474836558 2024-09-16T04:28:49.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:28:49.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673029 2024-09-16T04:28:49.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:28:49.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:28:49.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673029 2024-09-16T04:28:49.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:28:49.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673029 2024-09-16T04:28:49.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673029' 2024-09-16T04:28:49.602 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673029 2024-09-16T04:28:49.602 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:28:50.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673029 -lt 42949673029 2024-09-16T04:28:50.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:28:50.011 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509504 2024-09-16T04:28:50.011 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:28:50.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:28:50.013 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509504 2024-09-16T04:28:50.013 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:28:50.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509504 2024-09-16T04:28:50.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509504' 2024-09-16T04:28:50.014 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509504 2024-09-16T04:28:50.014 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:28:50.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509504 -lt 64424509504 2024-09-16T04:28:50.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:28:50.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345978 2024-09-16T04:28:50.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:28:50.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:28:50.507 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345978 2024-09-16T04:28:50.507 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:28:50.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345978 2024-09-16T04:28:50.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345978' 2024-09-16T04:28:50.509 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345978 2024-09-16T04:28:50.509 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:28:51.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345978 -lt 85899345978 2024-09-16T04:28:51.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:28:51.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182446 2024-09-16T04:28:51.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:28:51.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:28:51.006 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182446 2024-09-16T04:28:51.006 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:28:51.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182446 2024-09-16T04:28:51.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182446' 2024-09-16T04:28:51.008 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182446 2024-09-16T04:28:51.008 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:28:51.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182446 -lt 107374182446 2024-09-16T04:28:51.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-09-16T04:28:51.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:28:51.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:28:52.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 2 == 0 2024-09-16T04:28:52.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:28:52.026 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:28:52.026 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:28:52.026 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:28:52.026 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:28:52.026 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:28:52.026 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:28:52.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=1 2024-09-16T04:28:52.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 1 = 0 2024-09-16T04:28:52.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 1 '!=' -1 2024-09-16T04:28:52.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:69: wait_for_not_state: loop=0 2024-09-16T04:28:52.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:70: wait_for_not_state: num_in_state=1 2024-09-16T04:28:52.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 5 2024-09-16T04:28:57.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-09-16T04:28:57.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:28:57.487 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:28:57.487 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:28:57.487 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:28:57.487 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:28:57.487 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:28:57.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:28:57.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=1 2024-09-16T04:28:57.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 1 = 0 2024-09-16T04:28:57.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 1 '!=' 1 2024-09-16T04:28:57.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:71: wait_for_not_state: (( 1 >= 81 )) 2024-09-16T04:28:57.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 10 2024-09-16T04:29:07.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-09-16T04:29:07.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:29:07.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:29:07.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:29:07.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:29:07.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:29:07.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:29:07.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:29:08.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-09-16T04:29:08.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-09-16T04:29:08.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-09-16T04:29:08.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-09-16T04:29:08.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:385: TEST_backfill_test_sametarget: wait_for_not_activating 60 2024-09-16T04:29:08.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:89: wait_for_not_activating: local timeout=60 2024-09-16T04:29:08.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:90: wait_for_not_activating: wait_for_not_state activating 60 2024-09-16T04:29:08.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=activating 2024-09-16T04:29:08.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-09-16T04:29:08.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-09-16T04:29:08.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 60 5 2024-09-16T04:29:08.316 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:29:08.317 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:29:08.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:29:08.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:29:08.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:29:08.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15') 2024-09-16T04:29:08.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-09-16T04:29:08.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-09-16T04:29:08.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-09-16T04:29:08.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:29:08.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:29:08.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:29:08.798 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:29:08.798 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:29:08.798 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:29:08.798 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T04:29:08.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:29:08.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:29:08.798 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:29:08.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836564 2024-09-16T04:29:08.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836564 2024-09-16T04:29:08.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836564' 2024-09-16T04:29:08.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:29:08.921 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:29:09.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673035 2024-09-16T04:29:09.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673035 2024-09-16T04:29:09.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836564 1-42949673035' 2024-09-16T04:29:09.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:29:09.056 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:29:09.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509510 2024-09-16T04:29:09.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509510 2024-09-16T04:29:09.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836564 1-42949673035 2-64424509510' 2024-09-16T04:29:09.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:29:09.204 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:29:09.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345984 2024-09-16T04:29:09.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345984 2024-09-16T04:29:09.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836564 1-42949673035 2-64424509510 3-85899345984' 2024-09-16T04:29:09.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:29:09.327 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:29:09.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182452 2024-09-16T04:29:09.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182452 2024-09-16T04:29:09.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836564 1-42949673035 2-64424509510 3-85899345984 4-107374182452' 2024-09-16T04:29:09.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:29:09.450 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836564 2024-09-16T04:29:09.451 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:29:09.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:29:09.452 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836564 2024-09-16T04:29:09.452 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:29:09.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836564 2024-09-16T04:29:09.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836564' 2024-09-16T04:29:09.453 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836564 2024-09-16T04:29:09.453 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:29:09.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836564 -lt 21474836564 2024-09-16T04:29:09.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:29:09.900 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673035 2024-09-16T04:29:09.900 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:29:09.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:29:09.901 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673035 2024-09-16T04:29:09.901 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:29:09.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673035 2024-09-16T04:29:09.902 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673035 2024-09-16T04:29:09.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673035' 2024-09-16T04:29:09.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:29:10.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673035 -lt 42949673035 2024-09-16T04:29:10.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:29:10.351 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509510 2024-09-16T04:29:10.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:29:10.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:29:10.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509510 2024-09-16T04:29:10.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:29:10.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509510 2024-09-16T04:29:10.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509510' 2024-09-16T04:29:10.354 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509510 2024-09-16T04:29:10.355 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:29:10.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509508 -lt 64424509510 2024-09-16T04:29:10.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:29:11.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:29:11.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:29:12.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509510 -lt 64424509510 2024-09-16T04:29:12.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:29:12.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345984 2024-09-16T04:29:12.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:29:12.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:29:12.298 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345984 2024-09-16T04:29:12.299 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:29:12.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345984 2024-09-16T04:29:12.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345984' 2024-09-16T04:29:12.300 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345984 2024-09-16T04:29:12.300 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:29:12.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345985 -lt 85899345984 2024-09-16T04:29:12.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:29:12.739 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182452 2024-09-16T04:29:12.739 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:29:12.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:29:12.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182452 2024-09-16T04:29:12.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:29:12.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182452 2024-09-16T04:29:12.742 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182452 2024-09-16T04:29:12.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182452' 2024-09-16T04:29:12.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:29:13.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182452 -lt 107374182452 2024-09-16T04:29:13.214 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-09-16T04:29:13.214 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:29:13.214 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:29:13.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 2 == 0 2024-09-16T04:29:13.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:29:13.797 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state activating 2024-09-16T04:29:13.797 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=activating 2024-09-16T04:29:13.797 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:29:13.797 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("activating"))' 2024-09-16T04:29:13.797 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:29:13.797 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2024-09-16T04:29:14.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-09-16T04:29:14.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-09-16T04:29:14.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-09-16T04:29:14.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-09-16T04:29:14.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:387: TEST_backfill_test_sametarget: ERRORS=0 2024-09-16T04:29:14.220 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:388: TEST_backfill_test_sametarget: ceph pg dump pgs 2024-09-16T04:29:14.220 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:388: TEST_backfill_test_sametarget: grep +backfill_toofull 2024-09-16T04:29:14.220 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:388: TEST_backfill_test_sametarget: wc -l 2024-09-16T04:29:14.609 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:29:14.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:388: TEST_backfill_test_sametarget: '[' 1 '!=' 1 ']' 2024-09-16T04:29:14.621 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:394: TEST_backfill_test_sametarget: ceph pg dump pgs 2024-09-16T04:29:14.621 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:394: TEST_backfill_test_sametarget: grep active+clean 2024-09-16T04:29:14.621 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:394: TEST_backfill_test_sametarget: wc -l 2024-09-16T04:29:15.014 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:29:15.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:394: TEST_backfill_test_sametarget: '[' 1 '!=' 1 ']' 2024-09-16T04:29:15.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:400: TEST_backfill_test_sametarget: ceph pg dump pgs 2024-09-16T04:29:15.418 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:29:15.418 INFO:tasks.workunit.client.0.smithi026.stdout:4.0 600 0 600 0 0 2457600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-09-16T04:28:48.631497+0000 95'600 104:727 [4,0] 4 [4] 4 0'0 2024-09-16T04:25:50.147195+0000 0'0 2024-09-16T04:25:50.147195+0000 0 0 no scrub is scheduled 0 0 2024-09-16T04:29:15.418 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 600 0 0 0 0 2457600 0 0 100 500 100 active+clean 2024-09-16T04:28:53.160678+0000 95'600 104:1960 [1,0] 1 [1,0] 1 0'0 2024-09-16T04:25:42.334183+0000 0'0 2024-09-16T04:25:42.334183+0000 0 0 periodic scrub scheduled @ 2024-09-17T16:01:47.970950+0000 0 0 2024-09-16T04:29:15.418 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:29:15.418 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:29:15.418 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:29:15.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:402: TEST_backfill_test_sametarget: '[' 0 '!=' 0 ']' 2024-09-16T04:29:15.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:407: TEST_backfill_test_sametarget: delete_pool test1 2024-09-16T04:29:15.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test1 2024-09-16T04:29:15.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-09-16T04:29:15.966 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' does not exist 2024-09-16T04:29:15.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:408: TEST_backfill_test_sametarget: delete_pool test4 2024-09-16T04:29:15.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test4 2024-09-16T04:29:15.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test4 test4 --yes-i-really-really-mean-it 2024-09-16T04:29:16.638 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test4' does not exist 2024-09-16T04:29:16.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:409: TEST_backfill_test_sametarget: kill_daemons td/osd-backfill-space 2024-09-16T04:29:16.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:29:16.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:29:16.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:29:16.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:29:16.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:29:21.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:29:21.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:410: TEST_backfill_test_sametarget: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log td/osd-backfill-space/osd.3.log td/osd-backfill-space/osd.4.log 2024-09-16T04:29:22.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-09-16T04:29:22.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:29:22.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:29:22.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:29:22.006 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:29:22.006 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:29:22.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:29:22.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:29:22.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:29:22.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:29:22.014 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:29:22.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:29:22.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:29:22.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:29:22.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:29:22.017 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:29:22.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:29:22.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:29:22.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:29:22.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:29:22.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:29:22.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:29:22.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:29:22.087 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:29:22.087 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:29:22.087 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:29:22.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:29:22.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:29:22.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:29:22.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-09-16T04:29:22.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-09-16T04:29:22.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-space 2024-09-16T04:29:22.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-space 2024-09-16T04:29:22.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:29:22.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:29:22.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:29:22.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:29:22.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:29:22.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:29:22.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:29:22.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:29:22.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:29:22.091 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:29:22.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:29:22.092 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:29:22.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:29:22.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:29:22.094 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:29:22.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:29:22.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:29:22.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:29:22.095 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:29:22.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:29:22.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:29:22.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:29:22.098 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:29:22.098 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:29:22.098 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:29:22.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:29:22.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:29:22.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:29:22.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-space 2024-09-16T04:29:22.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:29:22.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:29:22.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:29:22.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.114688 2024-09-16T04:29:22.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_backfill_test_simple td/osd-backfill-space 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:110: TEST_backfill_test_simple: local dir=td/osd-backfill-space 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:111: TEST_backfill_test_simple: local pools=2 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:112: TEST_backfill_test_simple: local OSDS=3 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:114: TEST_backfill_test_simple: run_mon td/osd-backfill-space a 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-space 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:29:22.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-space/a 2024-09-16T04:29:22.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-09-16T04:29:22.573 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:29:22.573 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:29:22.573 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:29:22.573 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:29:22.573 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:29:22.574 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:29:22.574 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:29:22.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:29:22.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:29:22.775 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:29:22.775 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:29:22.775 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:29:22.775 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:29:22.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:29:22.776 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:29:22.776 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:29:22.776 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:29:22.776 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:29:22.777 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:29:22.777 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:29:22.777 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T04:29:22.777 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:29:22.777 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get fsid 2024-09-16T04:29:22.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:29:22.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:29:22.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:29:22.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:29:22.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:29:22.870 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:29:22.870 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:29:22.870 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:29:22.871 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:29:22.871 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:29:22.871 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:29:22.871 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T04:29:22.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:29:22.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get mon_host 2024-09-16T04:29:22.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:115: TEST_backfill_test_simple: run_mgr td/osd-backfill-space x 2024-09-16T04:29:22.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-space 2024-09-16T04:29:22.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:29:22.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:29:22.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:29:22.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-space/x 2024-09-16T04:29:22.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:29:23.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:29:23.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:29:23.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:29:23.815 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:29:23.815 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:29:23.816 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:29:23.816 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:29:23.816 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:29:23.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:29:23.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:116: TEST_backfill_test_simple: export CEPH_ARGS 2024-09-16T04:29:23.850 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:118: TEST_backfill_test_simple: expr 3 - 1 2024-09-16T04:29:23.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:118: TEST_backfill_test_simple: seq 0 2 2024-09-16T04:29:23.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:118: TEST_backfill_test_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:29:23.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:120: TEST_backfill_test_simple: run_osd td/osd-backfill-space 0 2024-09-16T04:29:23.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:29:23.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:29:23.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T04:29:23.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:29:23.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/0 2024-09-16T04:29:23.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:29:23.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:29:23.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:29:23.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:29:23.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-09-16T04:29:23.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-09-16T04:29:23.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:29:23.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:29:23.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:29:23.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:29:23.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:29:23.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:29:23.857 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:29:23.857 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:29:23.857 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:29:23.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:29:23.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:29:23.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:29:23.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:29:23.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/0 2024-09-16T04:29:23.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:29:23.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=71119095-4ee9-4893-8fde-40549dd2cede 2024-09-16T04:29:23.859 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 71119095-4ee9-4893-8fde-40549dd2cede 2024-09-16T04:29:23.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 71119095-4ee9-4893-8fde-40549dd2cede' 2024-09-16T04:29:23.860 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:29:23.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAjtOdmaktYNBAAlhmxkDXabzG1SunQWJJ6yg== 2024-09-16T04:29:23.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAjtOdmaktYNBAAlhmxkDXabzG1SunQWJJ6yg=="}' 2024-09-16T04:29:23.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 71119095-4ee9-4893-8fde-40549dd2cede -i td/osd-backfill-space/0/new.json 2024-09-16T04:29:24.149 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:29:24.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/0/new.json 2024-09-16T04:29:24.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAjtOdmaktYNBAAlhmxkDXabzG1SunQWJJ6yg== --osd-uuid 71119095-4ee9-4893-8fde-40549dd2cede 2024-09-16T04:29:24.196 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:24.194+0000 7f9b6940b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:29:24.198 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:24.197+0000 7f9b6940b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:29:24.199 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:24.198+0000 7f9b6940b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:29:24.199 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:24.198+0000 7f9b6940b640 -1 bdev(0x559864921c00 td/osd-backfill-space/0/block) open stat got: (1) Operation not permitted 2024-09-16T04:29:24.199 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:24.198+0000 7f9b6940b640 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-09-16T04:29:30.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-09-16T04:29:30.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:29:30.201 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T04:29:30.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T04:29:30.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:29:30.771 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T04:29:30.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T04:29:30.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:29:30.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:29:30.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:29:30.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:29:30.806 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:30.804+0000 7f34f7211640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:29:30.808 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:30.806+0000 7f34f7211640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:29:30.809 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:30.808+0000 7f34f7211640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:29:31.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T04:29:31.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:29:31.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:29:31.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:29:31.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:29:31.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:31.227 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:29:31.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:29:31.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:31.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:31.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:31.914 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:31.913+0000 7f34f7211640 -1 Falling back to public interface 2024-09-16T04:29:32.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:32.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:32.662 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:29:32.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:29:32.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:32.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:33.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:34.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:34.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:34.113 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:29:34.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:29:34.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:34.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:34.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:34.589 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:34.588+0000 7f34f7211640 -1 osd.0 0 log_to_monitors true 2024-09-16T04:29:35.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:35.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:35.534 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:29:35.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:29:35.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:35.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:35.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:36.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:36.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:36.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:29:36.962 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:29:36.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:36.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:37.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:38.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:38.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:38.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:29:38.421 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:29:38.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:38.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:38.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:39.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:39.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:39.841 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:29:39.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:29:39.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:39.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:40.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:41.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:41.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:41.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:29:41.271 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:29:41.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:41.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:41.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:42.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:42.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:42.766 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:29:42.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:29:42.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:42.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:43.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:44.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:44.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:44.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:29:44.191 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:29:44.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:44.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:44.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:45.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:45.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:45.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:29:45.613 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:29:45.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:45.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:46.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:47.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:47.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:47.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:29:47.066 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:29:47.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:47.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:48.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:49.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:49.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:49.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:29:49.082 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:29:49.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:49.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:49.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:50.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:50.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:50.900 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:29:50.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:29:50.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:50.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:51.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:52.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:52.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:52.683 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:29:52.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:29:52.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:52.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:53.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:54.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:54.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:54.537 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:29:54.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:29:54.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:54.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:55.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:56.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:56.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:56.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:29:56.462 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:29:56.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:56.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:57.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:29:58.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:29:58.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:29:58.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:29:58.055 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:29:58.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:29:58.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:29:58.507 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4228422884,v1:127.0.0.1:6803/4228422884] [v2:127.0.0.1:6804/4228422884,v1:127.0.0.1:6805/4228422884] exists,up 71119095-4ee9-4893-8fde-40549dd2cede 2024-09-16T04:29:58.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:29:58.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:29:58.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:29:58.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:118: TEST_backfill_test_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:29:58.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:120: TEST_backfill_test_simple: run_osd td/osd-backfill-space 1 2024-09-16T04:29:58.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:29:58.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:29:58.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T04:29:58.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:29:58.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/1 2024-09-16T04:29:58.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:29:58.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:29:58.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:29:58.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:29:58.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-09-16T04:29:58.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-09-16T04:29:58.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:29:58.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:29:58.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:29:58.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:29:58.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:29:58.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:29:58.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:29:58.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:29:58.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:29:58.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:29:58.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/1 2024-09-16T04:29:58.514 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:29:58.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0241461f-f97a-4592-9e6c-c909e564675c 2024-09-16T04:29:58.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 0241461f-f97a-4592-9e6c-c909e564675c' 2024-09-16T04:29:58.515 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 0241461f-f97a-4592-9e6c-c909e564675c 2024-09-16T04:29:58.515 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:29:58.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBGtOdm8iTVHxAAkNTuy4+nDI48C65uY71XfQ== 2024-09-16T04:29:58.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBGtOdm8iTVHxAAkNTuy4+nDI48C65uY71XfQ=="}' 2024-09-16T04:29:58.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0241461f-f97a-4592-9e6c-c909e564675c -i td/osd-backfill-space/1/new.json 2024-09-16T04:29:59.082 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:29:59.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/1/new.json 2024-09-16T04:29:59.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBGtOdm8iTVHxAAkNTuy4+nDI48C65uY71XfQ== --osd-uuid 0241461f-f97a-4592-9e6c-c909e564675c 2024-09-16T04:29:59.130 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:59.128+0000 7fb8a4efe640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:29:59.132 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:59.129+0000 7fb8a4efe640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:29:59.133 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:59.130+0000 7fb8a4efe640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:29:59.133 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:59.131+0000 7fb8a4efe640 -1 bdev(0x55a70ed43c00 td/osd-backfill-space/1/block) open stat got: (1) Operation not permitted 2024-09-16T04:29:59.133 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:29:59.131+0000 7fb8a4efe640 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-09-16T04:30:05.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-09-16T04:30:05.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:30:05.044 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T04:30:05.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T04:30:05.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:30:05.625 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T04:30:05.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T04:30:05.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:30:05.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:30:05.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:30:05.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:30:05.660 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:05.659+0000 7fdc7cfbd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:30:05.678 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:05.676+0000 7fdc7cfbd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:30:05.678 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:05.677+0000 7fdc7cfbd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:30:06.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T04:30:06.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:30:06.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:30:06.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:30:06.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:30:06.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:06.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:30:06.124 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:30:06.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:06.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:06.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:07.028 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:07.027+0000 7fdc7cfbd640 -1 Falling back to public interface 2024-09-16T04:30:07.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:07.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:07.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:30:07.593 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:30:07.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:07.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:08.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:09.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:09.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:09.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:30:09.046 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:30:09.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:09.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:09.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:10.208 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:10.206+0000 7fdc7cfbd640 -1 osd.1 0 log_to_monitors true 2024-09-16T04:30:10.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:10.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:10.505 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:30:10.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:30:10.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:10.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:11.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:12.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:12.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:12.093 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:30:12.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:30:12.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:12.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:12.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:13.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:13.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:13.533 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:30:13.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:30:13.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:13.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:14.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:15.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:15.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:15.058 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:30:15.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:30:15.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:15.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:16.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:16.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:16.619 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:30:16.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:30:16.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:16.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:17.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:18.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:18.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:18.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:30:18.099 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:30:18.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:18.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:18.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:19.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:19.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:19.528 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:30:19.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:30:19.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:19.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:20.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:21.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:21.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:21.092 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:30:21.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:30:21.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:21.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:21.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:22.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:22.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:22.608 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:30:22.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:30:22.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:22.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:23.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:24.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:24.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:24.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:30:24.367 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:30:24.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:24.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:25.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:30:26.495 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:30:26.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:26.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:27.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:28.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:28.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:28.503 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:30:28.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:30:28.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:28.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:29.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:30.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:30.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:30.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:30:30.397 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:30:30.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:30.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:31.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:32.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:32.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:32.470 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:30:32.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:30:32.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:32.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:33.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:34.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:34.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:34.113 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:30:34.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:30:34.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:34.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:30:34.533 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1662003458,v1:127.0.0.1:6811/1662003458] [v2:127.0.0.1:6812/1662003458,v1:127.0.0.1:6813/1662003458] exists,up 0241461f-f97a-4592-9e6c-c909e564675c 2024-09-16T04:30:34.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:30:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:30:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:30:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:118: TEST_backfill_test_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:30:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:120: TEST_backfill_test_simple: run_osd td/osd-backfill-space 2 2024-09-16T04:30:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:30:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:30:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T04:30:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:30:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/2 2024-09-16T04:30:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:30:34.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:30:34.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:30:34.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:30:34.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-09-16T04:30:34.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-09-16T04:30:34.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:30:34.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:30:34.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:30:34.539 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:30:34.539 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:30:34.539 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:30:34.539 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:30:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:30:34.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:30:34.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/2 2024-09-16T04:30:34.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:30:34.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d837e273-783c-48a7-8a56-1c4cd24ff8cd 2024-09-16T04:30:34.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 d837e273-783c-48a7-8a56-1c4cd24ff8cd' 2024-09-16T04:30:34.541 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 d837e273-783c-48a7-8a56-1c4cd24ff8cd 2024-09-16T04:30:34.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:30:34.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBqtOdmvJVZIRAAMxH7UQ2VRQSirRY9v8MC7A== 2024-09-16T04:30:34.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBqtOdmvJVZIRAAMxH7UQ2VRQSirRY9v8MC7A=="}' 2024-09-16T04:30:34.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d837e273-783c-48a7-8a56-1c4cd24ff8cd -i td/osd-backfill-space/2/new.json 2024-09-16T04:30:35.050 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:30:35.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/2/new.json 2024-09-16T04:30:35.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBqtOdmvJVZIRAAMxH7UQ2VRQSirRY9v8MC7A== --osd-uuid d837e273-783c-48a7-8a56-1c4cd24ff8cd 2024-09-16T04:30:35.099 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:35.097+0000 7ff64ce0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:30:35.101 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:35.099+0000 7ff64ce0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:30:35.101 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:35.100+0000 7ff64ce0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:30:35.102 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:35.101+0000 7ff64ce0f640 -1 bdev(0x55e5e2db7c00 td/osd-backfill-space/2/block) open stat got: (1) Operation not permitted 2024-09-16T04:30:35.102 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:35.101+0000 7ff64ce0f640 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-09-16T04:30:41.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-09-16T04:30:41.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:30:41.384 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T04:30:41.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T04:30:41.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:30:41.962 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T04:30:41.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T04:30:41.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:30:41.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:30:41.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:30:41.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:30:41.997 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:41.996+0000 7f2bac80d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:30:41.999 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:41.998+0000 7f2bac80d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:30:42.000 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:41.999+0000 7f2bac80d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:30:42.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T04:30:42.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:30:42.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:30:42.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:30:42.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:30:42.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:42.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:30:42.432 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:30:42.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:42.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:30:42.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:43.584 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:43.583+0000 7f2bac80d640 -1 Falling back to public interface 2024-09-16T04:30:43.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:43.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:43.891 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:30:43.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:30:43.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:43.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:30:44.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:45.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:45.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:45.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:30:45.315 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:30:45.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:45.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:30:45.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:46.371 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:30:46.370+0000 7f2bac80d640 -1 osd.2 0 log_to_monitors true 2024-09-16T04:30:46.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:46.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:46.778 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:30:46.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:30:46.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:46.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:30:47.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:48.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:48.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:48.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:30:48.208 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:30:48.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:48.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:30:48.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:49.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:49.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:49.629 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:30:49.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:30:49.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:49.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:30:50.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:51.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:51.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:51.280 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:30:51.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:30:51.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:51.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:30:51.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:52.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:52.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:52.710 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:30:52.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:30:52.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:52.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:30:53.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:54.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:54.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:54.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:30:54.221 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:30:54.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:54.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:30:54.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:55.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:55.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:55.657 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:30:55.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:30:55.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:55.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:30:56.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:57.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:57.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:57.224 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:30:57.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:30:57.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:57.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:30:57.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:30:58.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:30:58.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:30:58.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:30:58.645 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:30:58.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:30:58.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:30:59.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:31:00.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:31:00.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:31:00.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:31:00.669 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:31:00.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:31:00.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:31:01.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:31:02.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:31:02.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:31:02.429 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:31:02.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:31:02.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:31:02.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:31:03.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:31:04.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:31:04.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:31:04.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:31:04.456 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:31:04.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:31:04.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:31:05.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:31:06.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:31:06.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:31:06.246 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:31:06.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:31:06.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:31:06.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:31:07.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:31:08.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:31:08.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:31:08.167 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:31:08.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:31:08.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:31:08.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:31:08.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:31:09.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:31:09.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:31:09.737 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:31:09.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:31:09.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:31:09.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:31:10.155 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1450101211,v1:127.0.0.1:6819/1450101211] [v2:127.0.0.1:6820/1450101211,v1:127.0.0.1:6821/1450101211] exists,up d837e273-783c-48a7-8a56-1c4cd24ff8cd 2024-09-16T04:31:10.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:31:10.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:31:10.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:31:10.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:123: TEST_backfill_test_simple: ceph osd set-backfillfull-ratio .85 2024-09-16T04:31:10.773 INFO:tasks.workunit.client.0.smithi026.stderr:osd set-backfillfull-ratio 0.85 2024-09-16T04:31:10.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:125: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:10.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:125: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:10.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:127: TEST_backfill_test_simple: create_pool test1 1 1 2024-09-16T04:31:10.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test1 1 1 2024-09-16T04:31:11.426 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' already exists 2024-09-16T04:31:11.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:31:12.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:128: TEST_backfill_test_simple: ceph osd pool set test1 size 1 --yes-i-really-mean-it 2024-09-16T04:31:13.569 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 1 2024-09-16T04:31:13.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:125: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:13.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:127: TEST_backfill_test_simple: create_pool test2 1 1 2024-09-16T04:31:13.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test2 1 1 2024-09-16T04:31:14.229 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' already exists 2024-09-16T04:31:14.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:31:15.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:128: TEST_backfill_test_simple: ceph osd pool set test2 size 1 --yes-i-really-mean-it 2024-09-16T04:31:16.175 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 2 size to 1 2024-09-16T04:31:16.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:131: TEST_backfill_test_simple: wait_for_clean 2024-09-16T04:31:16.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T04:31:16.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T04:31:16.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T04:31:16.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T04:31:16.188 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:31:16.188 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:31:16.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:31:16.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:31:16.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:31:16.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T04:31:16.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T04:31:16.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T04:31:16.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T04:31:16.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:31:16.283 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:31:16.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:31:16.783 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:31:16.783 INFO:tasks.workunit.client.0.smithi026.stderr:2' 2024-09-16T04:31:16.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:31:16.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:31:16.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:31:16.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836502 2024-09-16T04:31:16.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836502 2024-09-16T04:31:16.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836502' 2024-09-16T04:31:16.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:31:16.916 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:31:17.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672977 2024-09-16T04:31:17.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672977 2024-09-16T04:31:17.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836502 1-42949672977' 2024-09-16T04:31:17.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:31:17.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:31:17.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509445 2024-09-16T04:31:17.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509445 2024-09-16T04:31:17.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836502 1-42949672977 2-64424509445' 2024-09-16T04:31:17.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:31:17.251 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836502 2024-09-16T04:31:17.252 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:31:17.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:31:17.253 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836502 2024-09-16T04:31:17.253 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:31:17.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836502 2024-09-16T04:31:17.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836502' 2024-09-16T04:31:17.254 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836502 2024-09-16T04:31:17.254 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:31:17.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836500 -lt 21474836502 2024-09-16T04:31:17.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:31:18.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:31:18.697 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:31:19.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836502 -lt 21474836502 2024-09-16T04:31:19.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:31:19.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672977 2024-09-16T04:31:19.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:31:19.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:31:19.183 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672977 2024-09-16T04:31:19.183 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:31:19.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672977 2024-09-16T04:31:19.184 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672977 2024-09-16T04:31:19.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672977' 2024-09-16T04:31:19.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:31:19.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672977 -lt 42949672977 2024-09-16T04:31:19.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:31:19.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509445 2024-09-16T04:31:19.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:31:19.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:31:19.667 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509445 2024-09-16T04:31:19.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:31:19.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509445 2024-09-16T04:31:19.669 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509445 2024-09-16T04:31:19.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509445' 2024-09-16T04:31:19.670 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:31:20.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509445 -lt 64424509445 2024-09-16T04:31:20.141 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T04:31:20.141 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:31:20.141 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:31:20.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 2 == 0 2024-09-16T04:31:20.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:31:20.736 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:31:20.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:31:20.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:31:20.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:31:20.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:31:20.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:31:21.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=2 2024-09-16T04:31:21.147 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:31:21.148 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:31:21.148 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:31:21.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 2 = 2 2024-09-16T04:31:21.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T04:31:21.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T04:31:21.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:136: TEST_backfill_test_simple: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=4 2024-09-16T04:31:21.704 INFO:tasks.workunit.client.0.smithi026.stderr:4+0 records in 2024-09-16T04:31:21.704 INFO:tasks.workunit.client.0.smithi026.stderr:4+0 records out 2024-09-16T04:31:21.704 INFO:tasks.workunit.client.0.smithi026.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 7.2037e-05 s, 56.9 MB/s 2024-09-16T04:31:21.705 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: seq 1 600 2024-09-16T04:31:21.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:21.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:21.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:21.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:31:21.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:21.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:31:21.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:21.910 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:21.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:21.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:31:22.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:22.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:31:22.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:22.178 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:22.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:22.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:31:22.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:22.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:31:22.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:22.345 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:22.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:22.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:31:22.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:22.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:31:22.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:22.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:22.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:22.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:31:22.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:22.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:31:22.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:22.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:22.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:22.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:31:22.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:22.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:31:22.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:22.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:22.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:22.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:31:22.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:22.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:31:23.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:23.107 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:23.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:23.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:31:23.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:23.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:31:23.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:23.274 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:23.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:23.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:31:23.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:23.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:31:23.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:23.441 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:23.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:23.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:31:23.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:23.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:31:23.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:23.608 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:23.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:23.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:31:23.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:23.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:31:23.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:23.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:23.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:23.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:31:23.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:23.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:31:23.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:23.943 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:23.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:23.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:31:24.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:24.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:31:24.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:24.177 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:24.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:24.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:31:24.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:24.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:31:24.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:24.345 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:24.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:24.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:31:24.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:24.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:31:24.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:24.528 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:24.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:24.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:31:24.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:24.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:31:24.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:24.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:24.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:24.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:31:24.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:24.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:31:24.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:24.862 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:24.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:24.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:31:24.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:24.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:31:25.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:25.165 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:25.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:25.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:31:25.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:25.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:31:25.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:25.332 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:25.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:25.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:31:25.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:25.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:31:25.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:25.499 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:25.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:25.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:31:25.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:25.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:31:25.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:25.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:25.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:25.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:31:25.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:25.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:31:25.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:25.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:25.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:25.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:31:25.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:25.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:31:26.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:26.001 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:26.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:26.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:31:26.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:26.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:31:26.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:26.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:26.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:26.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:31:26.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:26.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:31:26.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:26.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:26.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:26.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:31:26.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:26.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:31:26.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:26.528 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:26.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:26.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:31:26.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:26.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:31:26.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:26.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:26.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:26.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:31:26.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:26.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:31:26.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:26.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:26.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:26.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:31:26.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:26.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:31:27.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:27.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:27.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:27.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:31:27.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:27.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:31:27.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:27.273 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:27.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:27.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:31:27.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:27.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:31:27.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:27.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:27.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:27.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:31:27.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:27.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:31:27.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:27.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:27.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:27.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:31:27.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:27.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:31:27.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:27.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:27.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:27.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:31:27.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:27.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:31:27.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:27.950 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:27.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:27.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:31:28.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:28.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:31:28.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:28.168 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:28.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:28.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:31:28.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:28.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:31:28.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:28.335 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:28.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:28.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:31:28.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:28.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:31:28.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:28.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:28.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:28.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:31:28.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:28.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:31:28.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:28.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:28.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:28.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:31:28.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:28.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:31:28.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:28.862 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:28.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:28.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:31:28.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:28.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:31:29.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:29.097 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:29.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:29.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:31:29.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:29.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:31:29.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:29.272 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:29.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:29.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:31:29.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:29.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:31:29.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:29.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:29.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:29.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:31:29.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:29.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:31:29.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:29.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:29.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:29.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:31:29.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:29.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:31:29.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:29.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:29.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:29.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:31:29.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:29.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:31:29.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:29.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:29.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:29.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:31:30.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:30.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:31:30.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:30.218 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:30.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:30.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:31:30.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:30.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:31:30.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:30.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:30.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:30.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:31:30.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:30.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:31:30.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:30.552 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:30.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:30.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:31:30.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:30.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:31:30.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:30.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:30.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:30.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:31:30.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:30.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:31:30.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:30.887 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:30.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:30.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:31:31.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:31.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:31:31.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:31.146 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:31.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:31.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:31:31.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:31.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:31:31.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:31.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:31.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:31.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:31:31.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:31.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:31:31.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:31.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:31.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:31.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:31:31.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:31.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:31:31.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:31.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:31.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:31.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:31:31.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:31.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:31:31.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:31.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:31.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:31.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:31:31.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:31.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:31:31.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:31.983 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:31.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:31.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:31:32.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:32.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:31:32.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:32.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:32.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:32.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:31:32.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:32.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:31:32.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:32.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:32.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:32.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:31:32.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:32.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:31:32.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:32.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:32.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:32.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:31:32.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:32.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:31:32.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:32.694 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:32.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:32.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:31:32.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:32.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:31:32.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:32.861 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:32.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:32.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:31:32.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:32.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:31:33.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:33.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:33.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:33.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:31:33.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:33.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:31:33.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:33.263 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:33.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:33.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:31:33.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:33.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:31:33.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:33.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:33.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:33.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:31:33.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:33.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:31:33.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:33.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:33.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:33.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:31:33.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:33.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:31:33.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:33.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:33.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:33.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:31:33.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:33.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:31:33.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:33.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:33.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:33.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:31:34.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:34.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:31:34.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:34.141 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:34.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:34.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:31:34.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:34.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:31:34.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:34.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:34.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:34.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:31:34.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:34.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:31:34.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:34.484 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:34.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:34.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:31:34.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:34.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:31:34.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:34.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:34.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:34.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:31:34.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:34.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:31:34.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:34.819 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:34.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:34.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:31:34.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:34.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:31:35.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:35.053 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:35.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:35.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:31:35.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:35.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:31:35.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:35.220 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:35.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:35.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:31:35.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:35.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:31:35.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:35.405 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:35.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:35.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:31:35.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:35.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:31:35.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:35.580 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:35.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:35.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:31:35.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:35.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:31:35.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:35.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:35.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:35.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:31:35.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:35.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:31:35.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:35.915 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:35.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:35.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:31:35.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:35.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:31:36.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:36.087 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:36.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:36.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:31:36.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:36.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:31:36.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:36.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:36.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:36.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:31:36.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:36.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:31:36.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:36.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:36.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:36.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:31:36.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:36.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:31:36.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:36.611 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:36.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:36.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:31:36.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:36.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:31:36.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:36.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:36.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:36.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:31:36.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:36.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:31:36.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:36.954 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:36.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:36.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:31:37.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:37.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:31:37.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:37.155 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:37.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:37.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:31:37.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:37.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:31:37.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:37.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:37.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:37.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:31:37.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:37.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:31:37.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:37.490 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:37.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:37.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:31:37.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:37.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:31:37.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:37.657 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:37.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:37.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:31:37.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:37.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:31:37.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:37.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:37.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:37.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:31:37.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:37.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:31:38.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:38.025 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:38.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:38.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:31:38.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:38.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:31:38.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:38.226 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:38.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:38.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:31:38.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:38.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:31:38.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:38.393 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:38.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:38.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:31:38.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:38.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:31:38.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:38.569 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:38.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:38.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:31:38.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:38.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:31:38.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:38.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:38.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:38.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:31:38.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:38.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:31:38.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:38.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:38.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:38.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:31:39.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:39.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:31:39.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:39.130 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:39.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:39.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:31:39.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:39.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:31:39.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:39.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:39.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:39.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:31:39.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:39.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:31:39.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:39.472 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:39.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:39.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:31:39.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:39.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:31:39.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:39.640 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:39.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:39.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:31:39.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:39.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:31:39.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:39.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:39.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:39.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:31:39.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:39.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:31:39.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:39.974 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:39.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:39.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:31:40.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:40.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:31:40.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:40.159 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:40.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:40.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:31:40.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:40.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:31:40.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:40.326 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:40.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:40.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:31:40.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:40.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:31:40.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:40.518 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:40.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:40.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:31:40.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:40.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:31:40.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:40.686 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:40.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:40.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:31:40.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:40.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:31:40.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:40.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:40.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:40.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:31:40.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:40.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:31:41.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:41.062 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:41.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:41.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:31:41.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:41.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:31:41.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:41.230 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:41.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:41.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:31:41.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:41.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:31:41.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:41.397 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:41.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:41.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:31:41.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:41.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:31:41.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:41.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:41.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:41.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:31:41.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:41.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:31:41.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:41.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:41.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:41.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:31:41.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:41.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:31:41.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:41.899 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:41.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:41.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:31:41.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:41.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:31:42.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:42.066 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:42.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:42.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:31:42.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:42.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:31:42.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:42.251 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:42.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:42.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:31:42.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:42.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:31:42.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:42.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:42.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:42.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:31:42.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:42.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:31:42.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:42.610 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:42.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:42.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:31:42.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:42.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:31:42.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:42.785 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:42.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:42.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:31:42.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:42.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:31:42.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:42.998 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:42.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:42.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:31:43.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:43.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:31:43.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:43.196 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:43.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:43.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:31:43.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:43.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:31:43.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:43.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:43.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:43.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:31:43.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:43.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:31:43.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:43.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:43.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:43.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:31:43.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:43.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:31:43.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:43.698 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:43.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:43.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:31:43.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:43.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:31:43.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:43.865 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:43.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:43.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:31:43.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:43.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:31:44.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:44.032 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:44.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:44.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:31:44.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:44.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:31:44.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:44.241 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:44.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:44.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:31:44.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:44.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:31:44.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:44.409 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:44.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:44.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:31:44.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:44.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:31:44.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:44.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:44.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:44.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:31:44.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:44.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:31:44.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:44.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:44.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:44.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:31:44.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:44.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:31:44.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:44.910 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:44.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:44.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:31:45.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:45.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:31:45.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:45.145 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:45.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:45.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:31:45.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:45.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:31:45.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:45.312 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:45.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:45.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:31:45.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:45.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:31:45.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:45.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:45.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:45.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:31:45.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:45.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:31:45.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:45.697 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:45.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:45.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:31:45.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:45.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:31:45.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:45.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:45.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:45.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:31:45.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:45.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:31:46.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:46.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:46.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:46.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:31:46.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:46.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:31:46.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:46.241 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:46.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:46.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:31:46.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:46.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:31:46.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:46.408 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:46.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:46.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:31:46.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:46.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:31:46.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:46.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:46.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:46.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:31:46.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:46.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:31:46.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:46.751 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:46.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:46.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:31:46.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:46.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:31:46.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:46.927 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:46.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:46.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:31:47.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:47.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:31:47.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:47.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:47.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:47.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:31:47.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:47.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:31:47.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:47.329 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:47.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:47.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:31:47.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:47.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:31:47.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:47.496 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:47.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:47.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:31:47.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:47.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:31:47.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:47.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:47.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:47.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:31:47.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:47.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:31:47.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:47.831 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:47.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:47.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:31:47.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:47.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:31:47.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:47.998 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:47.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:47.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:31:48.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:48.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:31:48.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:48.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:48.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:48.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:31:48.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:48.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:31:48.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:48.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:48.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:48.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:31:48.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:48.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:31:48.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:48.517 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:48.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:48.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:31:48.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:48.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:31:48.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:48.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:48.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:48.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:31:48.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:48.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:31:48.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:48.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:48.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:48.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:31:48.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:48.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:31:49.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:49.044 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:49.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:49.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:31:49.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:49.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:31:49.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:49.211 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:49.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:49.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:31:49.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:49.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:31:49.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:49.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:49.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:49.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:31:49.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:49.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:31:49.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:49.554 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:49.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:49.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:31:49.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:49.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:31:49.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:49.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:49.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:49.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:31:49.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:49.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:31:49.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:49.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:49.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:49.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:31:49.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:49.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:31:50.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:50.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:50.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:50.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:31:50.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:50.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:31:50.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:50.240 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:50.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:31:50.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:50.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:31:50.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:50.407 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:50.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:50.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:31:50.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:50.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:31:50.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:50.583 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:50.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:50.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:31:50.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:50.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:31:50.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:50.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:50.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:50.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:31:50.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:50.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:31:50.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:50.926 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:50.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:50.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:31:51.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:51.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:31:51.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:51.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:51.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:51.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:31:51.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:51.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:31:51.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:51.303 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:51.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:51.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:31:51.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:51.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:31:51.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:51.479 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:51.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:51.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:31:51.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:51.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:31:51.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:51.671 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:51.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:51.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:31:51.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:51.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:31:51.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:51.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:51.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:51.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:31:51.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:51.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:31:52.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:52.006 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:52.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:52.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:31:52.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:52.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:31:52.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:52.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:52.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:52.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:31:52.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:52.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:31:52.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:52.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:52.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:52.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:31:52.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:52.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:31:52.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:52.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:52.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:52.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:31:52.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:52.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:31:52.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:52.683 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:52.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:52.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:31:52.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:52.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:31:52.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:52.850 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:52.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:52.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:31:52.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:52.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:31:53.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:53.060 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:53.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:53.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:31:53.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:53.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:31:53.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:53.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:53.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:53.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:31:53.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:53.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:31:53.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:53.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:53.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:53.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:31:53.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:53.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:31:53.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:53.571 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:53.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:53.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:31:53.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:53.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:31:53.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:53.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:53.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:53.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:31:53.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:53.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:31:53.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:53.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:53.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:53.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:31:53.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:53.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:31:54.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:54.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:54.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:54.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:31:54.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:54.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:31:54.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:54.248 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:54.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:54.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:31:54.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:54.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:31:54.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:54.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:54.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:54.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:31:54.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:54.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:31:54.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:54.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:54.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:54.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:31:54.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:54.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:31:54.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:54.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:54.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:54.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:31:54.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:54.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:31:54.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:54.925 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:54.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:54.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:31:55.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:55.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:31:55.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:55.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:55.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:55.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:31:55.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:55.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:31:55.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:55.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:55.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:55.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:31:55.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:55.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:31:55.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:55.486 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:55.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:55.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:31:55.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:55.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:31:55.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:55.654 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:55.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:55.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:31:55.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:55.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:31:56.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:56.155 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:56.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:56.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:31:56.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:56.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:31:56.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:56.355 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:56.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:56.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:31:56.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:56.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:31:56.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:56.523 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:56.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:56.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:31:56.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:56.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:31:56.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:56.690 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:56.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:56.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:31:56.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:56.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:31:56.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:56.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:56.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:56.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:31:56.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:56.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:31:57.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:57.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:57.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:57.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:31:57.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:57.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:31:57.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:57.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:57.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:31:57.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:57.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:31:57.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:57.393 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:57.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:57.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:31:57.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:57.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:31:57.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:57.568 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:57.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:57.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:31:57.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:57.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:31:57.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:57.736 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:57.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:57.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj201 td/osd-backfill-space/datafile 2024-09-16T04:31:57.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:57.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj201 td/osd-backfill-space/datafile 2024-09-16T04:31:57.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:57.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:57.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:57.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj202 td/osd-backfill-space/datafile 2024-09-16T04:31:57.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:57.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj202 td/osd-backfill-space/datafile 2024-09-16T04:31:58.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:58.093 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:58.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:58.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj203 td/osd-backfill-space/datafile 2024-09-16T04:31:58.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:58.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj203 td/osd-backfill-space/datafile 2024-09-16T04:31:58.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:58.280 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:58.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:58.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj204 td/osd-backfill-space/datafile 2024-09-16T04:31:58.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:58.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj204 td/osd-backfill-space/datafile 2024-09-16T04:31:58.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:58.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:58.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:58.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj205 td/osd-backfill-space/datafile 2024-09-16T04:31:58.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:58.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj205 td/osd-backfill-space/datafile 2024-09-16T04:31:58.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:58.615 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:58.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:58.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj206 td/osd-backfill-space/datafile 2024-09-16T04:31:58.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:58.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj206 td/osd-backfill-space/datafile 2024-09-16T04:31:58.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:58.782 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:58.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:58.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj207 td/osd-backfill-space/datafile 2024-09-16T04:31:58.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:58.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj207 td/osd-backfill-space/datafile 2024-09-16T04:31:58.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:58.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:58.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:58.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj208 td/osd-backfill-space/datafile 2024-09-16T04:31:59.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:59.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj208 td/osd-backfill-space/datafile 2024-09-16T04:31:59.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:59.141 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:59.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:59.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj209 td/osd-backfill-space/datafile 2024-09-16T04:31:59.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:59.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj209 td/osd-backfill-space/datafile 2024-09-16T04:31:59.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:59.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:59.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:59.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj210 td/osd-backfill-space/datafile 2024-09-16T04:31:59.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:59.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj210 td/osd-backfill-space/datafile 2024-09-16T04:31:59.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:59.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:59.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:59.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj211 td/osd-backfill-space/datafile 2024-09-16T04:31:59.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:59.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj211 td/osd-backfill-space/datafile 2024-09-16T04:31:59.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:59.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:59.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:59.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj212 td/osd-backfill-space/datafile 2024-09-16T04:31:59.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:59.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj212 td/osd-backfill-space/datafile 2024-09-16T04:31:59.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:59.819 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:59.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:59.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj213 td/osd-backfill-space/datafile 2024-09-16T04:31:59.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:59.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj213 td/osd-backfill-space/datafile 2024-09-16T04:31:59.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:31:59.986 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:31:59.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:31:59.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj214 td/osd-backfill-space/datafile 2024-09-16T04:32:00.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:00.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj214 td/osd-backfill-space/datafile 2024-09-16T04:32:00.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:00.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:00.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:00.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj215 td/osd-backfill-space/datafile 2024-09-16T04:32:00.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:00.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj215 td/osd-backfill-space/datafile 2024-09-16T04:32:00.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:00.338 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:00.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:00.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj216 td/osd-backfill-space/datafile 2024-09-16T04:32:00.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:00.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj216 td/osd-backfill-space/datafile 2024-09-16T04:32:00.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:00.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:00.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:00.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj217 td/osd-backfill-space/datafile 2024-09-16T04:32:00.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:00.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj217 td/osd-backfill-space/datafile 2024-09-16T04:32:00.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:00.689 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:00.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:00.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj218 td/osd-backfill-space/datafile 2024-09-16T04:32:00.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:00.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj218 td/osd-backfill-space/datafile 2024-09-16T04:32:00.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:00.874 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:00.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:00.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj219 td/osd-backfill-space/datafile 2024-09-16T04:32:01.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:01.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj219 td/osd-backfill-space/datafile 2024-09-16T04:32:01.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:01.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:01.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:01.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj220 td/osd-backfill-space/datafile 2024-09-16T04:32:01.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:01.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj220 td/osd-backfill-space/datafile 2024-09-16T04:32:01.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:01.286 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:01.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:01.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj221 td/osd-backfill-space/datafile 2024-09-16T04:32:01.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:01.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj221 td/osd-backfill-space/datafile 2024-09-16T04:32:01.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:01.562 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:01.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:01.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj222 td/osd-backfill-space/datafile 2024-09-16T04:32:01.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:01.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj222 td/osd-backfill-space/datafile 2024-09-16T04:32:01.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:01.730 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:01.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:01.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj223 td/osd-backfill-space/datafile 2024-09-16T04:32:01.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:01.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj223 td/osd-backfill-space/datafile 2024-09-16T04:32:01.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:01.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:01.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:01.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj224 td/osd-backfill-space/datafile 2024-09-16T04:32:01.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:01.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj224 td/osd-backfill-space/datafile 2024-09-16T04:32:02.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:02.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:02.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:02.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj225 td/osd-backfill-space/datafile 2024-09-16T04:32:02.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:02.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj225 td/osd-backfill-space/datafile 2024-09-16T04:32:02.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:02.248 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:02.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:02.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj226 td/osd-backfill-space/datafile 2024-09-16T04:32:02.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:02.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj226 td/osd-backfill-space/datafile 2024-09-16T04:32:02.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:02.424 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:02.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:02.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj227 td/osd-backfill-space/datafile 2024-09-16T04:32:02.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:02.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj227 td/osd-backfill-space/datafile 2024-09-16T04:32:02.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:02.599 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:02.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:02.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj228 td/osd-backfill-space/datafile 2024-09-16T04:32:02.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:02.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj228 td/osd-backfill-space/datafile 2024-09-16T04:32:02.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:02.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:02.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:02.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj229 td/osd-backfill-space/datafile 2024-09-16T04:32:02.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:02.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj229 td/osd-backfill-space/datafile 2024-09-16T04:32:02.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:02.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:02.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:02.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj230 td/osd-backfill-space/datafile 2024-09-16T04:32:03.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:03.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj230 td/osd-backfill-space/datafile 2024-09-16T04:32:03.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:03.152 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:03.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:03.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj231 td/osd-backfill-space/datafile 2024-09-16T04:32:03.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:03.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj231 td/osd-backfill-space/datafile 2024-09-16T04:32:03.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:03.327 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:03.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:03.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj232 td/osd-backfill-space/datafile 2024-09-16T04:32:03.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:03.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj232 td/osd-backfill-space/datafile 2024-09-16T04:32:03.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:03.520 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:03.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:03.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj233 td/osd-backfill-space/datafile 2024-09-16T04:32:03.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:03.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj233 td/osd-backfill-space/datafile 2024-09-16T04:32:03.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:03.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:03.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:03.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj234 td/osd-backfill-space/datafile 2024-09-16T04:32:03.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:03.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj234 td/osd-backfill-space/datafile 2024-09-16T04:32:03.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:03.863 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:03.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:03.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj235 td/osd-backfill-space/datafile 2024-09-16T04:32:03.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:03.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj235 td/osd-backfill-space/datafile 2024-09-16T04:32:04.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:04.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:04.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:04.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj236 td/osd-backfill-space/datafile 2024-09-16T04:32:04.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:04.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj236 td/osd-backfill-space/datafile 2024-09-16T04:32:04.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:04.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:04.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:04.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj237 td/osd-backfill-space/datafile 2024-09-16T04:32:04.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:04.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj237 td/osd-backfill-space/datafile 2024-09-16T04:32:04.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:04.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:04.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:04.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj238 td/osd-backfill-space/datafile 2024-09-16T04:32:04.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:04.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj238 td/osd-backfill-space/datafile 2024-09-16T04:32:04.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:04.582 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:04.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:04.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj239 td/osd-backfill-space/datafile 2024-09-16T04:32:04.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:04.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj239 td/osd-backfill-space/datafile 2024-09-16T04:32:04.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:04.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:04.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:04.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj240 td/osd-backfill-space/datafile 2024-09-16T04:32:04.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:04.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj240 td/osd-backfill-space/datafile 2024-09-16T04:32:04.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:04.925 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:04.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:04.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj241 td/osd-backfill-space/datafile 2024-09-16T04:32:05.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:05.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj241 td/osd-backfill-space/datafile 2024-09-16T04:32:05.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:05.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:05.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:05.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj242 td/osd-backfill-space/datafile 2024-09-16T04:32:05.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:05.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj242 td/osd-backfill-space/datafile 2024-09-16T04:32:05.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:05.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:05.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:05.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj243 td/osd-backfill-space/datafile 2024-09-16T04:32:05.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:05.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj243 td/osd-backfill-space/datafile 2024-09-16T04:32:05.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:05.511 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:05.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:05.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj244 td/osd-backfill-space/datafile 2024-09-16T04:32:05.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:05.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj244 td/osd-backfill-space/datafile 2024-09-16T04:32:05.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:05.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:05.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:05.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj245 td/osd-backfill-space/datafile 2024-09-16T04:32:05.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:05.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj245 td/osd-backfill-space/datafile 2024-09-16T04:32:05.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:05.862 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:05.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:05.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj246 td/osd-backfill-space/datafile 2024-09-16T04:32:05.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:05.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj246 td/osd-backfill-space/datafile 2024-09-16T04:32:06.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:06.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:06.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:06.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj247 td/osd-backfill-space/datafile 2024-09-16T04:32:06.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:06.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj247 td/osd-backfill-space/datafile 2024-09-16T04:32:06.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:06.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:06.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:06.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj248 td/osd-backfill-space/datafile 2024-09-16T04:32:06.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:06.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj248 td/osd-backfill-space/datafile 2024-09-16T04:32:06.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:06.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:06.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:06.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj249 td/osd-backfill-space/datafile 2024-09-16T04:32:06.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:06.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj249 td/osd-backfill-space/datafile 2024-09-16T04:32:06.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:06.641 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:06.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:06.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj250 td/osd-backfill-space/datafile 2024-09-16T04:32:06.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:06.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj250 td/osd-backfill-space/datafile 2024-09-16T04:32:06.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:06.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:06.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:06.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj251 td/osd-backfill-space/datafile 2024-09-16T04:32:06.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:06.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj251 td/osd-backfill-space/datafile 2024-09-16T04:32:07.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:07.050 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:07.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:07.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj252 td/osd-backfill-space/datafile 2024-09-16T04:32:07.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:07.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj252 td/osd-backfill-space/datafile 2024-09-16T04:32:07.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:07.218 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:07.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:07.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj253 td/osd-backfill-space/datafile 2024-09-16T04:32:07.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:07.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj253 td/osd-backfill-space/datafile 2024-09-16T04:32:07.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:07.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:07.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:07.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj254 td/osd-backfill-space/datafile 2024-09-16T04:32:07.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:07.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj254 td/osd-backfill-space/datafile 2024-09-16T04:32:07.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:07.552 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:07.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:07.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj255 td/osd-backfill-space/datafile 2024-09-16T04:32:07.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:07.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj255 td/osd-backfill-space/datafile 2024-09-16T04:32:07.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:07.719 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:07.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:07.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj256 td/osd-backfill-space/datafile 2024-09-16T04:32:07.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:07.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj256 td/osd-backfill-space/datafile 2024-09-16T04:32:07.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:07.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:07.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:07.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj257 td/osd-backfill-space/datafile 2024-09-16T04:32:07.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:07.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj257 td/osd-backfill-space/datafile 2024-09-16T04:32:08.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:08.054 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:08.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:08.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj258 td/osd-backfill-space/datafile 2024-09-16T04:32:08.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:08.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj258 td/osd-backfill-space/datafile 2024-09-16T04:32:08.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:08.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:08.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:08.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj259 td/osd-backfill-space/datafile 2024-09-16T04:32:08.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:08.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj259 td/osd-backfill-space/datafile 2024-09-16T04:32:08.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:08.430 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:08.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:08.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj260 td/osd-backfill-space/datafile 2024-09-16T04:32:08.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:08.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj260 td/osd-backfill-space/datafile 2024-09-16T04:32:08.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:08.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:08.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:08.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj261 td/osd-backfill-space/datafile 2024-09-16T04:32:08.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:08.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj261 td/osd-backfill-space/datafile 2024-09-16T04:32:08.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:08.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:08.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:08.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj262 td/osd-backfill-space/datafile 2024-09-16T04:32:08.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:08.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj262 td/osd-backfill-space/datafile 2024-09-16T04:32:08.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:08.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:08.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:08.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj263 td/osd-backfill-space/datafile 2024-09-16T04:32:09.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:09.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj263 td/osd-backfill-space/datafile 2024-09-16T04:32:09.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:09.192 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:09.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:09.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj264 td/osd-backfill-space/datafile 2024-09-16T04:32:09.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:09.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj264 td/osd-backfill-space/datafile 2024-09-16T04:32:09.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:09.359 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:09.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:09.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj265 td/osd-backfill-space/datafile 2024-09-16T04:32:09.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:09.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj265 td/osd-backfill-space/datafile 2024-09-16T04:32:09.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:09.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:09.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:09.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj266 td/osd-backfill-space/datafile 2024-09-16T04:32:09.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:09.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj266 td/osd-backfill-space/datafile 2024-09-16T04:32:09.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:09.710 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:09.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:09.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj267 td/osd-backfill-space/datafile 2024-09-16T04:32:09.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:09.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj267 td/osd-backfill-space/datafile 2024-09-16T04:32:09.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:09.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:09.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:09.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj268 td/osd-backfill-space/datafile 2024-09-16T04:32:09.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:09.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj268 td/osd-backfill-space/datafile 2024-09-16T04:32:10.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:10.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:10.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:10.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj269 td/osd-backfill-space/datafile 2024-09-16T04:32:10.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:10.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj269 td/osd-backfill-space/datafile 2024-09-16T04:32:10.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:10.263 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:10.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:10.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj270 td/osd-backfill-space/datafile 2024-09-16T04:32:10.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:10.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj270 td/osd-backfill-space/datafile 2024-09-16T04:32:10.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:10.430 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:10.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:10.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj271 td/osd-backfill-space/datafile 2024-09-16T04:32:10.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:10.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj271 td/osd-backfill-space/datafile 2024-09-16T04:32:10.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:10.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:10.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:10.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj272 td/osd-backfill-space/datafile 2024-09-16T04:32:10.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:10.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj272 td/osd-backfill-space/datafile 2024-09-16T04:32:10.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:10.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:10.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:10.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj273 td/osd-backfill-space/datafile 2024-09-16T04:32:10.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:10.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj273 td/osd-backfill-space/datafile 2024-09-16T04:32:10.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:10.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:10.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:10.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj274 td/osd-backfill-space/datafile 2024-09-16T04:32:11.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:11.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj274 td/osd-backfill-space/datafile 2024-09-16T04:32:11.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:11.150 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:11.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:11.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj275 td/osd-backfill-space/datafile 2024-09-16T04:32:11.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:11.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj275 td/osd-backfill-space/datafile 2024-09-16T04:32:11.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:11.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:11.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:11.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj276 td/osd-backfill-space/datafile 2024-09-16T04:32:11.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:11.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj276 td/osd-backfill-space/datafile 2024-09-16T04:32:11.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:11.484 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:11.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:11.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj277 td/osd-backfill-space/datafile 2024-09-16T04:32:11.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:11.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj277 td/osd-backfill-space/datafile 2024-09-16T04:32:11.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:11.685 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:11.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:11.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj278 td/osd-backfill-space/datafile 2024-09-16T04:32:11.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:11.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj278 td/osd-backfill-space/datafile 2024-09-16T04:32:11.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:11.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:11.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:11.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj279 td/osd-backfill-space/datafile 2024-09-16T04:32:11.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:11.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj279 td/osd-backfill-space/datafile 2024-09-16T04:32:12.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:12.019 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:12.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:12.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj280 td/osd-backfill-space/datafile 2024-09-16T04:32:12.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:12.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj280 td/osd-backfill-space/datafile 2024-09-16T04:32:12.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:12.229 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:12.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:12.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj281 td/osd-backfill-space/datafile 2024-09-16T04:32:12.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:12.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj281 td/osd-backfill-space/datafile 2024-09-16T04:32:12.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:12.421 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:12.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:12.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj282 td/osd-backfill-space/datafile 2024-09-16T04:32:12.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:12.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj282 td/osd-backfill-space/datafile 2024-09-16T04:32:12.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:12.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:12.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:12.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj283 td/osd-backfill-space/datafile 2024-09-16T04:32:12.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:12.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj283 td/osd-backfill-space/datafile 2024-09-16T04:32:12.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:12.772 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:12.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:12.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj284 td/osd-backfill-space/datafile 2024-09-16T04:32:12.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:12.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj284 td/osd-backfill-space/datafile 2024-09-16T04:32:12.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:12.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:12.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:12.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj285 td/osd-backfill-space/datafile 2024-09-16T04:32:13.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:13.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj285 td/osd-backfill-space/datafile 2024-09-16T04:32:13.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:13.149 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:13.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:13.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj286 td/osd-backfill-space/datafile 2024-09-16T04:32:13.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:13.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj286 td/osd-backfill-space/datafile 2024-09-16T04:32:13.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:13.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:13.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:13.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj287 td/osd-backfill-space/datafile 2024-09-16T04:32:13.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:13.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj287 td/osd-backfill-space/datafile 2024-09-16T04:32:13.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:13.484 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:13.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:13.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj288 td/osd-backfill-space/datafile 2024-09-16T04:32:13.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:13.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj288 td/osd-backfill-space/datafile 2024-09-16T04:32:13.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:13.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:13.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:13.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj289 td/osd-backfill-space/datafile 2024-09-16T04:32:13.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:13.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj289 td/osd-backfill-space/datafile 2024-09-16T04:32:13.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:13.818 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj290 td/osd-backfill-space/datafile 2024-09-16T04:32:13.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:13.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj290 td/osd-backfill-space/datafile 2024-09-16T04:32:13.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:13.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:13.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:13.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj291 td/osd-backfill-space/datafile 2024-09-16T04:32:14.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:14.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj291 td/osd-backfill-space/datafile 2024-09-16T04:32:14.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:14.170 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:14.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:14.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj292 td/osd-backfill-space/datafile 2024-09-16T04:32:14.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:14.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj292 td/osd-backfill-space/datafile 2024-09-16T04:32:14.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:14.337 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:14.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:14.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj293 td/osd-backfill-space/datafile 2024-09-16T04:32:14.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:14.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj293 td/osd-backfill-space/datafile 2024-09-16T04:32:14.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:14.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:14.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:14.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj294 td/osd-backfill-space/datafile 2024-09-16T04:32:14.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:14.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj294 td/osd-backfill-space/datafile 2024-09-16T04:32:14.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:14.705 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:14.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:14.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj295 td/osd-backfill-space/datafile 2024-09-16T04:32:14.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:14.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj295 td/osd-backfill-space/datafile 2024-09-16T04:32:14.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:14.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:14.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:14.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj296 td/osd-backfill-space/datafile 2024-09-16T04:32:14.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:14.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj296 td/osd-backfill-space/datafile 2024-09-16T04:32:15.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:15.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:15.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:15.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj297 td/osd-backfill-space/datafile 2024-09-16T04:32:15.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:15.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj297 td/osd-backfill-space/datafile 2024-09-16T04:32:15.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:15.299 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:15.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:15.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj298 td/osd-backfill-space/datafile 2024-09-16T04:32:15.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:15.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj298 td/osd-backfill-space/datafile 2024-09-16T04:32:15.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:15.466 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:15.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:15.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj299 td/osd-backfill-space/datafile 2024-09-16T04:32:15.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:15.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj299 td/osd-backfill-space/datafile 2024-09-16T04:32:15.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:15.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:15.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:15.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj300 td/osd-backfill-space/datafile 2024-09-16T04:32:15.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:15.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj300 td/osd-backfill-space/datafile 2024-09-16T04:32:15.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:15.809 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:15.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:15.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj301 td/osd-backfill-space/datafile 2024-09-16T04:32:15.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:15.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj301 td/osd-backfill-space/datafile 2024-09-16T04:32:15.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:15.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:15.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:15.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj302 td/osd-backfill-space/datafile 2024-09-16T04:32:16.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:16.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj302 td/osd-backfill-space/datafile 2024-09-16T04:32:16.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:16.169 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:16.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:16.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj303 td/osd-backfill-space/datafile 2024-09-16T04:32:16.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:16.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj303 td/osd-backfill-space/datafile 2024-09-16T04:32:16.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:16.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:16.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:16.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj304 td/osd-backfill-space/datafile 2024-09-16T04:32:16.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:16.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj304 td/osd-backfill-space/datafile 2024-09-16T04:32:16.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:16.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:16.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:16.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj305 td/osd-backfill-space/datafile 2024-09-16T04:32:16.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:16.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj305 td/osd-backfill-space/datafile 2024-09-16T04:32:16.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:16.671 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:16.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:16.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj306 td/osd-backfill-space/datafile 2024-09-16T04:32:16.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:16.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj306 td/osd-backfill-space/datafile 2024-09-16T04:32:16.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:16.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:16.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:16.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj307 td/osd-backfill-space/datafile 2024-09-16T04:32:16.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:16.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj307 td/osd-backfill-space/datafile 2024-09-16T04:32:17.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:17.114 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:17.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:17.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj308 td/osd-backfill-space/datafile 2024-09-16T04:32:17.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:17.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj308 td/osd-backfill-space/datafile 2024-09-16T04:32:17.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:17.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:17.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:17.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj309 td/osd-backfill-space/datafile 2024-09-16T04:32:17.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:17.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj309 td/osd-backfill-space/datafile 2024-09-16T04:32:17.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:17.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:17.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:17.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj310 td/osd-backfill-space/datafile 2024-09-16T04:32:17.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:17.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj310 td/osd-backfill-space/datafile 2024-09-16T04:32:17.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:17.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:17.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:17.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj311 td/osd-backfill-space/datafile 2024-09-16T04:32:17.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:17.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj311 td/osd-backfill-space/datafile 2024-09-16T04:32:17.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:17.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:17.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:17.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj312 td/osd-backfill-space/datafile 2024-09-16T04:32:17.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:17.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj312 td/osd-backfill-space/datafile 2024-09-16T04:32:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:17.968 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:17.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:17.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj313 td/osd-backfill-space/datafile 2024-09-16T04:32:18.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:18.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj313 td/osd-backfill-space/datafile 2024-09-16T04:32:18.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:18.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:18.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:18.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj314 td/osd-backfill-space/datafile 2024-09-16T04:32:18.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:18.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj314 td/osd-backfill-space/datafile 2024-09-16T04:32:18.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:18.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:18.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:18.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj315 td/osd-backfill-space/datafile 2024-09-16T04:32:18.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:18.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj315 td/osd-backfill-space/datafile 2024-09-16T04:32:18.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:18.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:18.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:18.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj316 td/osd-backfill-space/datafile 2024-09-16T04:32:18.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:18.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj316 td/osd-backfill-space/datafile 2024-09-16T04:32:18.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:18.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:18.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:18.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj317 td/osd-backfill-space/datafile 2024-09-16T04:32:18.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:18.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj317 td/osd-backfill-space/datafile 2024-09-16T04:32:18.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:18.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:18.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:18.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj318 td/osd-backfill-space/datafile 2024-09-16T04:32:18.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:18.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj318 td/osd-backfill-space/datafile 2024-09-16T04:32:19.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:19.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:19.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:19.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj319 td/osd-backfill-space/datafile 2024-09-16T04:32:19.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:19.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj319 td/osd-backfill-space/datafile 2024-09-16T04:32:19.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:19.240 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:19.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:19.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj320 td/osd-backfill-space/datafile 2024-09-16T04:32:19.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:19.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj320 td/osd-backfill-space/datafile 2024-09-16T04:32:19.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:19.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:19.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:19.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj321 td/osd-backfill-space/datafile 2024-09-16T04:32:19.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:19.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj321 td/osd-backfill-space/datafile 2024-09-16T04:32:19.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:19.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:19.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:19.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj322 td/osd-backfill-space/datafile 2024-09-16T04:32:19.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:19.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj322 td/osd-backfill-space/datafile 2024-09-16T04:32:19.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:19.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:19.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:19.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj323 td/osd-backfill-space/datafile 2024-09-16T04:32:19.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:19.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj323 td/osd-backfill-space/datafile 2024-09-16T04:32:19.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:19.942 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:19.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:19.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj324 td/osd-backfill-space/datafile 2024-09-16T04:32:20.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:20.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj324 td/osd-backfill-space/datafile 2024-09-16T04:32:20.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:20.168 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:20.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:20.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj325 td/osd-backfill-space/datafile 2024-09-16T04:32:20.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:20.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj325 td/osd-backfill-space/datafile 2024-09-16T04:32:20.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:20.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:20.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:20.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj326 td/osd-backfill-space/datafile 2024-09-16T04:32:20.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:20.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj326 td/osd-backfill-space/datafile 2024-09-16T04:32:20.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:20.511 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:20.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:20.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj327 td/osd-backfill-space/datafile 2024-09-16T04:32:20.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:20.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj327 td/osd-backfill-space/datafile 2024-09-16T04:32:20.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:20.686 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:20.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:20.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj328 td/osd-backfill-space/datafile 2024-09-16T04:32:20.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:20.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj328 td/osd-backfill-space/datafile 2024-09-16T04:32:20.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:20.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:20.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:20.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj329 td/osd-backfill-space/datafile 2024-09-16T04:32:20.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:20.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj329 td/osd-backfill-space/datafile 2024-09-16T04:32:21.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:21.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:21.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:21.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj330 td/osd-backfill-space/datafile 2024-09-16T04:32:21.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:21.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj330 td/osd-backfill-space/datafile 2024-09-16T04:32:21.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:21.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:21.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:21.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj331 td/osd-backfill-space/datafile 2024-09-16T04:32:21.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:21.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj331 td/osd-backfill-space/datafile 2024-09-16T04:32:21.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:21.400 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:21.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:21.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj332 td/osd-backfill-space/datafile 2024-09-16T04:32:21.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:21.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj332 td/osd-backfill-space/datafile 2024-09-16T04:32:21.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:21.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:21.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:21.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj333 td/osd-backfill-space/datafile 2024-09-16T04:32:21.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:21.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj333 td/osd-backfill-space/datafile 2024-09-16T04:32:21.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:21.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:21.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:21.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj334 td/osd-backfill-space/datafile 2024-09-16T04:32:21.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:21.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj334 td/osd-backfill-space/datafile 2024-09-16T04:32:21.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:21.901 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:21.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:21.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj335 td/osd-backfill-space/datafile 2024-09-16T04:32:21.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:21.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj335 td/osd-backfill-space/datafile 2024-09-16T04:32:22.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:22.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:22.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:22.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj336 td/osd-backfill-space/datafile 2024-09-16T04:32:22.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:22.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj336 td/osd-backfill-space/datafile 2024-09-16T04:32:22.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:22.253 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:22.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:22.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj337 td/osd-backfill-space/datafile 2024-09-16T04:32:22.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:22.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj337 td/osd-backfill-space/datafile 2024-09-16T04:32:22.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:22.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:22.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:22.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj338 td/osd-backfill-space/datafile 2024-09-16T04:32:22.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:22.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj338 td/osd-backfill-space/datafile 2024-09-16T04:32:22.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:22.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:22.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:22.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj339 td/osd-backfill-space/datafile 2024-09-16T04:32:22.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:22.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj339 td/osd-backfill-space/datafile 2024-09-16T04:32:22.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:22.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:22.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:22.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj340 td/osd-backfill-space/datafile 2024-09-16T04:32:22.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:22.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj340 td/osd-backfill-space/datafile 2024-09-16T04:32:22.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:22.922 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:22.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:22.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj341 td/osd-backfill-space/datafile 2024-09-16T04:32:23.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:23.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj341 td/osd-backfill-space/datafile 2024-09-16T04:32:23.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:23.140 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:23.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:23.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj342 td/osd-backfill-space/datafile 2024-09-16T04:32:23.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:23.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj342 td/osd-backfill-space/datafile 2024-09-16T04:32:23.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:23.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:23.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:23.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj343 td/osd-backfill-space/datafile 2024-09-16T04:32:23.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:23.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj343 td/osd-backfill-space/datafile 2024-09-16T04:32:23.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:23.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:23.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:23.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj344 td/osd-backfill-space/datafile 2024-09-16T04:32:23.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:23.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj344 td/osd-backfill-space/datafile 2024-09-16T04:32:23.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:23.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:23.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:23.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj345 td/osd-backfill-space/datafile 2024-09-16T04:32:23.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:23.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj345 td/osd-backfill-space/datafile 2024-09-16T04:32:23.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:23.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:23.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:23.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj346 td/osd-backfill-space/datafile 2024-09-16T04:32:23.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:23.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj346 td/osd-backfill-space/datafile 2024-09-16T04:32:24.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:24.027 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:24.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:24.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj347 td/osd-backfill-space/datafile 2024-09-16T04:32:24.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:24.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj347 td/osd-backfill-space/datafile 2024-09-16T04:32:24.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:24.219 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:24.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:24.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj348 td/osd-backfill-space/datafile 2024-09-16T04:32:24.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:24.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj348 td/osd-backfill-space/datafile 2024-09-16T04:32:24.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:24.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:24.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:24.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj349 td/osd-backfill-space/datafile 2024-09-16T04:32:24.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:24.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj349 td/osd-backfill-space/datafile 2024-09-16T04:32:24.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:24.578 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:24.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:24.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj350 td/osd-backfill-space/datafile 2024-09-16T04:32:24.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:24.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj350 td/osd-backfill-space/datafile 2024-09-16T04:32:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:24.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:24.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:24.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj351 td/osd-backfill-space/datafile 2024-09-16T04:32:24.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:24.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj351 td/osd-backfill-space/datafile 2024-09-16T04:32:24.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:24.921 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:24.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:24.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj352 td/osd-backfill-space/datafile 2024-09-16T04:32:25.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:25.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj352 td/osd-backfill-space/datafile 2024-09-16T04:32:25.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:25.148 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:25.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:25.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj353 td/osd-backfill-space/datafile 2024-09-16T04:32:25.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:25.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj353 td/osd-backfill-space/datafile 2024-09-16T04:32:25.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:25.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:25.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:25.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj354 td/osd-backfill-space/datafile 2024-09-16T04:32:25.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:25.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj354 td/osd-backfill-space/datafile 2024-09-16T04:32:25.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:25.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:25.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:25.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj355 td/osd-backfill-space/datafile 2024-09-16T04:32:25.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:25.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj355 td/osd-backfill-space/datafile 2024-09-16T04:32:25.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:25.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:25.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:25.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj356 td/osd-backfill-space/datafile 2024-09-16T04:32:25.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:25.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj356 td/osd-backfill-space/datafile 2024-09-16T04:32:25.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:25.817 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:25.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:25.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj357 td/osd-backfill-space/datafile 2024-09-16T04:32:25.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:25.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj357 td/osd-backfill-space/datafile 2024-09-16T04:32:25.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:25.992 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:25.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:25.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj358 td/osd-backfill-space/datafile 2024-09-16T04:32:26.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:26.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj358 td/osd-backfill-space/datafile 2024-09-16T04:32:26.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:26.176 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:26.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:26.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj359 td/osd-backfill-space/datafile 2024-09-16T04:32:26.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:26.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj359 td/osd-backfill-space/datafile 2024-09-16T04:32:26.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:26.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:26.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:26.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj360 td/osd-backfill-space/datafile 2024-09-16T04:32:26.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:26.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj360 td/osd-backfill-space/datafile 2024-09-16T04:32:26.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:26.511 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:26.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:26.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj361 td/osd-backfill-space/datafile 2024-09-16T04:32:26.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:26.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj361 td/osd-backfill-space/datafile 2024-09-16T04:32:26.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:26.686 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:26.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:26.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj362 td/osd-backfill-space/datafile 2024-09-16T04:32:26.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:26.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj362 td/osd-backfill-space/datafile 2024-09-16T04:32:26.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:26.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:26.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:26.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj363 td/osd-backfill-space/datafile 2024-09-16T04:32:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj363 td/osd-backfill-space/datafile 2024-09-16T04:32:27.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:27.397 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:27.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:27.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj364 td/osd-backfill-space/datafile 2024-09-16T04:32:27.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:27.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj364 td/osd-backfill-space/datafile 2024-09-16T04:32:27.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:27.581 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:27.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:27.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj365 td/osd-backfill-space/datafile 2024-09-16T04:32:27.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:27.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj365 td/osd-backfill-space/datafile 2024-09-16T04:32:27.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:27.765 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:27.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:27.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj366 td/osd-backfill-space/datafile 2024-09-16T04:32:27.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:27.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj366 td/osd-backfill-space/datafile 2024-09-16T04:32:27.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:27.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:27.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:27.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj367 td/osd-backfill-space/datafile 2024-09-16T04:32:28.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:28.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj367 td/osd-backfill-space/datafile 2024-09-16T04:32:28.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:28.150 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:28.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:28.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj368 td/osd-backfill-space/datafile 2024-09-16T04:32:28.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:28.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj368 td/osd-backfill-space/datafile 2024-09-16T04:32:28.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:28.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:28.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:28.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj369 td/osd-backfill-space/datafile 2024-09-16T04:32:28.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:28.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj369 td/osd-backfill-space/datafile 2024-09-16T04:32:28.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:28.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:28.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:28.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj370 td/osd-backfill-space/datafile 2024-09-16T04:32:28.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:28.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj370 td/osd-backfill-space/datafile 2024-09-16T04:32:28.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:28.702 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:28.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:28.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj371 td/osd-backfill-space/datafile 2024-09-16T04:32:28.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:28.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj371 td/osd-backfill-space/datafile 2024-09-16T04:32:28.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:28.869 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:28.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:28.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj372 td/osd-backfill-space/datafile 2024-09-16T04:32:28.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:28.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj372 td/osd-backfill-space/datafile 2024-09-16T04:32:29.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:29.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:29.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:29.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj373 td/osd-backfill-space/datafile 2024-09-16T04:32:29.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:29.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj373 td/osd-backfill-space/datafile 2024-09-16T04:32:29.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:29.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:29.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:29.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj374 td/osd-backfill-space/datafile 2024-09-16T04:32:29.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:29.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj374 td/osd-backfill-space/datafile 2024-09-16T04:32:29.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:29.404 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:29.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:29.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj375 td/osd-backfill-space/datafile 2024-09-16T04:32:29.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:29.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj375 td/osd-backfill-space/datafile 2024-09-16T04:32:29.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:29.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:29.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:29.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj376 td/osd-backfill-space/datafile 2024-09-16T04:32:29.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:29.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj376 td/osd-backfill-space/datafile 2024-09-16T04:32:29.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:29.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:29.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj377 td/osd-backfill-space/datafile 2024-09-16T04:32:29.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:29.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj377 td/osd-backfill-space/datafile 2024-09-16T04:32:29.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:29.923 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:29.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:29.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj378 td/osd-backfill-space/datafile 2024-09-16T04:32:30.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:30.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj378 td/osd-backfill-space/datafile 2024-09-16T04:32:30.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:30.149 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:30.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:30.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj379 td/osd-backfill-space/datafile 2024-09-16T04:32:30.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:30.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj379 td/osd-backfill-space/datafile 2024-09-16T04:32:30.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:30.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:30.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:30.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj380 td/osd-backfill-space/datafile 2024-09-16T04:32:30.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:30.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj380 td/osd-backfill-space/datafile 2024-09-16T04:32:30.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:30.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:30.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:30.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj381 td/osd-backfill-space/datafile 2024-09-16T04:32:30.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:30.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj381 td/osd-backfill-space/datafile 2024-09-16T04:32:30.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:30.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:30.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:30.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj382 td/osd-backfill-space/datafile 2024-09-16T04:32:30.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:30.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj382 td/osd-backfill-space/datafile 2024-09-16T04:32:30.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:30.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:30.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:30.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj383 td/osd-backfill-space/datafile 2024-09-16T04:32:30.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:30.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj383 td/osd-backfill-space/datafile 2024-09-16T04:32:31.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:31.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:31.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:31.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj384 td/osd-backfill-space/datafile 2024-09-16T04:32:31.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:31.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj384 td/osd-backfill-space/datafile 2024-09-16T04:32:31.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:31.245 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:31.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:31.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj385 td/osd-backfill-space/datafile 2024-09-16T04:32:31.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:31.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj385 td/osd-backfill-space/datafile 2024-09-16T04:32:31.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:31.412 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:31.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:31.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj386 td/osd-backfill-space/datafile 2024-09-16T04:32:31.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:31.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj386 td/osd-backfill-space/datafile 2024-09-16T04:32:31.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:31.579 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:31.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:31.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj387 td/osd-backfill-space/datafile 2024-09-16T04:32:31.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:31.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj387 td/osd-backfill-space/datafile 2024-09-16T04:32:31.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:31.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:31.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:31.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj388 td/osd-backfill-space/datafile 2024-09-16T04:32:31.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:31.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj388 td/osd-backfill-space/datafile 2024-09-16T04:32:31.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:31.925 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:31.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:31.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj389 td/osd-backfill-space/datafile 2024-09-16T04:32:32.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:32.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj389 td/osd-backfill-space/datafile 2024-09-16T04:32:32.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:32.098 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:32.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:32.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj390 td/osd-backfill-space/datafile 2024-09-16T04:32:32.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:32.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj390 td/osd-backfill-space/datafile 2024-09-16T04:32:32.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:32.274 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:32.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:32.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj391 td/osd-backfill-space/datafile 2024-09-16T04:32:32.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:32.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj391 td/osd-backfill-space/datafile 2024-09-16T04:32:32.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:32.441 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:32.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:32.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj392 td/osd-backfill-space/datafile 2024-09-16T04:32:32.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:32.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj392 td/osd-backfill-space/datafile 2024-09-16T04:32:32.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:32.700 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:32.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:32.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj393 td/osd-backfill-space/datafile 2024-09-16T04:32:32.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:32.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj393 td/osd-backfill-space/datafile 2024-09-16T04:32:32.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:32.868 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:32.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:32.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj394 td/osd-backfill-space/datafile 2024-09-16T04:32:32.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:32.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj394 td/osd-backfill-space/datafile 2024-09-16T04:32:33.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:33.085 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:33.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:33.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj395 td/osd-backfill-space/datafile 2024-09-16T04:32:33.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:33.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj395 td/osd-backfill-space/datafile 2024-09-16T04:32:33.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:33.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:33.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:33.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj396 td/osd-backfill-space/datafile 2024-09-16T04:32:33.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:33.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj396 td/osd-backfill-space/datafile 2024-09-16T04:32:33.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:33.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:33.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:33.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj397 td/osd-backfill-space/datafile 2024-09-16T04:32:33.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:33.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj397 td/osd-backfill-space/datafile 2024-09-16T04:32:33.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:33.612 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:33.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:33.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj398 td/osd-backfill-space/datafile 2024-09-16T04:32:33.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:33.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj398 td/osd-backfill-space/datafile 2024-09-16T04:32:33.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:33.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:33.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:33.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj399 td/osd-backfill-space/datafile 2024-09-16T04:32:33.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:33.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj399 td/osd-backfill-space/datafile 2024-09-16T04:32:33.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:33.947 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:33.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:33.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj400 td/osd-backfill-space/datafile 2024-09-16T04:32:34.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:34.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj400 td/osd-backfill-space/datafile 2024-09-16T04:32:34.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:34.147 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:34.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:34.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj401 td/osd-backfill-space/datafile 2024-09-16T04:32:34.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:34.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj401 td/osd-backfill-space/datafile 2024-09-16T04:32:34.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:34.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:34.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:34.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj402 td/osd-backfill-space/datafile 2024-09-16T04:32:34.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:34.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj402 td/osd-backfill-space/datafile 2024-09-16T04:32:34.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:34.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:34.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:34.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj403 td/osd-backfill-space/datafile 2024-09-16T04:32:34.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:34.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj403 td/osd-backfill-space/datafile 2024-09-16T04:32:34.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:34.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:34.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:34.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj404 td/osd-backfill-space/datafile 2024-09-16T04:32:34.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:34.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj404 td/osd-backfill-space/datafile 2024-09-16T04:32:34.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:34.817 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:34.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:34.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj405 td/osd-backfill-space/datafile 2024-09-16T04:32:34.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:34.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj405 td/osd-backfill-space/datafile 2024-09-16T04:32:35.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:35.051 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:35.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:35.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj406 td/osd-backfill-space/datafile 2024-09-16T04:32:35.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:35.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj406 td/osd-backfill-space/datafile 2024-09-16T04:32:35.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:35.218 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:35.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:35.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj407 td/osd-backfill-space/datafile 2024-09-16T04:32:35.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:35.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj407 td/osd-backfill-space/datafile 2024-09-16T04:32:35.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:35.386 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:35.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:35.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj408 td/osd-backfill-space/datafile 2024-09-16T04:32:35.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:35.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj408 td/osd-backfill-space/datafile 2024-09-16T04:32:35.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:35.553 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:35.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:35.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj409 td/osd-backfill-space/datafile 2024-09-16T04:32:35.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:35.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj409 td/osd-backfill-space/datafile 2024-09-16T04:32:35.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:35.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:35.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:35.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj410 td/osd-backfill-space/datafile 2024-09-16T04:32:35.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:35.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj410 td/osd-backfill-space/datafile 2024-09-16T04:32:35.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:35.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:35.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:35.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj411 td/osd-backfill-space/datafile 2024-09-16T04:32:35.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:35.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj411 td/osd-backfill-space/datafile 2024-09-16T04:32:36.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:36.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:36.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:36.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj412 td/osd-backfill-space/datafile 2024-09-16T04:32:36.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:36.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj412 td/osd-backfill-space/datafile 2024-09-16T04:32:36.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:36.264 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:36.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:36.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj413 td/osd-backfill-space/datafile 2024-09-16T04:32:36.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:36.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj413 td/osd-backfill-space/datafile 2024-09-16T04:32:36.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:36.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:36.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:36.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj414 td/osd-backfill-space/datafile 2024-09-16T04:32:36.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:36.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj414 td/osd-backfill-space/datafile 2024-09-16T04:32:36.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:36.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:36.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:36.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj415 td/osd-backfill-space/datafile 2024-09-16T04:32:36.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:36.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj415 td/osd-backfill-space/datafile 2024-09-16T04:32:36.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:36.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:36.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:36.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj416 td/osd-backfill-space/datafile 2024-09-16T04:32:36.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:36.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj416 td/osd-backfill-space/datafile 2024-09-16T04:32:36.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:36.942 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:36.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:36.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj417 td/osd-backfill-space/datafile 2024-09-16T04:32:37.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:37.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj417 td/osd-backfill-space/datafile 2024-09-16T04:32:37.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:37.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:37.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:37.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj418 td/osd-backfill-space/datafile 2024-09-16T04:32:37.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:37.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj418 td/osd-backfill-space/datafile 2024-09-16T04:32:37.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:37.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:37.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:37.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj419 td/osd-backfill-space/datafile 2024-09-16T04:32:37.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:37.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj419 td/osd-backfill-space/datafile 2024-09-16T04:32:37.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:37.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:37.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:37.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj420 td/osd-backfill-space/datafile 2024-09-16T04:32:37.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:37.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj420 td/osd-backfill-space/datafile 2024-09-16T04:32:37.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:37.644 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:37.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:37.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj421 td/osd-backfill-space/datafile 2024-09-16T04:32:37.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:37.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj421 td/osd-backfill-space/datafile 2024-09-16T04:32:37.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:37.887 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:37.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:37.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj422 td/osd-backfill-space/datafile 2024-09-16T04:32:37.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:37.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj422 td/osd-backfill-space/datafile 2024-09-16T04:32:38.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:38.054 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:38.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:38.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj423 td/osd-backfill-space/datafile 2024-09-16T04:32:38.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:38.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj423 td/osd-backfill-space/datafile 2024-09-16T04:32:38.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:38.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:38.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:38.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj424 td/osd-backfill-space/datafile 2024-09-16T04:32:38.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:38.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj424 td/osd-backfill-space/datafile 2024-09-16T04:32:38.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:38.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:38.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:38.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj425 td/osd-backfill-space/datafile 2024-09-16T04:32:38.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:38.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj425 td/osd-backfill-space/datafile 2024-09-16T04:32:38.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:38.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:38.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:38.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj426 td/osd-backfill-space/datafile 2024-09-16T04:32:38.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:38.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj426 td/osd-backfill-space/datafile 2024-09-16T04:32:38.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:38.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:38.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:38.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj427 td/osd-backfill-space/datafile 2024-09-16T04:32:38.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:38.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj427 td/osd-backfill-space/datafile 2024-09-16T04:32:38.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:38.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:38.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:38.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj428 td/osd-backfill-space/datafile 2024-09-16T04:32:39.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:39.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj428 td/osd-backfill-space/datafile 2024-09-16T04:32:39.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:39.142 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:39.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:39.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj429 td/osd-backfill-space/datafile 2024-09-16T04:32:39.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:39.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj429 td/osd-backfill-space/datafile 2024-09-16T04:32:39.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:39.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:39.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:39.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj430 td/osd-backfill-space/datafile 2024-09-16T04:32:39.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:39.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj430 td/osd-backfill-space/datafile 2024-09-16T04:32:39.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:39.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:39.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:39.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj431 td/osd-backfill-space/datafile 2024-09-16T04:32:39.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:39.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj431 td/osd-backfill-space/datafile 2024-09-16T04:32:39.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:39.810 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:39.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:39.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj432 td/osd-backfill-space/datafile 2024-09-16T04:32:39.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:39.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj432 td/osd-backfill-space/datafile 2024-09-16T04:32:39.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:39.820 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:39.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:39.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj433 td/osd-backfill-space/datafile 2024-09-16T04:32:39.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:39.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj433 td/osd-backfill-space/datafile 2024-09-16T04:32:39.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:39.987 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:39.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:39.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj434 td/osd-backfill-space/datafile 2024-09-16T04:32:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:40.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj434 td/osd-backfill-space/datafile 2024-09-16T04:32:40.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:40.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:40.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:40.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj435 td/osd-backfill-space/datafile 2024-09-16T04:32:40.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:40.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj435 td/osd-backfill-space/datafile 2024-09-16T04:32:40.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:40.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:40.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:40.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj436 td/osd-backfill-space/datafile 2024-09-16T04:32:40.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:40.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj436 td/osd-backfill-space/datafile 2024-09-16T04:32:40.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:40.531 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:40.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:40.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj437 td/osd-backfill-space/datafile 2024-09-16T04:32:40.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:40.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj437 td/osd-backfill-space/datafile 2024-09-16T04:32:40.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:40.698 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:40.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:40.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj438 td/osd-backfill-space/datafile 2024-09-16T04:32:40.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:40.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj438 td/osd-backfill-space/datafile 2024-09-16T04:32:40.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:40.874 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:40.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:40.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj439 td/osd-backfill-space/datafile 2024-09-16T04:32:40.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:40.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj439 td/osd-backfill-space/datafile 2024-09-16T04:32:41.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:41.108 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:41.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:41.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj440 td/osd-backfill-space/datafile 2024-09-16T04:32:41.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:41.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj440 td/osd-backfill-space/datafile 2024-09-16T04:32:41.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:41.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:41.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:41.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj441 td/osd-backfill-space/datafile 2024-09-16T04:32:41.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:41.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj441 td/osd-backfill-space/datafile 2024-09-16T04:32:41.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:41.443 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:41.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:41.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj442 td/osd-backfill-space/datafile 2024-09-16T04:32:41.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:41.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj442 td/osd-backfill-space/datafile 2024-09-16T04:32:41.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:41.619 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:41.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:41.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj443 td/osd-backfill-space/datafile 2024-09-16T04:32:41.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:41.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj443 td/osd-backfill-space/datafile 2024-09-16T04:32:41.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:41.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:41.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:41.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj444 td/osd-backfill-space/datafile 2024-09-16T04:32:41.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:41.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj444 td/osd-backfill-space/datafile 2024-09-16T04:32:41.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:41.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:41.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:41.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj445 td/osd-backfill-space/datafile 2024-09-16T04:32:42.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:42.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj445 td/osd-backfill-space/datafile 2024-09-16T04:32:42.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:42.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:42.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:42.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj446 td/osd-backfill-space/datafile 2024-09-16T04:32:42.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:42.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj446 td/osd-backfill-space/datafile 2024-09-16T04:32:42.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:42.380 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:42.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:42.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj447 td/osd-backfill-space/datafile 2024-09-16T04:32:42.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:42.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj447 td/osd-backfill-space/datafile 2024-09-16T04:32:42.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:42.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:42.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:42.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj448 td/osd-backfill-space/datafile 2024-09-16T04:32:42.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:42.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj448 td/osd-backfill-space/datafile 2024-09-16T04:32:42.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:42.731 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:42.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:42.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj449 td/osd-backfill-space/datafile 2024-09-16T04:32:42.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:42.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj449 td/osd-backfill-space/datafile 2024-09-16T04:32:42.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:42.907 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:42.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:42.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj450 td/osd-backfill-space/datafile 2024-09-16T04:32:43.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:43.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj450 td/osd-backfill-space/datafile 2024-09-16T04:32:43.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:43.125 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:43.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:43.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj451 td/osd-backfill-space/datafile 2024-09-16T04:32:43.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:43.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj451 td/osd-backfill-space/datafile 2024-09-16T04:32:43.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:43.300 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:43.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:43.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj452 td/osd-backfill-space/datafile 2024-09-16T04:32:43.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:43.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj452 td/osd-backfill-space/datafile 2024-09-16T04:32:43.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:43.467 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:43.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:43.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj453 td/osd-backfill-space/datafile 2024-09-16T04:32:43.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:43.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj453 td/osd-backfill-space/datafile 2024-09-16T04:32:43.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:43.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:43.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:43.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj454 td/osd-backfill-space/datafile 2024-09-16T04:32:43.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:43.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj454 td/osd-backfill-space/datafile 2024-09-16T04:32:43.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:43.802 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:43.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:43.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj455 td/osd-backfill-space/datafile 2024-09-16T04:32:43.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:43.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj455 td/osd-backfill-space/datafile 2024-09-16T04:32:43.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:43.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:43.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:43.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj456 td/osd-backfill-space/datafile 2024-09-16T04:32:44.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:44.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj456 td/osd-backfill-space/datafile 2024-09-16T04:32:44.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:44.170 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:44.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:44.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj457 td/osd-backfill-space/datafile 2024-09-16T04:32:44.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:44.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj457 td/osd-backfill-space/datafile 2024-09-16T04:32:44.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:44.337 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:44.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:44.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj458 td/osd-backfill-space/datafile 2024-09-16T04:32:44.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:44.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj458 td/osd-backfill-space/datafile 2024-09-16T04:32:44.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:44.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:44.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:44.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj459 td/osd-backfill-space/datafile 2024-09-16T04:32:44.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:44.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj459 td/osd-backfill-space/datafile 2024-09-16T04:32:44.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:44.697 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:44.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:44.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj460 td/osd-backfill-space/datafile 2024-09-16T04:32:44.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:44.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj460 td/osd-backfill-space/datafile 2024-09-16T04:32:44.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:44.864 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:44.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:44.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj461 td/osd-backfill-space/datafile 2024-09-16T04:32:44.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:44.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj461 td/osd-backfill-space/datafile 2024-09-16T04:32:45.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:45.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:45.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:45.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj462 td/osd-backfill-space/datafile 2024-09-16T04:32:45.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:45.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj462 td/osd-backfill-space/datafile 2024-09-16T04:32:45.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:45.258 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:45.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:45.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj463 td/osd-backfill-space/datafile 2024-09-16T04:32:45.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:45.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj463 td/osd-backfill-space/datafile 2024-09-16T04:32:45.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:45.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:45.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:45.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj464 td/osd-backfill-space/datafile 2024-09-16T04:32:45.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:45.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj464 td/osd-backfill-space/datafile 2024-09-16T04:32:45.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:45.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:45.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:45.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj465 td/osd-backfill-space/datafile 2024-09-16T04:32:45.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:45.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj465 td/osd-backfill-space/datafile 2024-09-16T04:32:45.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:45.785 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:45.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:45.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj466 td/osd-backfill-space/datafile 2024-09-16T04:32:45.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:45.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj466 td/osd-backfill-space/datafile 2024-09-16T04:32:45.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:45.952 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:45.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:45.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj467 td/osd-backfill-space/datafile 2024-09-16T04:32:46.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:46.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj467 td/osd-backfill-space/datafile 2024-09-16T04:32:46.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:46.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:46.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:46.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj468 td/osd-backfill-space/datafile 2024-09-16T04:32:46.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:46.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj468 td/osd-backfill-space/datafile 2024-09-16T04:32:46.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:46.320 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:46.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:46.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj469 td/osd-backfill-space/datafile 2024-09-16T04:32:46.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:46.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj469 td/osd-backfill-space/datafile 2024-09-16T04:32:46.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:46.487 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:46.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:46.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj470 td/osd-backfill-space/datafile 2024-09-16T04:32:46.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:46.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj470 td/osd-backfill-space/datafile 2024-09-16T04:32:46.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:46.655 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:46.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:46.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj471 td/osd-backfill-space/datafile 2024-09-16T04:32:46.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:46.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj471 td/osd-backfill-space/datafile 2024-09-16T04:32:46.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:46.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:46.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:46.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj472 td/osd-backfill-space/datafile 2024-09-16T04:32:46.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:46.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj472 td/osd-backfill-space/datafile 2024-09-16T04:32:47.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:47.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:47.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:47.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj473 td/osd-backfill-space/datafile 2024-09-16T04:32:47.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:47.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj473 td/osd-backfill-space/datafile 2024-09-16T04:32:47.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:47.224 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:47.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:47.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj474 td/osd-backfill-space/datafile 2024-09-16T04:32:47.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:47.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj474 td/osd-backfill-space/datafile 2024-09-16T04:32:47.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:47.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:47.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:47.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj475 td/osd-backfill-space/datafile 2024-09-16T04:32:47.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:47.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj475 td/osd-backfill-space/datafile 2024-09-16T04:32:47.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:47.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:47.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:47.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj476 td/osd-backfill-space/datafile 2024-09-16T04:32:47.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:47.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj476 td/osd-backfill-space/datafile 2024-09-16T04:32:47.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:47.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:47.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:47.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj477 td/osd-backfill-space/datafile 2024-09-16T04:32:47.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:47.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj477 td/osd-backfill-space/datafile 2024-09-16T04:32:47.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:47.927 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:47.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:47.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj478 td/osd-backfill-space/datafile 2024-09-16T04:32:48.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:48.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj478 td/osd-backfill-space/datafile 2024-09-16T04:32:48.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:48.186 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:48.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:48.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj479 td/osd-backfill-space/datafile 2024-09-16T04:32:48.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:48.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj479 td/osd-backfill-space/datafile 2024-09-16T04:32:48.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:48.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:48.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:48.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj480 td/osd-backfill-space/datafile 2024-09-16T04:32:48.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:48.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj480 td/osd-backfill-space/datafile 2024-09-16T04:32:48.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:48.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:48.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:48.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj481 td/osd-backfill-space/datafile 2024-09-16T04:32:48.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:48.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj481 td/osd-backfill-space/datafile 2024-09-16T04:32:48.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:48.712 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:48.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:48.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj482 td/osd-backfill-space/datafile 2024-09-16T04:32:48.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:48.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj482 td/osd-backfill-space/datafile 2024-09-16T04:32:48.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:48.888 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:48.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:48.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj483 td/osd-backfill-space/datafile 2024-09-16T04:32:49.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:49.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj483 td/osd-backfill-space/datafile 2024-09-16T04:32:49.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:49.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:49.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:49.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj484 td/osd-backfill-space/datafile 2024-09-16T04:32:49.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:49.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj484 td/osd-backfill-space/datafile 2024-09-16T04:32:49.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:49.298 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:49.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:49.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj485 td/osd-backfill-space/datafile 2024-09-16T04:32:49.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:49.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj485 td/osd-backfill-space/datafile 2024-09-16T04:32:49.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:49.465 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:49.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:49.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj486 td/osd-backfill-space/datafile 2024-09-16T04:32:49.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:49.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj486 td/osd-backfill-space/datafile 2024-09-16T04:32:49.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:49.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:49.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:49.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj487 td/osd-backfill-space/datafile 2024-09-16T04:32:49.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:49.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj487 td/osd-backfill-space/datafile 2024-09-16T04:32:49.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:49.800 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:49.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:49.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj488 td/osd-backfill-space/datafile 2024-09-16T04:32:49.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:49.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj488 td/osd-backfill-space/datafile 2024-09-16T04:32:49.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:49.967 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:49.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:49.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj489 td/osd-backfill-space/datafile 2024-09-16T04:32:50.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:50.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj489 td/osd-backfill-space/datafile 2024-09-16T04:32:50.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:50.176 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:50.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:50.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj490 td/osd-backfill-space/datafile 2024-09-16T04:32:50.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:50.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj490 td/osd-backfill-space/datafile 2024-09-16T04:32:50.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:50.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:50.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:50.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj491 td/osd-backfill-space/datafile 2024-09-16T04:32:50.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:50.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj491 td/osd-backfill-space/datafile 2024-09-16T04:32:50.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:50.511 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:50.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:50.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj492 td/osd-backfill-space/datafile 2024-09-16T04:32:50.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:50.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj492 td/osd-backfill-space/datafile 2024-09-16T04:32:50.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:50.686 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:50.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:50.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj493 td/osd-backfill-space/datafile 2024-09-16T04:32:50.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:50.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj493 td/osd-backfill-space/datafile 2024-09-16T04:32:50.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:50.862 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:50.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:50.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj494 td/osd-backfill-space/datafile 2024-09-16T04:32:50.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:50.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj494 td/osd-backfill-space/datafile 2024-09-16T04:32:51.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:51.088 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:51.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:51.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj495 td/osd-backfill-space/datafile 2024-09-16T04:32:51.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:51.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj495 td/osd-backfill-space/datafile 2024-09-16T04:32:51.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:51.256 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:51.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:51.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj496 td/osd-backfill-space/datafile 2024-09-16T04:32:51.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:51.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj496 td/osd-backfill-space/datafile 2024-09-16T04:32:51.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:51.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:51.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:51.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj497 td/osd-backfill-space/datafile 2024-09-16T04:32:51.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:51.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj497 td/osd-backfill-space/datafile 2024-09-16T04:32:51.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:51.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:51.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:51.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj498 td/osd-backfill-space/datafile 2024-09-16T04:32:51.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:51.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj498 td/osd-backfill-space/datafile 2024-09-16T04:32:51.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:51.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:51.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:51.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj499 td/osd-backfill-space/datafile 2024-09-16T04:32:51.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:51.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj499 td/osd-backfill-space/datafile 2024-09-16T04:32:51.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:51.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:51.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:51.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj500 td/osd-backfill-space/datafile 2024-09-16T04:32:52.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:52.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj500 td/osd-backfill-space/datafile 2024-09-16T04:32:52.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:52.159 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:52.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:52.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj501 td/osd-backfill-space/datafile 2024-09-16T04:32:52.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:52.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj501 td/osd-backfill-space/datafile 2024-09-16T04:32:52.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:52.326 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:52.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:52.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj502 td/osd-backfill-space/datafile 2024-09-16T04:32:52.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:52.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj502 td/osd-backfill-space/datafile 2024-09-16T04:32:52.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:52.494 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:52.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:52.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj503 td/osd-backfill-space/datafile 2024-09-16T04:32:52.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:52.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj503 td/osd-backfill-space/datafile 2024-09-16T04:32:52.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:52.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:52.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:52.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj504 td/osd-backfill-space/datafile 2024-09-16T04:32:52.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:52.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj504 td/osd-backfill-space/datafile 2024-09-16T04:32:52.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:52.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:52.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:52.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj505 td/osd-backfill-space/datafile 2024-09-16T04:32:52.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:52.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj505 td/osd-backfill-space/datafile 2024-09-16T04:32:53.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:53.055 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:53.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:53.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj506 td/osd-backfill-space/datafile 2024-09-16T04:32:53.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:53.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj506 td/osd-backfill-space/datafile 2024-09-16T04:32:53.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:53.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:53.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:53.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj507 td/osd-backfill-space/datafile 2024-09-16T04:32:53.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:53.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj507 td/osd-backfill-space/datafile 2024-09-16T04:32:53.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:53.406 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:53.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:53.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj508 td/osd-backfill-space/datafile 2024-09-16T04:32:53.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:53.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj508 td/osd-backfill-space/datafile 2024-09-16T04:32:53.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:53.573 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:53.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:53.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj509 td/osd-backfill-space/datafile 2024-09-16T04:32:53.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:53.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj509 td/osd-backfill-space/datafile 2024-09-16T04:32:53.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:53.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:53.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:53.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj510 td/osd-backfill-space/datafile 2024-09-16T04:32:53.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:53.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj510 td/osd-backfill-space/datafile 2024-09-16T04:32:53.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:53.908 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:53.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:53.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj511 td/osd-backfill-space/datafile 2024-09-16T04:32:53.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:53.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj511 td/osd-backfill-space/datafile 2024-09-16T04:32:54.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:54.078 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:54.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:54.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj512 td/osd-backfill-space/datafile 2024-09-16T04:32:54.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:54.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj512 td/osd-backfill-space/datafile 2024-09-16T04:32:54.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:54.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:54.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:54.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj513 td/osd-backfill-space/datafile 2024-09-16T04:32:54.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:54.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj513 td/osd-backfill-space/datafile 2024-09-16T04:32:54.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:54.427 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:54.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:54.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj514 td/osd-backfill-space/datafile 2024-09-16T04:32:54.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:54.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj514 td/osd-backfill-space/datafile 2024-09-16T04:32:54.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:54.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:54.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:54.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj515 td/osd-backfill-space/datafile 2024-09-16T04:32:54.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:54.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj515 td/osd-backfill-space/datafile 2024-09-16T04:32:54.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:54.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:54.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:54.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj516 td/osd-backfill-space/datafile 2024-09-16T04:32:54.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:54.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj516 td/osd-backfill-space/datafile 2024-09-16T04:32:54.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:54.962 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:54.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:54.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj517 td/osd-backfill-space/datafile 2024-09-16T04:32:55.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:55.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj517 td/osd-backfill-space/datafile 2024-09-16T04:32:55.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:55.163 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:55.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:55.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj518 td/osd-backfill-space/datafile 2024-09-16T04:32:55.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:55.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj518 td/osd-backfill-space/datafile 2024-09-16T04:32:55.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:55.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:55.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:55.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj519 td/osd-backfill-space/datafile 2024-09-16T04:32:55.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:55.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj519 td/osd-backfill-space/datafile 2024-09-16T04:32:55.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:55.497 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:55.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:55.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj520 td/osd-backfill-space/datafile 2024-09-16T04:32:55.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:55.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj520 td/osd-backfill-space/datafile 2024-09-16T04:32:55.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:55.681 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:55.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:55.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj521 td/osd-backfill-space/datafile 2024-09-16T04:32:55.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:55.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj521 td/osd-backfill-space/datafile 2024-09-16T04:32:55.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:55.849 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:55.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:55.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj522 td/osd-backfill-space/datafile 2024-09-16T04:32:55.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:55.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj522 td/osd-backfill-space/datafile 2024-09-16T04:32:56.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:56.016 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:56.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:56.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj523 td/osd-backfill-space/datafile 2024-09-16T04:32:56.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:56.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj523 td/osd-backfill-space/datafile 2024-09-16T04:32:56.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:56.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:56.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:56.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj524 td/osd-backfill-space/datafile 2024-09-16T04:32:56.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:56.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj524 td/osd-backfill-space/datafile 2024-09-16T04:32:56.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:56.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:56.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:56.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj525 td/osd-backfill-space/datafile 2024-09-16T04:32:56.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:56.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj525 td/osd-backfill-space/datafile 2024-09-16T04:32:56.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:56.560 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:56.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:56.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj526 td/osd-backfill-space/datafile 2024-09-16T04:32:56.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:56.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj526 td/osd-backfill-space/datafile 2024-09-16T04:32:56.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:56.727 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:56.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:56.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj527 td/osd-backfill-space/datafile 2024-09-16T04:32:56.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:56.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj527 td/osd-backfill-space/datafile 2024-09-16T04:32:56.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:56.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:56.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:56.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj528 td/osd-backfill-space/datafile 2024-09-16T04:32:57.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:57.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj528 td/osd-backfill-space/datafile 2024-09-16T04:32:57.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:57.128 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:57.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:57.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj529 td/osd-backfill-space/datafile 2024-09-16T04:32:57.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:57.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj529 td/osd-backfill-space/datafile 2024-09-16T04:32:57.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:57.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:57.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:57.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj530 td/osd-backfill-space/datafile 2024-09-16T04:32:57.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:57.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj530 td/osd-backfill-space/datafile 2024-09-16T04:32:57.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:57.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:57.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:57.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj531 td/osd-backfill-space/datafile 2024-09-16T04:32:57.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:57.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj531 td/osd-backfill-space/datafile 2024-09-16T04:32:57.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:57.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:57.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:57.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj532 td/osd-backfill-space/datafile 2024-09-16T04:32:57.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:57.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj532 td/osd-backfill-space/datafile 2024-09-16T04:32:57.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:57.798 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:57.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:57.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj533 td/osd-backfill-space/datafile 2024-09-16T04:32:57.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:57.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj533 td/osd-backfill-space/datafile 2024-09-16T04:32:57.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:57.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:57.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:57.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj534 td/osd-backfill-space/datafile 2024-09-16T04:32:58.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:58.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj534 td/osd-backfill-space/datafile 2024-09-16T04:32:58.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:58.177 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:58.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:58.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj535 td/osd-backfill-space/datafile 2024-09-16T04:32:58.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:58.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj535 td/osd-backfill-space/datafile 2024-09-16T04:32:58.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:58.667 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:58.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:58.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj536 td/osd-backfill-space/datafile 2024-09-16T04:32:58.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:58.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj536 td/osd-backfill-space/datafile 2024-09-16T04:32:58.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:58.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:58.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:58.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj537 td/osd-backfill-space/datafile 2024-09-16T04:32:58.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:58.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj537 td/osd-backfill-space/datafile 2024-09-16T04:32:59.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:59.060 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:59.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:59.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj538 td/osd-backfill-space/datafile 2024-09-16T04:32:59.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:59.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj538 td/osd-backfill-space/datafile 2024-09-16T04:32:59.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:59.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:59.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:59.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj539 td/osd-backfill-space/datafile 2024-09-16T04:32:59.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:59.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj539 td/osd-backfill-space/datafile 2024-09-16T04:32:59.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:59.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:59.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:59.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj540 td/osd-backfill-space/datafile 2024-09-16T04:32:59.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:59.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj540 td/osd-backfill-space/datafile 2024-09-16T04:32:59.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:59.562 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:59.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:59.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj541 td/osd-backfill-space/datafile 2024-09-16T04:32:59.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:59.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj541 td/osd-backfill-space/datafile 2024-09-16T04:32:59.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:59.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:59.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:59.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj542 td/osd-backfill-space/datafile 2024-09-16T04:32:59.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:59.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj542 td/osd-backfill-space/datafile 2024-09-16T04:32:59.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:32:59.921 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:32:59.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:32:59.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj543 td/osd-backfill-space/datafile 2024-09-16T04:33:00.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:00.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj543 td/osd-backfill-space/datafile 2024-09-16T04:33:00.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:00.089 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:00.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:00.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj544 td/osd-backfill-space/datafile 2024-09-16T04:33:00.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:00.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj544 td/osd-backfill-space/datafile 2024-09-16T04:33:00.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:00.265 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:00.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:00.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj545 td/osd-backfill-space/datafile 2024-09-16T04:33:00.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:00.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj545 td/osd-backfill-space/datafile 2024-09-16T04:33:00.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:00.432 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:00.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:00.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj546 td/osd-backfill-space/datafile 2024-09-16T04:33:00.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:00.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj546 td/osd-backfill-space/datafile 2024-09-16T04:33:00.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:00.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:00.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:00.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj547 td/osd-backfill-space/datafile 2024-09-16T04:33:00.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:00.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj547 td/osd-backfill-space/datafile 2024-09-16T04:33:00.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:00.800 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:00.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:00.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj548 td/osd-backfill-space/datafile 2024-09-16T04:33:00.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:00.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj548 td/osd-backfill-space/datafile 2024-09-16T04:33:01.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:01.001 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:01.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj549 td/osd-backfill-space/datafile 2024-09-16T04:33:01.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj549 td/osd-backfill-space/datafile 2024-09-16T04:33:01.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:01.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:01.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj550 td/osd-backfill-space/datafile 2024-09-16T04:33:01.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj550 td/osd-backfill-space/datafile 2024-09-16T04:33:01.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:01.361 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:01.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj551 td/osd-backfill-space/datafile 2024-09-16T04:33:01.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj551 td/osd-backfill-space/datafile 2024-09-16T04:33:01.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:01.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:01.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj552 td/osd-backfill-space/datafile 2024-09-16T04:33:01.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj552 td/osd-backfill-space/datafile 2024-09-16T04:33:01.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:01.670 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:01.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj553 td/osd-backfill-space/datafile 2024-09-16T04:33:01.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj553 td/osd-backfill-space/datafile 2024-09-16T04:33:01.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:01.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:01.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj554 td/osd-backfill-space/datafile 2024-09-16T04:33:01.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj554 td/osd-backfill-space/datafile 2024-09-16T04:33:01.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:01.996 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:01.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:01.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj555 td/osd-backfill-space/datafile 2024-09-16T04:33:02.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:02.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj555 td/osd-backfill-space/datafile 2024-09-16T04:33:02.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:02.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:02.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:02.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj556 td/osd-backfill-space/datafile 2024-09-16T04:33:02.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:02.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj556 td/osd-backfill-space/datafile 2024-09-16T04:33:02.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:02.339 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:02.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:02.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj557 td/osd-backfill-space/datafile 2024-09-16T04:33:02.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:02.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj557 td/osd-backfill-space/datafile 2024-09-16T04:33:02.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:02.497 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:02.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:02.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj558 td/osd-backfill-space/datafile 2024-09-16T04:33:02.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:02.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj558 td/osd-backfill-space/datafile 2024-09-16T04:33:02.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:02.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:02.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:02.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj559 td/osd-backfill-space/datafile 2024-09-16T04:33:02.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:02.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj559 td/osd-backfill-space/datafile 2024-09-16T04:33:02.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:02.798 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:02.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:02.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj560 td/osd-backfill-space/datafile 2024-09-16T04:33:02.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:02.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj560 td/osd-backfill-space/datafile 2024-09-16T04:33:02.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:02.959 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:02.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:02.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj561 td/osd-backfill-space/datafile 2024-09-16T04:33:03.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj561 td/osd-backfill-space/datafile 2024-09-16T04:33:03.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:03.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:03.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj562 td/osd-backfill-space/datafile 2024-09-16T04:33:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj562 td/osd-backfill-space/datafile 2024-09-16T04:33:03.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:03.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:03.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj563 td/osd-backfill-space/datafile 2024-09-16T04:33:03.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj563 td/osd-backfill-space/datafile 2024-09-16T04:33:03.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:03.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:03.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj564 td/osd-backfill-space/datafile 2024-09-16T04:33:03.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj564 td/osd-backfill-space/datafile 2024-09-16T04:33:03.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:03.551 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:03.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj565 td/osd-backfill-space/datafile 2024-09-16T04:33:03.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj565 td/osd-backfill-space/datafile 2024-09-16T04:33:03.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:03.692 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:03.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj566 td/osd-backfill-space/datafile 2024-09-16T04:33:03.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj566 td/osd-backfill-space/datafile 2024-09-16T04:33:03.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:03.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:03.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj567 td/osd-backfill-space/datafile 2024-09-16T04:33:03.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:03.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj567 td/osd-backfill-space/datafile 2024-09-16T04:33:04.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:04.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:04.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj568 td/osd-backfill-space/datafile 2024-09-16T04:33:04.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj568 td/osd-backfill-space/datafile 2024-09-16T04:33:04.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:04.169 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:04.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj569 td/osd-backfill-space/datafile 2024-09-16T04:33:04.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj569 td/osd-backfill-space/datafile 2024-09-16T04:33:04.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:04.303 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:04.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj570 td/osd-backfill-space/datafile 2024-09-16T04:33:04.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj570 td/osd-backfill-space/datafile 2024-09-16T04:33:04.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:04.444 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:04.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj571 td/osd-backfill-space/datafile 2024-09-16T04:33:04.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj571 td/osd-backfill-space/datafile 2024-09-16T04:33:04.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:04.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:04.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj572 td/osd-backfill-space/datafile 2024-09-16T04:33:04.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj572 td/osd-backfill-space/datafile 2024-09-16T04:33:04.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:04.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:04.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj573 td/osd-backfill-space/datafile 2024-09-16T04:33:04.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj573 td/osd-backfill-space/datafile 2024-09-16T04:33:04.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:04.904 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:04.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:04.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj574 td/osd-backfill-space/datafile 2024-09-16T04:33:05.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj574 td/osd-backfill-space/datafile 2024-09-16T04:33:05.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:05.089 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:05.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj575 td/osd-backfill-space/datafile 2024-09-16T04:33:05.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj575 td/osd-backfill-space/datafile 2024-09-16T04:33:05.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:05.239 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:05.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj576 td/osd-backfill-space/datafile 2024-09-16T04:33:05.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj576 td/osd-backfill-space/datafile 2024-09-16T04:33:05.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:05.406 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:05.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj577 td/osd-backfill-space/datafile 2024-09-16T04:33:05.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj577 td/osd-backfill-space/datafile 2024-09-16T04:33:05.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:05.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:05.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj578 td/osd-backfill-space/datafile 2024-09-16T04:33:05.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj578 td/osd-backfill-space/datafile 2024-09-16T04:33:05.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:05.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:05.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj579 td/osd-backfill-space/datafile 2024-09-16T04:33:05.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj579 td/osd-backfill-space/datafile 2024-09-16T04:33:05.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:05.865 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:05.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj580 td/osd-backfill-space/datafile 2024-09-16T04:33:05.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:05.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj580 td/osd-backfill-space/datafile 2024-09-16T04:33:06.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:06.007 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:06.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj581 td/osd-backfill-space/datafile 2024-09-16T04:33:06.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj581 td/osd-backfill-space/datafile 2024-09-16T04:33:06.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:06.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:06.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj582 td/osd-backfill-space/datafile 2024-09-16T04:33:06.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj582 td/osd-backfill-space/datafile 2024-09-16T04:33:06.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:06.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:06.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj583 td/osd-backfill-space/datafile 2024-09-16T04:33:06.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj583 td/osd-backfill-space/datafile 2024-09-16T04:33:06.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:06.459 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj584 td/osd-backfill-space/datafile 2024-09-16T04:33:06.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj584 td/osd-backfill-space/datafile 2024-09-16T04:33:06.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:06.592 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:06.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj585 td/osd-backfill-space/datafile 2024-09-16T04:33:06.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj585 td/osd-backfill-space/datafile 2024-09-16T04:33:06.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:06.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:06.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj586 td/osd-backfill-space/datafile 2024-09-16T04:33:06.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj586 td/osd-backfill-space/datafile 2024-09-16T04:33:06.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:06.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:06.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj587 td/osd-backfill-space/datafile 2024-09-16T04:33:06.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:06.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj587 td/osd-backfill-space/datafile 2024-09-16T04:33:07.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:07.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:07.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj588 td/osd-backfill-space/datafile 2024-09-16T04:33:07.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj588 td/osd-backfill-space/datafile 2024-09-16T04:33:07.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:07.211 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:07.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj589 td/osd-backfill-space/datafile 2024-09-16T04:33:07.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj589 td/osd-backfill-space/datafile 2024-09-16T04:33:07.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:07.369 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:07.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj590 td/osd-backfill-space/datafile 2024-09-16T04:33:07.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj590 td/osd-backfill-space/datafile 2024-09-16T04:33:07.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:07.520 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:07.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj591 td/osd-backfill-space/datafile 2024-09-16T04:33:07.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj591 td/osd-backfill-space/datafile 2024-09-16T04:33:07.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:07.671 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:07.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj592 td/osd-backfill-space/datafile 2024-09-16T04:33:07.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj592 td/osd-backfill-space/datafile 2024-09-16T04:33:07.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:07.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:07.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj593 td/osd-backfill-space/datafile 2024-09-16T04:33:07.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj593 td/osd-backfill-space/datafile 2024-09-16T04:33:07.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:07.971 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:07.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:07.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj594 td/osd-backfill-space/datafile 2024-09-16T04:33:08.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:08.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj594 td/osd-backfill-space/datafile 2024-09-16T04:33:08.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:08.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:08.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:08.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj595 td/osd-backfill-space/datafile 2024-09-16T04:33:08.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:08.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj595 td/osd-backfill-space/datafile 2024-09-16T04:33:08.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:08.331 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:08.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:08.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj596 td/osd-backfill-space/datafile 2024-09-16T04:33:08.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:08.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj596 td/osd-backfill-space/datafile 2024-09-16T04:33:08.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:08.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:08.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:08.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj597 td/osd-backfill-space/datafile 2024-09-16T04:33:08.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:08.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj597 td/osd-backfill-space/datafile 2024-09-16T04:33:08.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:08.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:08.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:08.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj598 td/osd-backfill-space/datafile 2024-09-16T04:33:08.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:08.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj598 td/osd-backfill-space/datafile 2024-09-16T04:33:08.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:08.798 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:08.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:08.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj599 td/osd-backfill-space/datafile 2024-09-16T04:33:08.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:08.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj599 td/osd-backfill-space/datafile 2024-09-16T04:33:08.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:137: TEST_backfill_test_simple: for o in $(seq 1 $objects) 2024-09-16T04:33:08.991 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:08.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:08.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test1 put obj600 td/osd-backfill-space/datafile 2024-09-16T04:33:09.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:139: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:09.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:141: TEST_backfill_test_simple: rados -p test2 put obj600 td/osd-backfill-space/datafile 2024-09-16T04:33:09.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:145: TEST_backfill_test_simple: ceph pg dump pgs 2024-09-16T04:33:09.588 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:33:09.588 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 572 0 0 0 0 2342912 0 0 72 500 72 active+clean 2024-09-16T04:31:16.618924+0000 29'572 29:596 [2] 2 [2] 2 0'0 2024-09-16T04:31:13.996240+0000 0'0 2024-09-16T04:31:13.996240+0000 0 0 periodic scrub scheduled @ 2024-09-17T06:16:08.463590+0000 0 0 2024-09-16T04:33:09.589 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 566 0 0 0 0 2318336 0 0 66 500 66 active+clean 2024-09-16T04:31:13.715063+0000 29'566 29:598 [1] 1 [1] 1 0'0 2024-09-16T04:31:11.174292+0000 0'0 2024-09-16T04:31:11.174292+0000 0 0 periodic scrub scheduled @ 2024-09-17T15:38:11.926900+0000 0 0 2024-09-16T04:33:09.589 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:33:09.589 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:33:09.589 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:33:09.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:147: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:33:09.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:147: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:09.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:149: TEST_backfill_test_simple: ceph osd pool set test1 size 2 2024-09-16T04:33:10.341 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 2 2024-09-16T04:33:10.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:147: TEST_backfill_test_simple: for p in $(seq 1 $pools) 2024-09-16T04:33:10.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:149: TEST_backfill_test_simple: ceph osd pool set test2 size 2 2024-09-16T04:33:11.355 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 2 size to 2 2024-09-16T04:33:11.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:151: TEST_backfill_test_simple: sleep 30 2024-09-16T04:33:41.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:153: TEST_backfill_test_simple: wait_for_not_backfilling 1200 2024-09-16T04:33:41.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:83: wait_for_not_backfilling: local timeout=1200 2024-09-16T04:33:41.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:84: wait_for_not_backfilling: wait_for_not_state backfilling 1200 2024-09-16T04:33:41.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=backfilling 2024-09-16T04:33:41.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-09-16T04:33:41.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-09-16T04:33:41.370 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 1200 5 2024-09-16T04:33:41.370 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:33:41.370 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:33:41.370 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:33:41.370 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:33:41.371 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:33:41.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15') 2024-09-16T04:33:41.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-09-16T04:33:41.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-09-16T04:33:41.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-09-16T04:33:41.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:33:41.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:33:42.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:33:42.399 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:33:42.399 INFO:tasks.workunit.client.0.smithi026.stderr:2' 2024-09-16T04:33:42.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:33:42.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:33:42.399 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:33:42.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836533 2024-09-16T04:33:42.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836533 2024-09-16T04:33:42.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836533' 2024-09-16T04:33:42.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:33:42.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:33:42.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673008 2024-09-16T04:33:42.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673008 2024-09-16T04:33:42.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836533 1-42949673008' 2024-09-16T04:33:42.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:33:42.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:33:42.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509476 2024-09-16T04:33:42.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509476 2024-09-16T04:33:42.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836533 1-42949673008 2-64424509476' 2024-09-16T04:33:42.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:33:42.866 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836533 2024-09-16T04:33:42.866 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:33:42.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:33:42.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836533 2024-09-16T04:33:42.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:33:42.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836533 2024-09-16T04:33:42.869 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836533 2024-09-16T04:33:42.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836533' 2024-09-16T04:33:42.869 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:33:43.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836531 -lt 21474836533 2024-09-16T04:33:43.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:33:44.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:33:44.388 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:33:44.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836534 -lt 21474836533 2024-09-16T04:33:44.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:33:44.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673008 2024-09-16T04:33:44.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:33:44.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:33:44.888 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673008 2024-09-16T04:33:44.888 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:33:44.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673008 2024-09-16T04:33:44.889 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673008 2024-09-16T04:33:44.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673008' 2024-09-16T04:33:44.890 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:33:45.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673009 -lt 42949673008 2024-09-16T04:33:45.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:33:45.393 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509476 2024-09-16T04:33:45.393 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:33:45.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:33:45.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509476 2024-09-16T04:33:45.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:33:45.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509476 2024-09-16T04:33:45.395 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509476 2024-09-16T04:33:45.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509476' 2024-09-16T04:33:45.396 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:33:45.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509476 -lt 64424509476 2024-09-16T04:33:45.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-09-16T04:33:45.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:33:45.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:33:46.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 2 == 0 2024-09-16T04:33:46.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:33:46.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:33:46.421 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:33:46.421 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:33:46.421 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:33:46.421 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:33:46.421 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:33:46.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=1 2024-09-16T04:33:46.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 1 = 0 2024-09-16T04:33:46.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 1 '!=' -1 2024-09-16T04:33:46.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:69: wait_for_not_state: loop=0 2024-09-16T04:33:46.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:70: wait_for_not_state: num_in_state=1 2024-09-16T04:33:46.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 5 2024-09-16T04:33:51.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-09-16T04:33:51.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:33:51.900 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:33:51.900 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:33:51.900 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:33:51.900 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:33:51.901 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:33:51.901 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:33:52.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=1 2024-09-16T04:33:52.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 1 = 0 2024-09-16T04:33:52.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:68: wait_for_not_state: test 1 '!=' 1 2024-09-16T04:33:52.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:71: wait_for_not_state: (( 1 >= 81 )) 2024-09-16T04:33:52.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:75: wait_for_not_state: sleep 10 2024-09-16T04:34:02.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:76: wait_for_not_state: loop+=1 2024-09-16T04:34:02.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:34:02.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:34:02.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:34:02.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:34:02.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:34:02.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:34:02.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:34:02.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-09-16T04:34:02.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-09-16T04:34:02.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-09-16T04:34:02.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-09-16T04:34:02.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:154: TEST_backfill_test_simple: wait_for_not_activating 60 2024-09-16T04:34:02.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:89: wait_for_not_activating: local timeout=60 2024-09-16T04:34:02.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:90: wait_for_not_activating: wait_for_not_state activating 60 2024-09-16T04:34:02.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=activating 2024-09-16T04:34:02.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-09-16T04:34:02.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-09-16T04:34:02.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 60 5 2024-09-16T04:34:02.733 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:34:02.733 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:34:02.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:34:02.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:34:02.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:34:02.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15') 2024-09-16T04:34:02.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-09-16T04:34:02.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-09-16T04:34:02.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-09-16T04:34:02.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:34:02.772 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:34:03.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:34:03.196 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:34:03.196 INFO:tasks.workunit.client.0.smithi026.stderr:2' 2024-09-16T04:34:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:34:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:34:03.197 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:34:03.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836540 2024-09-16T04:34:03.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836540 2024-09-16T04:34:03.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836540' 2024-09-16T04:34:03.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:34:03.319 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:34:03.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673014 2024-09-16T04:34:03.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673014 2024-09-16T04:34:03.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836540 1-42949673014' 2024-09-16T04:34:03.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:34:03.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:34:03.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509482 2024-09-16T04:34:03.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509482 2024-09-16T04:34:03.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836540 1-42949673014 2-64424509482' 2024-09-16T04:34:03.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:34:03.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836540 2024-09-16T04:34:03.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:34:03.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:34:03.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836540 2024-09-16T04:34:03.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:34:03.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836540 2024-09-16T04:34:03.568 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836540 2024-09-16T04:34:03.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836540' 2024-09-16T04:34:03.568 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:34:04.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836537 -lt 21474836540 2024-09-16T04:34:04.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:34:05.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:34:05.041 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:34:05.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836540 -lt 21474836540 2024-09-16T04:34:05.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:34:05.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673014 2024-09-16T04:34:05.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:34:05.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:34:05.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673014 2024-09-16T04:34:05.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:34:05.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673014 2024-09-16T04:34:05.503 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673014 2024-09-16T04:34:05.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673014' 2024-09-16T04:34:05.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:34:05.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673015 -lt 42949673014 2024-09-16T04:34:05.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:34:05.943 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509482 2024-09-16T04:34:05.943 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:34:05.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:34:05.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509482 2024-09-16T04:34:05.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:34:05.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509482 2024-09-16T04:34:05.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509482' 2024-09-16T04:34:05.947 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509482 2024-09-16T04:34:05.947 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:34:06.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509483 -lt 64424509482 2024-09-16T04:34:06.356 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-09-16T04:34:06.356 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:34:06.356 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:34:06.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 2 == 0 2024-09-16T04:34:06.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:34:06.920 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state activating 2024-09-16T04:34:06.920 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=activating 2024-09-16T04:34:06.920 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:34:06.921 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("activating"))' 2024-09-16T04:34:06.921 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:34:06.921 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2024-09-16T04:34:07.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-09-16T04:34:07.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-09-16T04:34:07.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-09-16T04:34:07.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-09-16T04:34:07.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:156: TEST_backfill_test_simple: ERRORS=0 2024-09-16T04:34:07.325 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:157: TEST_backfill_test_simple: ceph pg dump pgs 2024-09-16T04:34:07.325 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:157: TEST_backfill_test_simple: grep +backfill_toofull 2024-09-16T04:34:07.325 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:157: TEST_backfill_test_simple: wc -l 2024-09-16T04:34:07.710 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:34:07.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:157: TEST_backfill_test_simple: '[' 1 '!=' 1 ']' 2024-09-16T04:34:07.722 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:163: TEST_backfill_test_simple: expr 2 - 1 2024-09-16T04:34:07.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:163: TEST_backfill_test_simple: expected=1 2024-09-16T04:34:07.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:164: TEST_backfill_test_simple: ceph pg dump pgs 2024-09-16T04:34:07.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:164: TEST_backfill_test_simple: grep active+clean 2024-09-16T04:34:07.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:164: TEST_backfill_test_simple: wc -l 2024-09-16T04:34:08.111 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:34:08.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:164: TEST_backfill_test_simple: '[' 1 '!=' 1 ']' 2024-09-16T04:34:08.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:170: TEST_backfill_test_simple: ceph pg dump pgs 2024-09-16T04:34:08.512 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:34:08.512 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 600 0 600 0 0 2457600 0 0 100 500 100 active+undersized+degraded+remapped+backfill_toofull 2024-09-16T04:33:45.081575+0000 29'600 38:647 [2,1] 2 [2] 2 0'0 2024-09-16T04:31:13.996240+0000 0'0 2024-09-16T04:31:13.996240+0000 0 0 no scrub is scheduled 0 0 2024-09-16T04:34:08.512 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 600 0 0 0 0 2457600 0 0 100 500 100 active+clean 2024-09-16T04:33:55.061389+0000 29'600 38:1862 [1,0] 1 [1,0] 1 0'0 2024-09-16T04:31:11.174292+0000 0'0 2024-09-16T04:31:11.174292+0000 0 0 periodic scrub scheduled @ 2024-09-17T08:40:45.519028+0000 0 0 2024-09-16T04:34:08.512 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:34:08.512 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:34:08.512 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:34:08.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:172: TEST_backfill_test_simple: '[' 0 '!=' 0 ']' 2024-09-16T04:34:08.523 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:177: TEST_backfill_test_simple: seq 1 2 2024-09-16T04:34:08.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:177: TEST_backfill_test_simple: for i in $(seq 1 $pools) 2024-09-16T04:34:08.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:179: TEST_backfill_test_simple: delete_pool test1 2024-09-16T04:34:08.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test1 2024-09-16T04:34:08.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-09-16T04:34:09.110 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' does not exist 2024-09-16T04:34:09.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:177: TEST_backfill_test_simple: for i in $(seq 1 $pools) 2024-09-16T04:34:09.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:179: TEST_backfill_test_simple: delete_pool test2 2024-09-16T04:34:09.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test2 2024-09-16T04:34:09.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-09-16T04:34:09.656 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' does not exist 2024-09-16T04:34:09.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:181: TEST_backfill_test_simple: kill_daemons td/osd-backfill-space 2024-09-16T04:34:09.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:34:09.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:34:09.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:34:09.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:34:09.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:34:14.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:34:14.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:182: TEST_backfill_test_simple: grep -q 'num_bytes mismatch' td/osd-backfill-space/osd.0.log td/osd-backfill-space/osd.1.log td/osd-backfill-space/osd.2.log 2024-09-16T04:34:15.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-09-16T04:34:15.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:34:15.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:34:15.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:34:15.016 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:34:15.016 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:34:15.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:34:15.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:34:15.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:34:15.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:34:15.023 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:34:15.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:34:15.024 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:34:15.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:34:15.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:34:15.026 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:34:15.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:34:15.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:34:15.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:34:15.027 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:34:15.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:34:15.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:34:15.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:34:15.084 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:34:15.084 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:34:15.084 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:34:15.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:34:15.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:34:15.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:34:15.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-09-16T04:34:15.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-09-16T04:34:15.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-space 2024-09-16T04:34:15.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-space 2024-09-16T04:34:15.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:34:15.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:34:15.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:34:15.087 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:34:15.087 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:34:15.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:34:15.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:34:15.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:34:15.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:34:15.088 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:34:15.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:34:15.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:34:15.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:34:15.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:34:15.091 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:34:15.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:34:15.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:34:15.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:34:15.093 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:34:15.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:34:15.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:34:15.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:34:15.096 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:34:15.096 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:34:15.096 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:34:15.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:34:15.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:34:15.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:34:15.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-space 2024-09-16T04:34:15.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:34:15.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:34:15.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:34:15.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.114688 2024-09-16T04:34:15.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:34:15.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:34:15.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:34:15.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-09-16T04:34:15.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_ec_backfill_grow td/osd-backfill-space 2024-09-16T04:34:15.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1111: TEST_ec_backfill_grow: local dir=td/osd-backfill-space 2024-09-16T04:34:15.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1112: TEST_ec_backfill_grow: local poolname=test 2024-09-16T04:34:15.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1113: TEST_ec_backfill_grow: local OSDS=6 2024-09-16T04:34:15.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1114: TEST_ec_backfill_grow: local k=3 2024-09-16T04:34:15.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1115: TEST_ec_backfill_grow: local m=2 2024-09-16T04:34:15.102 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1116: TEST_ec_backfill_grow: expr 600 / 3 2024-09-16T04:34:15.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1116: TEST_ec_backfill_grow: local ecobjects=200 2024-09-16T04:34:15.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1118: TEST_ec_backfill_grow: run_mon td/osd-backfill-space a 2024-09-16T04:34:15.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-space 2024-09-16T04:34:15.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:34:15.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:34:15.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:34:15.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-space/a 2024-09-16T04:34:15.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-09-16T04:34:15.577 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:34:15.578 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:34:15.578 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:34:15.578 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:34:15.578 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:34:15.578 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:34:15.578 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:34:15.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:34:15.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:34:15.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:34:15.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:34:15.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:34:15.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:34:15.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:34:15.780 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:34:15.780 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:34:15.780 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:34:15.780 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:34:15.781 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:34:15.781 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:34:15.781 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T04:34:15.781 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:34:15.781 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get fsid 2024-09-16T04:34:15.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:34:15.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:34:15.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:34:15.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:34:15.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:34:15.871 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:34:15.871 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:34:15.871 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:34:15.871 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:34:15.871 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:34:15.871 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:34:15.871 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T04:34:15.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:34:15.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get mon_host 2024-09-16T04:34:15.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1119: TEST_ec_backfill_grow: run_mgr td/osd-backfill-space x 2024-09-16T04:34:15.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-space 2024-09-16T04:34:15.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:34:15.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:34:15.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:34:15.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-space/x 2024-09-16T04:34:15.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:34:16.820 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:34:16.820 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:34:16.820 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:34:16.820 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:34:16.820 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:34:16.820 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:34:16.820 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:34:16.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:34:16.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:34:16.855 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: expr 6 - 1 2024-09-16T04:34:16.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: seq 0 5 2024-09-16T04:34:16.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:34:16.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1123: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 0 2024-09-16T04:34:16.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:34:16.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:34:16.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T04:34:16.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:34:16.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/0 2024-09-16T04:34:16.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:34:16.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:34:16.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:34:16.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:34:16.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/0 2024-09-16T04:34:16.863 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:34:16.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5c3e8621-3489-49f4-a7f7-548aa3a1141a 2024-09-16T04:34:16.864 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 5c3e8621-3489-49f4-a7f7-548aa3a1141a 2024-09-16T04:34:16.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 5c3e8621-3489-49f4-a7f7-548aa3a1141a' 2024-09-16T04:34:16.865 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:34:16.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBItedm0rm2NBAADMzNLwTh+NwHBB2diuW9kg== 2024-09-16T04:34:16.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBItedm0rm2NBAADMzNLwTh+NwHBB2diuW9kg=="}' 2024-09-16T04:34:16.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5c3e8621-3489-49f4-a7f7-548aa3a1141a -i td/osd-backfill-space/0/new.json 2024-09-16T04:34:17.161 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:34:17.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/0/new.json 2024-09-16T04:34:17.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBItedm0rm2NBAADMzNLwTh+NwHBB2diuW9kg== --osd-uuid 5c3e8621-3489-49f4-a7f7-548aa3a1141a 2024-09-16T04:34:17.209 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:17.207+0000 7facea62f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:34:17.229 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:17.228+0000 7facea62f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:34:17.230 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:17.229+0000 7facea62f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:34:17.230 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:17.229+0000 7facea62f640 -1 bdev(0x561675ab7c00 td/osd-backfill-space/0/block) open stat got: (1) Operation not permitted 2024-09-16T04:34:17.230 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:17.229+0000 7facea62f640 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-09-16T04:34:23.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-09-16T04:34:23.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:34:23.037 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T04:34:23.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T04:34:23.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:34:23.620 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T04:34:23.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T04:34:23.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:34:23.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:34:23.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:34:23.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:34:23.655 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:23.653+0000 7f20eca64640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:34:23.674 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:23.673+0000 7f20eca64640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:34:23.675 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:23.674+0000 7f20eca64640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:34:24.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T04:34:24.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:34:24.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:34:24.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:34:24.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:34:24.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:24.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:34:24.063 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:34:24.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:24.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:24.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:25.019 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:25.017+0000 7f20eca64640 -1 Falling back to public interface 2024-09-16T04:34:25.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:25.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:25.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:34:25.515 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:34:25.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:25.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:25.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:26.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:26.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:26.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:34:26.966 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:34:26.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:26.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:27.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:27.993 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:27.991+0000 7f20eca64640 -1 osd.0 0 log_to_monitors true 2024-09-16T04:34:28.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:28.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:28.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:34:28.418 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:34:28.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:28.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:29.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:30.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:30.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:30.056 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:34:30.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:34:30.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:30.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:30.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:31.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:31.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:31.501 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:34:31.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:34:31.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:31.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:31.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:32.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:32.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:32.944 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:34:32.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:34:32.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:32.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:33.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:34.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:34.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:34.377 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:34:34.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:34:34.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:34.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:34.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:35.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:35.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:35.929 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:34:35.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:34:35.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:35.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:36.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:37.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:37.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:37.369 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:34:37.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:34:37.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:37.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:37.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:38.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:38.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:38.936 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:34:38.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:34:38.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:38.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:39.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:40.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:40.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:40.364 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:34:40.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:34:40.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:40.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:40.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:41.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:41.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:41.787 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:34:41.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:34:41.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:41.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:42.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:43.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:43.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:43.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:34:43.420 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:34:43.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:43.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:44.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:45.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:45.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:45.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:34:45.425 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:34:45.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:45.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:46.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:47.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:47.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:47.178 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:34:47.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:34:47.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:47.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:48.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:49.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:49.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:49.050 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:34:49.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:34:49.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:49.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:49.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:34:50.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:34:50.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:50.656 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:34:50.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:34:50.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:50.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:34:51.159 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3791854311,v1:127.0.0.1:6803/3791854311] [v2:127.0.0.1:6804/3791854311,v1:127.0.0.1:6805/3791854311] exists,up 5c3e8621-3489-49f4-a7f7-548aa3a1141a 2024-09-16T04:34:51.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:34:51.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:34:51.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:34:51.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:34:51.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1123: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 1 2024-09-16T04:34:51.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:34:51.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:34:51.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T04:34:51.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:34:51.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/1 2024-09-16T04:34:51.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:34:51.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:34:51.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:34:51.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:34:51.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-09-16T04:34:51.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-09-16T04:34:51.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:34:51.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:34:51.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:34:51.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:34:51.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:34:51.171 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:34:51.171 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:34:51.172 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:34:51.172 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:34:51.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:34:51.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:34:51.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:34:51.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:34:51.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:34:51.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:34:51.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:34:51.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:34:51.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:34:51.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:34:51.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:34:51.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:34:51.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:34:51.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/1 2024-09-16T04:34:51.174 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:34:51.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=84fef012-a442-42b6-8a26-2de41c538d27 2024-09-16T04:34:51.175 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 84fef012-a442-42b6-8a26-2de41c538d27 2024-09-16T04:34:51.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 84fef012-a442-42b6-8a26-2de41c538d27' 2024-09-16T04:34:51.176 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:34:51.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBrtedmqyoVCxAAMRrDMuSemn0xpThkQu2fIg== 2024-09-16T04:34:51.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBrtedmqyoVCxAAMRrDMuSemn0xpThkQu2fIg=="}' 2024-09-16T04:34:51.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 84fef012-a442-42b6-8a26-2de41c538d27 -i td/osd-backfill-space/1/new.json 2024-09-16T04:34:51.768 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:34:51.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/1/new.json 2024-09-16T04:34:51.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBrtedmqyoVCxAAMRrDMuSemn0xpThkQu2fIg== --osd-uuid 84fef012-a442-42b6-8a26-2de41c538d27 2024-09-16T04:34:51.817 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:51.816+0000 7fc83f34f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:34:51.818 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:51.817+0000 7fc83f34f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:34:51.819 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:51.818+0000 7fc83f34f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:34:51.820 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:51.819+0000 7fc83f34f640 -1 bdev(0x558e198e3c00 td/osd-backfill-space/1/block) open stat got: (1) Operation not permitted 2024-09-16T04:34:51.820 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:51.819+0000 7fc83f34f640 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-09-16T04:34:57.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-09-16T04:34:57.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:34:57.986 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T04:34:57.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T04:34:57.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:34:58.558 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T04:34:58.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T04:34:58.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:34:58.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:34:58.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:34:58.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:34:58.593 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:58.592+0000 7f23c540b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:34:58.595 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:58.594+0000 7f23c540b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:34:58.596 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:58.595+0000 7f23c540b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:34:59.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T04:34:59.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:34:59.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:34:59.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:34:59.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:34:59.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:34:59.012 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:34:59.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:34:59.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:34:59.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:34:59.436 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:34:59.435+0000 7f23c540b640 -1 Falling back to public interface 2024-09-16T04:34:59.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:00.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:00.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:00.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:35:00.456 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:35:00.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:00.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:00.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:01.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:01.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:01.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:35:01.899 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:35:01.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:01.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:02.167 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:35:02.166+0000 7f23c540b640 -1 osd.1 0 log_to_monitors true 2024-09-16T04:35:02.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:03.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:03.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:03.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:35:03.361 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:35:03.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:03.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:03.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:04.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:04.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:04.783 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:35:04.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:35:04.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:04.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:05.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:06.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:06.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:06.304 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:35:06.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:35:06.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:06.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:06.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:07.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:07.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:07.771 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:35:07.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:35:07.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:07.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:08.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:09.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:09.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:09.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:35:09.194 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:35:09.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:09.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:09.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:10.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:10.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:10.636 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:35:10.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:35:10.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:10.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:11.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:12.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:12.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:12.142 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:35:12.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:35:12.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:12.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:12.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:13.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:13.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:13.569 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:35:13.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:35:13.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:13.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:14.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:15.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:15.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:15.132 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:35:15.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:35:15.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:15.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:15.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:16.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:16.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:16.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:35:16.808 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:35:16.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:16.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:17.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:18.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:18.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:18.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:35:18.942 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:35:18.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:18.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:19.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:20.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:20.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:20.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:35:20.807 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:35:20.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:20.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:21.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:22.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:22.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:22.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:35:22.453 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:35:22.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:22.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:23.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:24.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:24.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:24.153 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:35:24.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:35:24.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:24.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:24.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:25.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:25.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:25.919 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:35:25.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:35:25.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:25.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:35:26.372 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1822864712,v1:127.0.0.1:6811/1822864712] [v2:127.0.0.1:6812/1822864712,v1:127.0.0.1:6813/1822864712] exists,up 84fef012-a442-42b6-8a26-2de41c538d27 2024-09-16T04:35:26.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:35:26.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:35:26.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:35:26.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:35:26.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1123: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 2 2024-09-16T04:35:26.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:35:26.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:35:26.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T04:35:26.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:35:26.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/2 2024-09-16T04:35:26.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:35:26.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:35:26.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:35:26.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:35:26.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-09-16T04:35:26.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-09-16T04:35:26.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:35:26.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:35:26.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:35:26.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:35:26.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:35:26.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:35:26.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:35:26.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:35:26.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:35:26.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:35:26.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/2 2024-09-16T04:35:26.380 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:35:26.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b54afe36-4eb5-490b-91b1-015d4de9d76f 2024-09-16T04:35:26.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 b54afe36-4eb5-490b-91b1-015d4de9d76f' 2024-09-16T04:35:26.381 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 b54afe36-4eb5-490b-91b1-015d4de9d76f 2024-09-16T04:35:26.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:35:26.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCOtedmh6DLFxAAmHw4J5pnNAKbzNQu1pEYuA== 2024-09-16T04:35:26.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCOtedmh6DLFxAAmHw4J5pnNAKbzNQu1pEYuA=="}' 2024-09-16T04:35:26.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b54afe36-4eb5-490b-91b1-015d4de9d76f -i td/osd-backfill-space/2/new.json 2024-09-16T04:35:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:35:26.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/2/new.json 2024-09-16T04:35:26.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCOtedmh6DLFxAAmHw4J5pnNAKbzNQu1pEYuA== --osd-uuid b54afe36-4eb5-490b-91b1-015d4de9d76f 2024-09-16T04:35:26.995 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:35:26.994+0000 7f3489264640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:35:26.997 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:35:26.996+0000 7f3489264640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:35:26.998 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:35:26.997+0000 7f3489264640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:35:26.999 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:35:26.997+0000 7f3489264640 -1 bdev(0x55e11a0ffc00 td/osd-backfill-space/2/block) open stat got: (1) Operation not permitted 2024-09-16T04:35:26.999 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:35:26.997+0000 7f3489264640 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-09-16T04:35:32.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-09-16T04:35:32.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:35:32.900 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T04:35:32.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T04:35:32.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:35:33.474 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T04:35:33.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T04:35:33.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:35:33.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:35:33.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:35:33.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:35:33.509 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:35:33.506+0000 7f3cd97cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:35:33.511 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:35:33.509+0000 7f3cd97cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:35:33.512 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:35:33.510+0000 7f3cd97cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:35:33.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T04:35:33.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:35:33.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:35:33.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:35:33.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:35:33.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:33.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:35:33.931 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:35:33.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:33.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:34.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:35.107 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:35:35.105+0000 7f3cd97cc640 -1 Falling back to public interface 2024-09-16T04:35:35.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:35.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:35.374 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:35:35.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:35:35.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:35.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:35.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:36.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:36.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:36.834 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:35:36.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:35:36.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:36.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:37.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:37.862 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:35:37.859+0000 7f3cd97cc640 -1 osd.2 0 log_to_monitors true 2024-09-16T04:35:38.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:38.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:38.260 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:35:38.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:35:38.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:38.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:38.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:39.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:39.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:39.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:35:39.683 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:35:39.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:39.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:40.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:41.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:41.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:41.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:35:41.224 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:35:41.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:41.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:41.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:42.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:42.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:42.787 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:35:42.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:35:42.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:42.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:43.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:44.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:44.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:44.269 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:35:44.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:35:44.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:44.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:44.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:45.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:45.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:45.725 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:35:45.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:35:45.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:45.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:46.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:47.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:47.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:47.224 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:35:47.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:35:47.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:47.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:47.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:48.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:48.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:48.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:35:48.664 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:35:48.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:48.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:49.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:50.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:50.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:50.088 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:35:50.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:35:50.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:50.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:50.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:51.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:51.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:51.914 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:35:51.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:35:51.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:51.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:52.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:53.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:53.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:53.683 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:35:53.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:35:53.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:53.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:54.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:55.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:55.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:55.536 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:35:55.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:35:55.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:55.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:56.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:57.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:57.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:57.683 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:35:57.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:35:57.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:57.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:35:58.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:35:59.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:35:59.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:35:59.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:35:59.702 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:35:59.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:35:59.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:36:00.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:01.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:01.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:01.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:36:01.622 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:36:01.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:01.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:36:02.065 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1361485813,v1:127.0.0.1:6819/1361485813] [v2:127.0.0.1:6820/1361485813,v1:127.0.0.1:6821/1361485813] exists,up b54afe36-4eb5-490b-91b1-015d4de9d76f 2024-09-16T04:36:02.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:36:02.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:36:02.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:36:02.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:36:02.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1123: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 3 2024-09-16T04:36:02.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:36:02.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:36:02.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T04:36:02.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:36:02.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/3 2024-09-16T04:36:02.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:36:02.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:36:02.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:36:02.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:36:02.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2024-09-16T04:36:02.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2024-09-16T04:36:02.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:36:02.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:36:02.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:36:02.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:36:02.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:36:02.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:36:02.071 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:36:02.071 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:36:02.071 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:36:02.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:36:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/3 2024-09-16T04:36:02.073 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:36:02.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c0f8b6fe-bd39-4080-a076-9e5a40d0c111 2024-09-16T04:36:02.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 c0f8b6fe-bd39-4080-a076-9e5a40d0c111' 2024-09-16T04:36:02.073 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 c0f8b6fe-bd39-4080-a076-9e5a40d0c111 2024-09-16T04:36:02.073 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:36:02.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCytedmnY9wBRAAX/l6xv0E81piFMXMHYby6w== 2024-09-16T04:36:02.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCytedmnY9wBRAAX/l6xv0E81piFMXMHYby6w=="}' 2024-09-16T04:36:02.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c0f8b6fe-bd39-4080-a076-9e5a40d0c111 -i td/osd-backfill-space/3/new.json 2024-09-16T04:36:02.561 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:36:02.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/3/new.json 2024-09-16T04:36:02.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCytedmnY9wBRAAX/l6xv0E81piFMXMHYby6w== --osd-uuid c0f8b6fe-bd39-4080-a076-9e5a40d0c111 2024-09-16T04:36:02.610 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:02.609+0000 7f1553dc5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:36:02.611 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:02.611+0000 7f1553dc5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:36:02.613 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:02.612+0000 7f1553dc5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:36:02.613 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:02.612+0000 7f1553dc5640 -1 bdev(0x55ad36d2bc00 td/osd-backfill-space/3/block) open stat got: (1) Operation not permitted 2024-09-16T04:36:02.613 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:02.612+0000 7f1553dc5640 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2024-09-16T04:36:08.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2024-09-16T04:36:08.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:36:08.630 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T04:36:08.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T04:36:08.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:36:09.194 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T04:36:09.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T04:36:09.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:36:09.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:36:09.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:36:09.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:36:09.230 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:09.229+0000 7fde9f40d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:36:09.237 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:09.237+0000 7fde9f40d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:36:09.239 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:09.238+0000 7fde9f40d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:36:09.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T04:36:09.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:36:09.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T04:36:09.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:36:09.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:36:09.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:09.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:36:09.635 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:36:09.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:09.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:10.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:10.327 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:10.326+0000 7fde9f40d640 -1 Falling back to public interface 2024-09-16T04:36:11.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:11.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:11.048 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:36:11.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:36:11.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:11.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:11.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:12.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:12.504 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:36:12.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:12.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:36:12.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:12.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:12.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:13.100 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:13.099+0000 7fde9f40d640 -1 osd.3 0 log_to_monitors true 2024-09-16T04:36:13.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:13.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:13.934 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:36:13.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:36:13.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:13.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:14.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:15.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:15.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:15.399 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:36:15.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:36:15.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:15.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:15.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:16.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:16.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:16.822 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:36:16.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:36:16.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:16.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:17.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:18.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:18.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:18.350 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:36:18.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:36:18.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:18.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:18.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:19.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:19.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:19.776 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:36:19.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:36:19.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:19.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:20.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:21.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:21.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:21.391 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:36:21.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:36:21.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:21.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:21.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:22.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:22.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:22.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:36:22.815 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:36:22.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:22.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:23.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:24.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:24.329 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:36:24.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:24.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:36:24.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:24.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:24.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:25.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:25.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:25.778 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:36:25.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:36:25.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:25.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:26.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:27.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:27.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:27.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:36:27.530 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:36:27.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:27.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:28.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:29.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:29.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:29.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:36:29.645 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:36:29.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:29.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:30.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:31.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:31.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:31.347 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:36:31.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:36:31.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:31.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:32.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:33.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:33.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:33.189 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:36:33.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:36:33.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:33.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:33.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:34.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:34.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:34.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:36:34.801 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:36:34.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:34.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:35.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:36.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:36.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:36.703 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:36:36.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:36:36.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:36.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:36:37.166 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2243602545,v1:127.0.0.1:6827/2243602545] [v2:127.0.0.1:6828/2243602545,v1:127.0.0.1:6829/2243602545] exists,up c0f8b6fe-bd39-4080-a076-9e5a40d0c111 2024-09-16T04:36:37.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:36:37.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:36:37.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:36:37.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1123: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 4 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/4 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:36:37.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:36:37.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:36:37.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:36:37.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:36:37.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:36:37.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:36:37.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:36:37.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:36:37.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:36:37.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/4 2024-09-16T04:36:37.173 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:36:37.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=eb4433e3-7e12-42f0-8e69-0e1ce0d47c58 2024-09-16T04:36:37.174 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 eb4433e3-7e12-42f0-8e69-0e1ce0d47c58 2024-09-16T04:36:37.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 eb4433e3-7e12-42f0-8e69-0e1ce0d47c58' 2024-09-16T04:36:37.174 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:36:37.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDVtedmSpyDCxAANzDcycK6mB7adh5GzUHPKg== 2024-09-16T04:36:37.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDVtedmSpyDCxAANzDcycK6mB7adh5GzUHPKg=="}' 2024-09-16T04:36:37.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new eb4433e3-7e12-42f0-8e69-0e1ce0d47c58 -i td/osd-backfill-space/4/new.json 2024-09-16T04:36:37.726 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:36:37.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/4/new.json 2024-09-16T04:36:37.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDVtedmSpyDCxAANzDcycK6mB7adh5GzUHPKg== --osd-uuid eb4433e3-7e12-42f0-8e69-0e1ce0d47c58 2024-09-16T04:36:37.774 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:37.772+0000 7efdc0a44640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:36:37.775 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:37.774+0000 7efdc0a44640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:36:37.776 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:37.775+0000 7efdc0a44640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:36:37.777 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:37.776+0000 7efdc0a44640 -1 bdev(0x55c04df13c00 td/osd-backfill-space/4/block) open stat got: (1) Operation not permitted 2024-09-16T04:36:37.777 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:37.776+0000 7efdc0a44640 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2024-09-16T04:36:44.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2024-09-16T04:36:44.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:36:44.249 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T04:36:44.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T04:36:44.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:36:44.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T04:36:44.821 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T04:36:44.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:36:44.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:36:44.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:36:44.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:36:44.856 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:44.854+0000 7f543f141640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:36:44.858 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:44.856+0000 7f543f141640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:36:44.859 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:44.857+0000 7f543f141640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:36:45.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T04:36:45.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:36:45.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T04:36:45.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:36:45.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:36:45.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:45.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:36:45.253 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:36:45.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:45.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:36:45.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:46.439 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:46.437+0000 7f543f141640 -1 Falling back to public interface 2024-09-16T04:36:46.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:46.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:46.698 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:36:46.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:36:46.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:46.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:36:47.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:48.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:48.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:48.181 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:36:48.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:36:48.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:48.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:36:48.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:49.405 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:36:49.402+0000 7f543f141640 -1 osd.4 0 log_to_monitors true 2024-09-16T04:36:49.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:49.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:49.639 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:36:49.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:36:49.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:49.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:36:50.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:51.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:51.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:51.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:36:51.179 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:36:51.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:51.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:36:51.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:52.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:52.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:52.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:36:52.728 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:36:52.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:52.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:36:53.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:54.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:54.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:54.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:36:54.337 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:36:54.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:54.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:36:54.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:55.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:55.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:55.871 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:36:55.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:36:55.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:55.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:36:56.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:57.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:57.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:57.381 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:36:57.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:36:57.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:57.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:36:57.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:36:58.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:36:58.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:36:58.827 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:36:58.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:36:58.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:36:58.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:36:59.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:00.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:00.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:00.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:37:00.352 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:37:00.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:00.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:37:00.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:01.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:01.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:01.778 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:37:01.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:37:01.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:01.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:37:02.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:03.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:03.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:03.731 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:37:03.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:37:03.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:03.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:37:04.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:05.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:05.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:05.507 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:37:05.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:37:05.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:05.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:37:06.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:07.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:07.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:07.159 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:37:07.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:37:07.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:07.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:37:07.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:08.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:08.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:08.681 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:37:08.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:37:08.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:08.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:37:09.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:10.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:10.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:10.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:37:10.702 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:37:10.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:10.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:37:11.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:12.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:12.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:12.387 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:37:12.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:37:12.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:12.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:37:13.032 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1872048414,v1:127.0.0.1:6835/1872048414] [v2:127.0.0.1:6836/1872048414,v1:127.0.0.1:6837/1872048414] exists,up eb4433e3-7e12-42f0-8e69-0e1ce0d47c58 2024-09-16T04:37:13.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:37:13.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:37:13.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:37:13.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1121: TEST_ec_backfill_grow: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:37:13.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1123: TEST_ec_backfill_grow: run_osd td/osd-backfill-space 5 2024-09-16T04:37:13.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:37:13.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:37:13.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T04:37:13.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:37:13.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/5 2024-09-16T04:37:13.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:37:13.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:37:13.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:37:13.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:37:13.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/5' 2024-09-16T04:37:13.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/5/journal' 2024-09-16T04:37:13.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:37:13.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:37:13.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:37:13.041 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:37:13.041 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:37:13.041 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:37:13.042 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:37:13.042 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:37:13.042 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:37:13.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:37:13.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:37:13.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:37:13.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:37:13.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:37:13.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:37:13.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:37:13.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:37:13.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:37:13.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:37:13.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:37:13.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:37:13.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:37:13.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/5 2024-09-16T04:37:13.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:37:13.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d3447f05-e328-4db3-aa90-0a3f21fb15dc 2024-09-16T04:37:13.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 d3447f05-e328-4db3-aa90-0a3f21fb15dc' 2024-09-16T04:37:13.044 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 d3447f05-e328-4db3-aa90-0a3f21fb15dc 2024-09-16T04:37:13.044 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:37:13.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD5tedmYEF8AxAAYBBh8yEu+QFRlkrniUO/Ng== 2024-09-16T04:37:13.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD5tedmYEF8AxAAYBBh8yEu+QFRlkrniUO/Ng=="}' 2024-09-16T04:37:13.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d3447f05-e328-4db3-aa90-0a3f21fb15dc -i td/osd-backfill-space/5/new.json 2024-09-16T04:37:13.750 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:37:13.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/5/new.json 2024-09-16T04:37:13.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD5tedmYEF8AxAAYBBh8yEu+QFRlkrniUO/Ng== --osd-uuid d3447f05-e328-4db3-aa90-0a3f21fb15dc 2024-09-16T04:37:13.800 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:37:13.798+0000 7f8b90824640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:37:13.801 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:37:13.800+0000 7f8b90824640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:37:13.802 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:37:13.801+0000 7f8b90824640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:37:13.803 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:37:13.801+0000 7f8b90824640 -1 bdev(0x5582645ffc00 td/osd-backfill-space/5/block) open stat got: (1) Operation not permitted 2024-09-16T04:37:13.803 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:37:13.802+0000 7f8b90824640 -1 bluestore(td/osd-backfill-space/5) _read_fsid unparsable uuid 2024-09-16T04:37:20.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/5/keyring 2024-09-16T04:37:20.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:37:20.213 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T04:37:20.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T04:37:20.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:37:20.795 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T04:37:20.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T04:37:20.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:37:20.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:37:20.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:37:20.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:37:20.830 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:37:20.828+0000 7f921a21c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:37:20.842 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:37:20.841+0000 7f921a21c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:37:20.843 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:37:20.842+0000 7f921a21c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:37:21.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T04:37:21.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:37:21.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T04:37:21.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:37:21.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:37:21.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:21.246 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:37:21.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:37:21.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:21.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:21.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:22.184 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:37:22.183+0000 7f921a21c640 -1 Falling back to public interface 2024-09-16T04:37:22.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:22.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:22.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:37:22.692 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:37:22.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:22.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:23.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:24.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:24.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:24.176 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:37:24.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:37:24.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:24.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:24.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:25.015 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:37:25.014+0000 7f921a21c640 -1 osd.5 0 log_to_monitors true 2024-09-16T04:37:25.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:25.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:25.605 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:37:25.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:37:25.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:25.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:26.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:27.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:27.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:27.159 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:37:27.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:37:27.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:27.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:27.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:28.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:28.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:28.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:37:28.590 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:37:28.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:28.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:29.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:30.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:30.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:30.070 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:37:30.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:37:30.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:30.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:30.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:31.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:31.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:31.559 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:37:31.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:37:31.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:31.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:32.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:33.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:33.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:33.064 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:37:33.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:37:33.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:33.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:33.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:34.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:34.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:34.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:37:34.517 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:37:34.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:34.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:34.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:35.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:35.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:35.948 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:37:35.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:37:35.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:35.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:36.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:37.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:37.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:37.447 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:37:37.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:37:37.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:37.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:38.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:39.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:37:39.050 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:37:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:39.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:40.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:41.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:41.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:41.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:37:41.174 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:37:41.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:41.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:42.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:43.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:43.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:43.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:37:43.011 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:37:43.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:43.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:43.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:44.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:44.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:44.676 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:37:44.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:37:44.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:44.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:45.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:46.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:46.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:46.486 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:37:46.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:37:46.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:46.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:47.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:37:48.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:37:48.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:37:48.284 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:37:48.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:37:48.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:37:48.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:37:48.747 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2316812834,v1:127.0.0.1:6843/2316812834] [v2:127.0.0.1:6844/2316812834,v1:127.0.0.1:6845/2316812834] exists,up d3447f05-e328-4db3-aa90-0a3f21fb15dc 2024-09-16T04:37:48.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:37:48.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:37:48.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:37:48.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1126: TEST_ec_backfill_grow: ceph osd set-backfillfull-ratio .85 2024-09-16T04:37:49.454 INFO:tasks.workunit.client.0.smithi026.stderr:osd set-backfillfull-ratio 0.85 2024-09-16T04:37:49.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1128: TEST_ec_backfill_grow: ceph osd set-require-min-compat-client luminous 2024-09-16T04:37:50.224 INFO:tasks.workunit.client.0.smithi026.stderr:set require_min_compat_client to luminous 2024-09-16T04:37:50.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1129: TEST_ec_backfill_grow: ceph osd erasure-code-profile set ec-profile k=3 m=2 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure 2024-09-16T04:37:50.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1130: TEST_ec_backfill_grow: ceph osd pool create test 1 1 erasure ec-profile 2024-09-16T04:37:51.842 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T04:37:51.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1132: TEST_ec_backfill_grow: wait_for_clean 2024-09-16T04:37:51.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T04:37:51.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T04:37:51.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T04:37:51.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T04:37:51.855 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:37:51.855 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:37:51.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:37:51.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:37:51.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:37:51.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T04:37:51.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T04:37:51.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T04:37:51.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T04:37:51.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:37:51.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:37:52.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:37:52.423 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:37:52.423 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:37:52.423 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:37:52.423 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T04:37:52.424 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T04:37:52.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:37:52.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:37:52.424 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:37:52.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836521 2024-09-16T04:37:52.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836521 2024-09-16T04:37:52.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836521' 2024-09-16T04:37:52.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:37:52.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:37:52.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672995 2024-09-16T04:37:52.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672995 2024-09-16T04:37:52.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836521 1-42949672995' 2024-09-16T04:37:52.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:37:52.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:37:52.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509467 2024-09-16T04:37:52.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509467 2024-09-16T04:37:52.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836521 1-42949672995 2-64424509467' 2024-09-16T04:37:52.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:37:52.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:37:53.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345944 2024-09-16T04:37:53.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345944 2024-09-16T04:37:53.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836521 1-42949672995 2-64424509467 3-85899345944' 2024-09-16T04:37:53.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:37:53.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:37:53.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182421 2024-09-16T04:37:53.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182421 2024-09-16T04:37:53.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836521 1-42949672995 2-64424509467 3-85899345944 4-107374182421' 2024-09-16T04:37:53.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:37:53.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T04:37:53.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018887 2024-09-16T04:37:53.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018887 2024-09-16T04:37:53.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836521 1-42949672995 2-64424509467 3-85899345944 4-107374182421 5-128849018887' 2024-09-16T04:37:53.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:37:53.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836521 2024-09-16T04:37:53.348 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:37:53.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:37:53.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836521 2024-09-16T04:37:53.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:37:53.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836521 2024-09-16T04:37:53.350 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836521 2024-09-16T04:37:53.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836521' 2024-09-16T04:37:53.350 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:37:53.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836521 -lt 21474836521 2024-09-16T04:37:53.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:37:53.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672995 2024-09-16T04:37:53.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:37:53.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:37:53.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672995 2024-09-16T04:37:53.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:37:53.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672995 2024-09-16T04:37:53.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672995' 2024-09-16T04:37:53.860 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672995 2024-09-16T04:37:53.860 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:37:54.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672995 -lt 42949672995 2024-09-16T04:37:54.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:37:54.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509467 2024-09-16T04:37:54.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:37:54.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:37:54.311 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509467 2024-09-16T04:37:54.311 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:37:54.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509467 2024-09-16T04:37:54.312 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509467 2024-09-16T04:37:54.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509467' 2024-09-16T04:37:54.313 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:37:54.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509467 -lt 64424509467 2024-09-16T04:37:54.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:37:54.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345944 2024-09-16T04:37:54.754 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:37:54.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:37:54.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345944 2024-09-16T04:37:54.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:37:54.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345944 2024-09-16T04:37:54.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345944' 2024-09-16T04:37:54.757 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345944 2024-09-16T04:37:54.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:37:55.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345944 -lt 85899345944 2024-09-16T04:37:55.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:37:55.166 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182421 2024-09-16T04:37:55.167 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:37:55.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:37:55.169 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182421 2024-09-16T04:37:55.169 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:37:55.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182421 2024-09-16T04:37:55.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182421' 2024-09-16T04:37:55.170 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182421 2024-09-16T04:37:55.170 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:37:55.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182422 -lt 107374182421 2024-09-16T04:37:55.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:37:55.623 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018887 2024-09-16T04:37:55.623 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:37:55.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T04:37:55.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018887 2024-09-16T04:37:55.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:37:55.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018887 2024-09-16T04:37:55.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018887' 2024-09-16T04:37:55.626 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018887 2024-09-16T04:37:55.626 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T04:37:56.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018888 -lt 128849018887 2024-09-16T04:37:56.049 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T04:37:56.050 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:37:56.050 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:37:56.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T04:37:56.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:37:56.613 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:37:56.613 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:37:56.613 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:37:56.613 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:37:56.613 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:37:56.613 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:37:57.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T04:37:57.041 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:37:57.041 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:37:57.041 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:37:57.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T04:37:57.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T04:37:57.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T04:37:57.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1134: TEST_ec_backfill_grow: dd if=/dev/urandom of=td/osd-backfill-space/12kdata bs=1k count=12 2024-09-16T04:37:57.609 INFO:tasks.workunit.client.0.smithi026.stderr:12+0 records in 2024-09-16T04:37:57.609 INFO:tasks.workunit.client.0.smithi026.stderr:12+0 records out 2024-09-16T04:37:57.609 INFO:tasks.workunit.client.0.smithi026.stderr:12288 bytes (12 kB, 12 KiB) copied, 9.7193e-05 s, 126 MB/s 2024-09-16T04:37:57.610 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: seq 1 200 2024-09-16T04:37:57.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:37:57.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj1 td/osd-backfill-space/12kdata 2024-09-16T04:37:57.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:37:57.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj2 td/osd-backfill-space/12kdata 2024-09-16T04:37:58.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:37:58.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj3 td/osd-backfill-space/12kdata 2024-09-16T04:37:58.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:37:58.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj4 td/osd-backfill-space/12kdata 2024-09-16T04:37:58.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:37:58.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj5 td/osd-backfill-space/12kdata 2024-09-16T04:37:58.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:37:58.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj6 td/osd-backfill-space/12kdata 2024-09-16T04:37:59.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:37:59.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj7 td/osd-backfill-space/12kdata 2024-09-16T04:37:59.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:37:59.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj8 td/osd-backfill-space/12kdata 2024-09-16T04:37:59.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:37:59.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj9 td/osd-backfill-space/12kdata 2024-09-16T04:37:59.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:37:59.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj10 td/osd-backfill-space/12kdata 2024-09-16T04:38:00.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:00.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj11 td/osd-backfill-space/12kdata 2024-09-16T04:38:00.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:00.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj12 td/osd-backfill-space/12kdata 2024-09-16T04:38:00.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:00.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj13 td/osd-backfill-space/12kdata 2024-09-16T04:38:01.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:01.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj14 td/osd-backfill-space/12kdata 2024-09-16T04:38:01.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:01.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj15 td/osd-backfill-space/12kdata 2024-09-16T04:38:01.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:01.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj16 td/osd-backfill-space/12kdata 2024-09-16T04:38:01.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:01.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj17 td/osd-backfill-space/12kdata 2024-09-16T04:38:02.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:02.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj18 td/osd-backfill-space/12kdata 2024-09-16T04:38:02.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:02.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj19 td/osd-backfill-space/12kdata 2024-09-16T04:38:02.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:02.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj20 td/osd-backfill-space/12kdata 2024-09-16T04:38:02.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:02.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj21 td/osd-backfill-space/12kdata 2024-09-16T04:38:03.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:03.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj22 td/osd-backfill-space/12kdata 2024-09-16T04:38:03.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:03.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj23 td/osd-backfill-space/12kdata 2024-09-16T04:38:03.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:03.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj24 td/osd-backfill-space/12kdata 2024-09-16T04:38:03.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:03.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj25 td/osd-backfill-space/12kdata 2024-09-16T04:38:04.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:04.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj26 td/osd-backfill-space/12kdata 2024-09-16T04:38:04.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:04.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj27 td/osd-backfill-space/12kdata 2024-09-16T04:38:04.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:04.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj28 td/osd-backfill-space/12kdata 2024-09-16T04:38:04.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:04.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj29 td/osd-backfill-space/12kdata 2024-09-16T04:38:05.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:05.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj30 td/osd-backfill-space/12kdata 2024-09-16T04:38:05.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:05.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj31 td/osd-backfill-space/12kdata 2024-09-16T04:38:05.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:05.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj32 td/osd-backfill-space/12kdata 2024-09-16T04:38:06.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:06.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj33 td/osd-backfill-space/12kdata 2024-09-16T04:38:06.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:06.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj34 td/osd-backfill-space/12kdata 2024-09-16T04:38:06.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:06.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj35 td/osd-backfill-space/12kdata 2024-09-16T04:38:06.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:06.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj36 td/osd-backfill-space/12kdata 2024-09-16T04:38:07.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:07.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj37 td/osd-backfill-space/12kdata 2024-09-16T04:38:07.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:07.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj38 td/osd-backfill-space/12kdata 2024-09-16T04:38:07.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:07.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj39 td/osd-backfill-space/12kdata 2024-09-16T04:38:07.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:07.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj40 td/osd-backfill-space/12kdata 2024-09-16T04:38:08.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:08.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj41 td/osd-backfill-space/12kdata 2024-09-16T04:38:08.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:08.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj42 td/osd-backfill-space/12kdata 2024-09-16T04:38:08.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:08.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj43 td/osd-backfill-space/12kdata 2024-09-16T04:38:09.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:09.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj44 td/osd-backfill-space/12kdata 2024-09-16T04:38:09.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:09.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj45 td/osd-backfill-space/12kdata 2024-09-16T04:38:09.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:09.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj46 td/osd-backfill-space/12kdata 2024-09-16T04:38:09.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:09.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj47 td/osd-backfill-space/12kdata 2024-09-16T04:38:10.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:10.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj48 td/osd-backfill-space/12kdata 2024-09-16T04:38:10.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:10.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj49 td/osd-backfill-space/12kdata 2024-09-16T04:38:10.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:10.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj50 td/osd-backfill-space/12kdata 2024-09-16T04:38:11.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:11.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj51 td/osd-backfill-space/12kdata 2024-09-16T04:38:11.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:11.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj52 td/osd-backfill-space/12kdata 2024-09-16T04:38:11.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:11.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj53 td/osd-backfill-space/12kdata 2024-09-16T04:38:11.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:11.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj54 td/osd-backfill-space/12kdata 2024-09-16T04:38:12.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:12.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj55 td/osd-backfill-space/12kdata 2024-09-16T04:38:12.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:12.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj56 td/osd-backfill-space/12kdata 2024-09-16T04:38:12.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:12.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj57 td/osd-backfill-space/12kdata 2024-09-16T04:38:12.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:12.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj58 td/osd-backfill-space/12kdata 2024-09-16T04:38:13.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:13.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj59 td/osd-backfill-space/12kdata 2024-09-16T04:38:13.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:13.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj60 td/osd-backfill-space/12kdata 2024-09-16T04:38:13.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:13.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj61 td/osd-backfill-space/12kdata 2024-09-16T04:38:13.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:13.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj62 td/osd-backfill-space/12kdata 2024-09-16T04:38:14.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:14.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj63 td/osd-backfill-space/12kdata 2024-09-16T04:38:14.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:14.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj64 td/osd-backfill-space/12kdata 2024-09-16T04:38:14.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:14.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj65 td/osd-backfill-space/12kdata 2024-09-16T04:38:14.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:14.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj66 td/osd-backfill-space/12kdata 2024-09-16T04:38:15.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:15.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj67 td/osd-backfill-space/12kdata 2024-09-16T04:38:15.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:15.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj68 td/osd-backfill-space/12kdata 2024-09-16T04:38:15.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:15.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj69 td/osd-backfill-space/12kdata 2024-09-16T04:38:16.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:16.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj70 td/osd-backfill-space/12kdata 2024-09-16T04:38:16.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:16.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj71 td/osd-backfill-space/12kdata 2024-09-16T04:38:16.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:16.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj72 td/osd-backfill-space/12kdata 2024-09-16T04:38:16.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:16.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj73 td/osd-backfill-space/12kdata 2024-09-16T04:38:17.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:17.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj74 td/osd-backfill-space/12kdata 2024-09-16T04:38:17.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:17.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj75 td/osd-backfill-space/12kdata 2024-09-16T04:38:17.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:17.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj76 td/osd-backfill-space/12kdata 2024-09-16T04:38:17.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:17.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj77 td/osd-backfill-space/12kdata 2024-09-16T04:38:18.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:18.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj78 td/osd-backfill-space/12kdata 2024-09-16T04:38:18.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:18.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj79 td/osd-backfill-space/12kdata 2024-09-16T04:38:18.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:18.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj80 td/osd-backfill-space/12kdata 2024-09-16T04:38:18.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:18.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj81 td/osd-backfill-space/12kdata 2024-09-16T04:38:19.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:19.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj82 td/osd-backfill-space/12kdata 2024-09-16T04:38:19.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:19.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj83 td/osd-backfill-space/12kdata 2024-09-16T04:38:19.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:19.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj84 td/osd-backfill-space/12kdata 2024-09-16T04:38:20.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:20.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj85 td/osd-backfill-space/12kdata 2024-09-16T04:38:20.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:20.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj86 td/osd-backfill-space/12kdata 2024-09-16T04:38:20.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:20.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj87 td/osd-backfill-space/12kdata 2024-09-16T04:38:20.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:20.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj88 td/osd-backfill-space/12kdata 2024-09-16T04:38:21.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:21.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj89 td/osd-backfill-space/12kdata 2024-09-16T04:38:21.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:21.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj90 td/osd-backfill-space/12kdata 2024-09-16T04:38:21.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:21.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj91 td/osd-backfill-space/12kdata 2024-09-16T04:38:22.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:22.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj92 td/osd-backfill-space/12kdata 2024-09-16T04:38:22.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:22.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj93 td/osd-backfill-space/12kdata 2024-09-16T04:38:22.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:22.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj94 td/osd-backfill-space/12kdata 2024-09-16T04:38:22.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:22.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj95 td/osd-backfill-space/12kdata 2024-09-16T04:38:23.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:23.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj96 td/osd-backfill-space/12kdata 2024-09-16T04:38:23.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:23.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj97 td/osd-backfill-space/12kdata 2024-09-16T04:38:23.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:23.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj98 td/osd-backfill-space/12kdata 2024-09-16T04:38:24.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:24.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj99 td/osd-backfill-space/12kdata 2024-09-16T04:38:24.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:24.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj100 td/osd-backfill-space/12kdata 2024-09-16T04:38:24.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:24.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj101 td/osd-backfill-space/12kdata 2024-09-16T04:38:24.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:24.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj102 td/osd-backfill-space/12kdata 2024-09-16T04:38:25.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:25.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj103 td/osd-backfill-space/12kdata 2024-09-16T04:38:25.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:25.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj104 td/osd-backfill-space/12kdata 2024-09-16T04:38:25.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:25.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj105 td/osd-backfill-space/12kdata 2024-09-16T04:38:25.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:25.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj106 td/osd-backfill-space/12kdata 2024-09-16T04:38:26.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:26.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj107 td/osd-backfill-space/12kdata 2024-09-16T04:38:26.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:26.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj108 td/osd-backfill-space/12kdata 2024-09-16T04:38:26.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:26.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj109 td/osd-backfill-space/12kdata 2024-09-16T04:38:27.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:27.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj110 td/osd-backfill-space/12kdata 2024-09-16T04:38:27.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:27.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj111 td/osd-backfill-space/12kdata 2024-09-16T04:38:27.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:27.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj112 td/osd-backfill-space/12kdata 2024-09-16T04:38:28.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:28.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj113 td/osd-backfill-space/12kdata 2024-09-16T04:38:28.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:28.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj114 td/osd-backfill-space/12kdata 2024-09-16T04:38:28.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:28.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj115 td/osd-backfill-space/12kdata 2024-09-16T04:38:28.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:28.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj116 td/osd-backfill-space/12kdata 2024-09-16T04:38:29.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:29.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj117 td/osd-backfill-space/12kdata 2024-09-16T04:38:29.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:29.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj118 td/osd-backfill-space/12kdata 2024-09-16T04:38:29.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:29.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj119 td/osd-backfill-space/12kdata 2024-09-16T04:38:29.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:29.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj120 td/osd-backfill-space/12kdata 2024-09-16T04:38:30.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:30.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj121 td/osd-backfill-space/12kdata 2024-09-16T04:38:30.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:30.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj122 td/osd-backfill-space/12kdata 2024-09-16T04:38:30.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:30.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj123 td/osd-backfill-space/12kdata 2024-09-16T04:38:30.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:30.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj124 td/osd-backfill-space/12kdata 2024-09-16T04:38:31.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:31.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj125 td/osd-backfill-space/12kdata 2024-09-16T04:38:31.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:31.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj126 td/osd-backfill-space/12kdata 2024-09-16T04:38:31.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:31.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj127 td/osd-backfill-space/12kdata 2024-09-16T04:38:31.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:31.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj128 td/osd-backfill-space/12kdata 2024-09-16T04:38:32.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:32.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj129 td/osd-backfill-space/12kdata 2024-09-16T04:38:32.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:32.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj130 td/osd-backfill-space/12kdata 2024-09-16T04:38:32.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:32.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj131 td/osd-backfill-space/12kdata 2024-09-16T04:38:33.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:33.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj132 td/osd-backfill-space/12kdata 2024-09-16T04:38:33.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:33.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj133 td/osd-backfill-space/12kdata 2024-09-16T04:38:33.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:33.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj134 td/osd-backfill-space/12kdata 2024-09-16T04:38:33.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:33.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj135 td/osd-backfill-space/12kdata 2024-09-16T04:38:34.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:34.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj136 td/osd-backfill-space/12kdata 2024-09-16T04:38:34.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:34.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj137 td/osd-backfill-space/12kdata 2024-09-16T04:38:34.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:34.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj138 td/osd-backfill-space/12kdata 2024-09-16T04:38:35.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:35.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj139 td/osd-backfill-space/12kdata 2024-09-16T04:38:35.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:35.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj140 td/osd-backfill-space/12kdata 2024-09-16T04:38:35.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:35.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj141 td/osd-backfill-space/12kdata 2024-09-16T04:38:35.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:35.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj142 td/osd-backfill-space/12kdata 2024-09-16T04:38:36.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:36.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj143 td/osd-backfill-space/12kdata 2024-09-16T04:38:36.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:36.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj144 td/osd-backfill-space/12kdata 2024-09-16T04:38:36.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:36.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj145 td/osd-backfill-space/12kdata 2024-09-16T04:38:36.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:36.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj146 td/osd-backfill-space/12kdata 2024-09-16T04:38:37.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:37.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj147 td/osd-backfill-space/12kdata 2024-09-16T04:38:37.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:37.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj148 td/osd-backfill-space/12kdata 2024-09-16T04:38:37.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:37.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj149 td/osd-backfill-space/12kdata 2024-09-16T04:38:37.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:37.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj150 td/osd-backfill-space/12kdata 2024-09-16T04:38:38.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:38.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj151 td/osd-backfill-space/12kdata 2024-09-16T04:38:38.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:38.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj152 td/osd-backfill-space/12kdata 2024-09-16T04:38:38.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:38.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj153 td/osd-backfill-space/12kdata 2024-09-16T04:38:38.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:38.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj154 td/osd-backfill-space/12kdata 2024-09-16T04:38:39.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:39.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj155 td/osd-backfill-space/12kdata 2024-09-16T04:38:39.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:39.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj156 td/osd-backfill-space/12kdata 2024-09-16T04:38:39.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:39.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj157 td/osd-backfill-space/12kdata 2024-09-16T04:38:40.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:40.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj158 td/osd-backfill-space/12kdata 2024-09-16T04:38:40.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:40.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj159 td/osd-backfill-space/12kdata 2024-09-16T04:38:40.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:40.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj160 td/osd-backfill-space/12kdata 2024-09-16T04:38:40.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:40.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj161 td/osd-backfill-space/12kdata 2024-09-16T04:38:41.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:41.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj162 td/osd-backfill-space/12kdata 2024-09-16T04:38:41.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:41.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj163 td/osd-backfill-space/12kdata 2024-09-16T04:38:41.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:41.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj164 td/osd-backfill-space/12kdata 2024-09-16T04:38:42.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:42.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj165 td/osd-backfill-space/12kdata 2024-09-16T04:38:42.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:42.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj166 td/osd-backfill-space/12kdata 2024-09-16T04:38:42.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:42.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj167 td/osd-backfill-space/12kdata 2024-09-16T04:38:42.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:42.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj168 td/osd-backfill-space/12kdata 2024-09-16T04:38:43.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:43.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj169 td/osd-backfill-space/12kdata 2024-09-16T04:38:43.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:43.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj170 td/osd-backfill-space/12kdata 2024-09-16T04:38:43.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:43.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj171 td/osd-backfill-space/12kdata 2024-09-16T04:38:43.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:43.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj172 td/osd-backfill-space/12kdata 2024-09-16T04:38:44.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:44.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj173 td/osd-backfill-space/12kdata 2024-09-16T04:38:44.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:44.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj174 td/osd-backfill-space/12kdata 2024-09-16T04:38:44.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:44.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj175 td/osd-backfill-space/12kdata 2024-09-16T04:38:44.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:44.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj176 td/osd-backfill-space/12kdata 2024-09-16T04:38:45.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:45.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj177 td/osd-backfill-space/12kdata 2024-09-16T04:38:45.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:45.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj178 td/osd-backfill-space/12kdata 2024-09-16T04:38:45.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:45.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj179 td/osd-backfill-space/12kdata 2024-09-16T04:38:45.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:45.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj180 td/osd-backfill-space/12kdata 2024-09-16T04:38:46.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:46.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj181 td/osd-backfill-space/12kdata 2024-09-16T04:38:46.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:46.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj182 td/osd-backfill-space/12kdata 2024-09-16T04:38:46.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:46.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj183 td/osd-backfill-space/12kdata 2024-09-16T04:38:46.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:46.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj184 td/osd-backfill-space/12kdata 2024-09-16T04:38:47.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:47.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj185 td/osd-backfill-space/12kdata 2024-09-16T04:38:47.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:47.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj186 td/osd-backfill-space/12kdata 2024-09-16T04:38:47.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:47.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj187 td/osd-backfill-space/12kdata 2024-09-16T04:38:48.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:48.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj188 td/osd-backfill-space/12kdata 2024-09-16T04:38:48.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:48.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj189 td/osd-backfill-space/12kdata 2024-09-16T04:38:48.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:48.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj190 td/osd-backfill-space/12kdata 2024-09-16T04:38:48.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:48.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj191 td/osd-backfill-space/12kdata 2024-09-16T04:38:49.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:49.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj192 td/osd-backfill-space/12kdata 2024-09-16T04:38:49.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:49.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj193 td/osd-backfill-space/12kdata 2024-09-16T04:38:49.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:49.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj194 td/osd-backfill-space/12kdata 2024-09-16T04:38:49.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:49.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj195 td/osd-backfill-space/12kdata 2024-09-16T04:38:50.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:50.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj196 td/osd-backfill-space/12kdata 2024-09-16T04:38:50.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:50.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj197 td/osd-backfill-space/12kdata 2024-09-16T04:38:50.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:50.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj198 td/osd-backfill-space/12kdata 2024-09-16T04:38:51.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:51.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj199 td/osd-backfill-space/12kdata 2024-09-16T04:38:51.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1135: TEST_ec_backfill_grow: for i in $(seq 1 $ecobjects) 2024-09-16T04:38:51.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1137: TEST_ec_backfill_grow: rados -p test put obj200 td/osd-backfill-space/12kdata 2024-09-16T04:38:51.526 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1140: TEST_ec_backfill_grow: get_pg test obj1 2024-09-16T04:38:51.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T04:38:51.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T04:38:51.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T04:38:51.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T04:38:51.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1140: TEST_ec_backfill_grow: local PG=1.0 2024-09-16T04:38:51.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1142: TEST_ec_backfill_grow: get_primary test obj1 2024-09-16T04:38:51.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T04:38:51.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T04:38:51.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T04:38:51.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T04:38:52.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1142: TEST_ec_backfill_grow: local primary=1 2024-09-16T04:38:52.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1143: TEST_ec_backfill_grow: get_not_primary test obj1 2024-09-16T04:38:52.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2024-09-16T04:38:52.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2024-09-16T04:38:52.423 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2024-09-16T04:38:52.423 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T04:38:52.423 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T04:38:52.423 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T04:38:52.424 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T04:38:52.916 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2024-09-16T04:38:52.916 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2024-09-16T04:38:52.916 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-09-16T04:38:53.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1143: TEST_ec_backfill_grow: local otherosd=0 2024-09-16T04:38:53.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1145: TEST_ec_backfill_grow: ceph osd set noout 2024-09-16T04:38:54.007 INFO:tasks.workunit.client.0.smithi026.stderr:noout is set 2024-09-16T04:38:54.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1146: TEST_ec_backfill_grow: kill_daemons td/osd-backfill-space TERM 0 2024-09-16T04:38:54.020 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:38:54.020 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:38:54.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:38:54.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:38:54.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:38:54.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:38:54.327 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: expr 200 / 4 2024-09-16T04:38:54.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1148: TEST_ec_backfill_grow: rmobjects=50 2024-09-16T04:38:54.328 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: seq 1 50 2024-09-16T04:38:54.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:54.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj1 2024-09-16T04:38:55.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:55.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj2 2024-09-16T04:38:55.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:55.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj3 2024-09-16T04:38:55.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:55.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj4 2024-09-16T04:38:56.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:56.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj5 2024-09-16T04:38:56.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:56.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj6 2024-09-16T04:38:56.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:56.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj7 2024-09-16T04:38:56.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:56.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj8 2024-09-16T04:38:57.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:57.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj9 2024-09-16T04:38:57.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:57.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj10 2024-09-16T04:38:57.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:57.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj11 2024-09-16T04:38:57.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:57.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj12 2024-09-16T04:38:58.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:58.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj13 2024-09-16T04:38:58.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:58.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj14 2024-09-16T04:38:58.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:58.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj15 2024-09-16T04:38:58.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:58.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj16 2024-09-16T04:38:58.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:58.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj17 2024-09-16T04:38:59.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:59.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj18 2024-09-16T04:38:59.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:59.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj19 2024-09-16T04:38:59.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:59.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj20 2024-09-16T04:38:59.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:38:59.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj21 2024-09-16T04:39:00.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:00.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj22 2024-09-16T04:39:00.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj23 2024-09-16T04:39:00.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:00.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj24 2024-09-16T04:39:00.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:00.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj25 2024-09-16T04:39:00.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:00.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj26 2024-09-16T04:39:01.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:01.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj27 2024-09-16T04:39:01.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:01.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj28 2024-09-16T04:39:01.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:01.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj29 2024-09-16T04:39:01.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:01.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj30 2024-09-16T04:39:02.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:02.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj31 2024-09-16T04:39:02.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:02.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj32 2024-09-16T04:39:02.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:02.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj33 2024-09-16T04:39:02.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:02.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj34 2024-09-16T04:39:03.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:03.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj35 2024-09-16T04:39:03.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:03.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj36 2024-09-16T04:39:03.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:03.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj37 2024-09-16T04:39:03.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:03.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj38 2024-09-16T04:39:03.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:03.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj39 2024-09-16T04:39:04.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:04.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj40 2024-09-16T04:39:04.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:04.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj41 2024-09-16T04:39:04.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:04.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj42 2024-09-16T04:39:04.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:04.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj43 2024-09-16T04:39:05.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:05.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj44 2024-09-16T04:39:05.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:05.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj45 2024-09-16T04:39:05.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:05.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj46 2024-09-16T04:39:05.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:05.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj47 2024-09-16T04:39:05.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:05.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj48 2024-09-16T04:39:06.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:06.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj49 2024-09-16T04:39:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1149: TEST_ec_backfill_grow: for i in $(seq 1 $rmobjects) 2024-09-16T04:39:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1151: TEST_ec_backfill_grow: rados -p test rm obj50 2024-09-16T04:39:06.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1154: TEST_ec_backfill_grow: dd if=/dev/urandom of=td/osd-backfill-space/36kdata bs=1k count=36 2024-09-16T04:39:06.678 INFO:tasks.workunit.client.0.smithi026.stderr:36+0 records in 2024-09-16T04:39:06.678 INFO:tasks.workunit.client.0.smithi026.stderr:36+0 records out 2024-09-16T04:39:06.678 INFO:tasks.workunit.client.0.smithi026.stderr:36864 bytes (37 kB, 36 KiB) copied, 0.000229577 s, 161 MB/s 2024-09-16T04:39:06.679 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: expr 50 + 1 2024-09-16T04:39:06.680 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: seq 51 200 2024-09-16T04:39:06.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:06.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj51 td/osd-backfill-space/36kdata 2024-09-16T04:39:06.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:06.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj52 td/osd-backfill-space/36kdata 2024-09-16T04:39:07.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:07.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj53 td/osd-backfill-space/36kdata 2024-09-16T04:39:07.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:07.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj54 td/osd-backfill-space/36kdata 2024-09-16T04:39:07.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:07.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj55 td/osd-backfill-space/36kdata 2024-09-16T04:39:07.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:07.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj56 td/osd-backfill-space/36kdata 2024-09-16T04:39:08.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:08.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj57 td/osd-backfill-space/36kdata 2024-09-16T04:39:08.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:08.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj58 td/osd-backfill-space/36kdata 2024-09-16T04:39:08.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:08.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj59 td/osd-backfill-space/36kdata 2024-09-16T04:39:09.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:09.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj60 td/osd-backfill-space/36kdata 2024-09-16T04:39:09.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:09.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj61 td/osd-backfill-space/36kdata 2024-09-16T04:39:09.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:09.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj62 td/osd-backfill-space/36kdata 2024-09-16T04:39:09.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:09.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj63 td/osd-backfill-space/36kdata 2024-09-16T04:39:10.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:10.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj64 td/osd-backfill-space/36kdata 2024-09-16T04:39:10.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:10.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj65 td/osd-backfill-space/36kdata 2024-09-16T04:39:10.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:10.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj66 td/osd-backfill-space/36kdata 2024-09-16T04:39:10.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:10.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj67 td/osd-backfill-space/36kdata 2024-09-16T04:39:11.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:11.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj68 td/osd-backfill-space/36kdata 2024-09-16T04:39:11.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:11.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj69 td/osd-backfill-space/36kdata 2024-09-16T04:39:11.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:11.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj70 td/osd-backfill-space/36kdata 2024-09-16T04:39:11.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:11.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj71 td/osd-backfill-space/36kdata 2024-09-16T04:39:12.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:12.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj72 td/osd-backfill-space/36kdata 2024-09-16T04:39:12.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:12.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj73 td/osd-backfill-space/36kdata 2024-09-16T04:39:12.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:12.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj74 td/osd-backfill-space/36kdata 2024-09-16T04:39:13.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:13.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj75 td/osd-backfill-space/36kdata 2024-09-16T04:39:13.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:13.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj76 td/osd-backfill-space/36kdata 2024-09-16T04:39:13.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:13.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj77 td/osd-backfill-space/36kdata 2024-09-16T04:39:13.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:13.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj78 td/osd-backfill-space/36kdata 2024-09-16T04:39:14.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:14.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj79 td/osd-backfill-space/36kdata 2024-09-16T04:39:14.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:14.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj80 td/osd-backfill-space/36kdata 2024-09-16T04:39:14.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:14.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj81 td/osd-backfill-space/36kdata 2024-09-16T04:39:14.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:14.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj82 td/osd-backfill-space/36kdata 2024-09-16T04:39:15.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:15.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj83 td/osd-backfill-space/36kdata 2024-09-16T04:39:15.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:15.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj84 td/osd-backfill-space/36kdata 2024-09-16T04:39:15.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:15.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj85 td/osd-backfill-space/36kdata 2024-09-16T04:39:15.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:15.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj86 td/osd-backfill-space/36kdata 2024-09-16T04:39:16.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:16.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj87 td/osd-backfill-space/36kdata 2024-09-16T04:39:16.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:16.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj88 td/osd-backfill-space/36kdata 2024-09-16T04:39:16.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:16.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj89 td/osd-backfill-space/36kdata 2024-09-16T04:39:16.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:16.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj90 td/osd-backfill-space/36kdata 2024-09-16T04:39:17.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:17.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj91 td/osd-backfill-space/36kdata 2024-09-16T04:39:17.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:17.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj92 td/osd-backfill-space/36kdata 2024-09-16T04:39:17.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:17.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj93 td/osd-backfill-space/36kdata 2024-09-16T04:39:17.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:17.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj94 td/osd-backfill-space/36kdata 2024-09-16T04:39:18.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:18.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj95 td/osd-backfill-space/36kdata 2024-09-16T04:39:18.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:18.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj96 td/osd-backfill-space/36kdata 2024-09-16T04:39:18.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:18.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj97 td/osd-backfill-space/36kdata 2024-09-16T04:39:19.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:19.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj98 td/osd-backfill-space/36kdata 2024-09-16T04:39:19.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:19.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj99 td/osd-backfill-space/36kdata 2024-09-16T04:39:19.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:19.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj100 td/osd-backfill-space/36kdata 2024-09-16T04:39:19.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:19.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj101 td/osd-backfill-space/36kdata 2024-09-16T04:39:20.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:20.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj102 td/osd-backfill-space/36kdata 2024-09-16T04:39:20.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:20.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj103 td/osd-backfill-space/36kdata 2024-09-16T04:39:20.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:20.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj104 td/osd-backfill-space/36kdata 2024-09-16T04:39:20.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:20.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj105 td/osd-backfill-space/36kdata 2024-09-16T04:39:21.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:21.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj106 td/osd-backfill-space/36kdata 2024-09-16T04:39:21.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:21.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj107 td/osd-backfill-space/36kdata 2024-09-16T04:39:21.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:21.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj108 td/osd-backfill-space/36kdata 2024-09-16T04:39:21.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:21.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj109 td/osd-backfill-space/36kdata 2024-09-16T04:39:21.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:21.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj110 td/osd-backfill-space/36kdata 2024-09-16T04:39:22.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:22.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj111 td/osd-backfill-space/36kdata 2024-09-16T04:39:22.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:22.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj112 td/osd-backfill-space/36kdata 2024-09-16T04:39:22.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:22.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj113 td/osd-backfill-space/36kdata 2024-09-16T04:39:22.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:22.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj114 td/osd-backfill-space/36kdata 2024-09-16T04:39:23.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:23.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj115 td/osd-backfill-space/36kdata 2024-09-16T04:39:23.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:23.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj116 td/osd-backfill-space/36kdata 2024-09-16T04:39:23.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:23.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj117 td/osd-backfill-space/36kdata 2024-09-16T04:39:24.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:24.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj118 td/osd-backfill-space/36kdata 2024-09-16T04:39:24.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:24.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj119 td/osd-backfill-space/36kdata 2024-09-16T04:39:24.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:24.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj120 td/osd-backfill-space/36kdata 2024-09-16T04:39:24.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:24.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj121 td/osd-backfill-space/36kdata 2024-09-16T04:39:25.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:25.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj122 td/osd-backfill-space/36kdata 2024-09-16T04:39:25.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:25.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj123 td/osd-backfill-space/36kdata 2024-09-16T04:39:25.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:25.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj124 td/osd-backfill-space/36kdata 2024-09-16T04:39:25.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:25.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj125 td/osd-backfill-space/36kdata 2024-09-16T04:39:26.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:26.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj126 td/osd-backfill-space/36kdata 2024-09-16T04:39:26.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:26.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj127 td/osd-backfill-space/36kdata 2024-09-16T04:39:26.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:26.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj128 td/osd-backfill-space/36kdata 2024-09-16T04:39:26.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:26.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj129 td/osd-backfill-space/36kdata 2024-09-16T04:39:27.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:27.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj130 td/osd-backfill-space/36kdata 2024-09-16T04:39:27.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:27.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj131 td/osd-backfill-space/36kdata 2024-09-16T04:39:27.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:27.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj132 td/osd-backfill-space/36kdata 2024-09-16T04:39:27.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:27.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj133 td/osd-backfill-space/36kdata 2024-09-16T04:39:28.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:28.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj134 td/osd-backfill-space/36kdata 2024-09-16T04:39:28.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:28.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj135 td/osd-backfill-space/36kdata 2024-09-16T04:39:28.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:28.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj136 td/osd-backfill-space/36kdata 2024-09-16T04:39:28.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:28.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj137 td/osd-backfill-space/36kdata 2024-09-16T04:39:29.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:29.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj138 td/osd-backfill-space/36kdata 2024-09-16T04:39:29.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:29.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj139 td/osd-backfill-space/36kdata 2024-09-16T04:39:29.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:29.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj140 td/osd-backfill-space/36kdata 2024-09-16T04:39:29.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:29.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj141 td/osd-backfill-space/36kdata 2024-09-16T04:39:29.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:29.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj142 td/osd-backfill-space/36kdata 2024-09-16T04:39:30.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:30.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj143 td/osd-backfill-space/36kdata 2024-09-16T04:39:30.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:30.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj144 td/osd-backfill-space/36kdata 2024-09-16T04:39:30.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:30.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj145 td/osd-backfill-space/36kdata 2024-09-16T04:39:30.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:30.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj146 td/osd-backfill-space/36kdata 2024-09-16T04:39:30.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:30.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj147 td/osd-backfill-space/36kdata 2024-09-16T04:39:31.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:31.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj148 td/osd-backfill-space/36kdata 2024-09-16T04:39:31.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:31.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj149 td/osd-backfill-space/36kdata 2024-09-16T04:39:31.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:31.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj150 td/osd-backfill-space/36kdata 2024-09-16T04:39:31.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:31.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj151 td/osd-backfill-space/36kdata 2024-09-16T04:39:31.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:31.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj152 td/osd-backfill-space/36kdata 2024-09-16T04:39:31.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:31.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj153 td/osd-backfill-space/36kdata 2024-09-16T04:39:32.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:32.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj154 td/osd-backfill-space/36kdata 2024-09-16T04:39:32.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:32.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj155 td/osd-backfill-space/36kdata 2024-09-16T04:39:32.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:32.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj156 td/osd-backfill-space/36kdata 2024-09-16T04:39:32.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:32.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj157 td/osd-backfill-space/36kdata 2024-09-16T04:39:32.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:32.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj158 td/osd-backfill-space/36kdata 2024-09-16T04:39:32.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:32.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj159 td/osd-backfill-space/36kdata 2024-09-16T04:39:33.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:33.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj160 td/osd-backfill-space/36kdata 2024-09-16T04:39:33.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:33.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj161 td/osd-backfill-space/36kdata 2024-09-16T04:39:33.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:33.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj162 td/osd-backfill-space/36kdata 2024-09-16T04:39:33.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:33.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj163 td/osd-backfill-space/36kdata 2024-09-16T04:39:33.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:33.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj164 td/osd-backfill-space/36kdata 2024-09-16T04:39:34.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:34.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj165 td/osd-backfill-space/36kdata 2024-09-16T04:39:34.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:34.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj166 td/osd-backfill-space/36kdata 2024-09-16T04:39:34.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:34.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj167 td/osd-backfill-space/36kdata 2024-09-16T04:39:34.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:34.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj168 td/osd-backfill-space/36kdata 2024-09-16T04:39:34.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:34.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj169 td/osd-backfill-space/36kdata 2024-09-16T04:39:35.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:35.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj170 td/osd-backfill-space/36kdata 2024-09-16T04:39:35.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:35.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj171 td/osd-backfill-space/36kdata 2024-09-16T04:39:35.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:35.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj172 td/osd-backfill-space/36kdata 2024-09-16T04:39:35.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:35.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj173 td/osd-backfill-space/36kdata 2024-09-16T04:39:35.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:35.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj174 td/osd-backfill-space/36kdata 2024-09-16T04:39:35.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:35.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj175 td/osd-backfill-space/36kdata 2024-09-16T04:39:36.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:36.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj176 td/osd-backfill-space/36kdata 2024-09-16T04:39:36.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:36.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj177 td/osd-backfill-space/36kdata 2024-09-16T04:39:36.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:36.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj178 td/osd-backfill-space/36kdata 2024-09-16T04:39:36.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:36.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj179 td/osd-backfill-space/36kdata 2024-09-16T04:39:36.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:36.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj180 td/osd-backfill-space/36kdata 2024-09-16T04:39:37.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:37.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj181 td/osd-backfill-space/36kdata 2024-09-16T04:39:37.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:37.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj182 td/osd-backfill-space/36kdata 2024-09-16T04:39:37.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:37.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj183 td/osd-backfill-space/36kdata 2024-09-16T04:39:37.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:37.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj184 td/osd-backfill-space/36kdata 2024-09-16T04:39:37.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:37.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj185 td/osd-backfill-space/36kdata 2024-09-16T04:39:37.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:37.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj186 td/osd-backfill-space/36kdata 2024-09-16T04:39:38.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:38.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj187 td/osd-backfill-space/36kdata 2024-09-16T04:39:38.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:38.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj188 td/osd-backfill-space/36kdata 2024-09-16T04:39:38.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:38.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj189 td/osd-backfill-space/36kdata 2024-09-16T04:39:38.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:38.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj190 td/osd-backfill-space/36kdata 2024-09-16T04:39:38.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:38.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj191 td/osd-backfill-space/36kdata 2024-09-16T04:39:38.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:38.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj192 td/osd-backfill-space/36kdata 2024-09-16T04:39:39.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:39.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj193 td/osd-backfill-space/36kdata 2024-09-16T04:39:39.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:39.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj194 td/osd-backfill-space/36kdata 2024-09-16T04:39:39.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:39.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj195 td/osd-backfill-space/36kdata 2024-09-16T04:39:39.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:39.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj196 td/osd-backfill-space/36kdata 2024-09-16T04:39:39.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:39.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj197 td/osd-backfill-space/36kdata 2024-09-16T04:39:39.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:39.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj198 td/osd-backfill-space/36kdata 2024-09-16T04:39:39.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:39.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj199 td/osd-backfill-space/36kdata 2024-09-16T04:39:40.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1155: TEST_ec_backfill_grow: for i in $(seq $(expr $rmobjects + 1) $ecobjects) 2024-09-16T04:39:40.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1157: TEST_ec_backfill_grow: rados -p test put obj200 td/osd-backfill-space/36kdata 2024-09-16T04:39:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1160: TEST_ec_backfill_grow: activate_osd td/osd-backfill-space 0 2024-09-16T04:39:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-backfill-space 2024-09-16T04:39:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T04:39:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2024-09-16T04:39:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T04:39:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-backfill-space/0 2024-09-16T04:39:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:39:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:39:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:39:40.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:39:40.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:39:40.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:39:40.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:39:40.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:39:40.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:39:40.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:39:40.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:39:40.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T04:39:40.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T04:39:40.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-backfill-space/0 2024-09-16T04:39:40.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2024-09-16T04:39:40.279 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T04:39:40.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:39:40.280 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-backfill-space/0/whoami 2024-09-16T04:39:40.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2024-09-16T04:39:40.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T04:39:40.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T04:39:40.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T04:39:40.310 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:39:40.309+0000 7fcab421b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:39:40.312 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:39:40.311+0000 7fcab421b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:39:40.313 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:39:40.312+0000 7fcab421b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:39:40.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2024-09-16T04:39:40.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:39:40.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:39:40.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:39:40.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:39:40.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:39:40.722 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:39:40.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:39:40.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:39:40.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:39:41.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:39:41.421 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:39:41.420+0000 7fcab421b640 -1 Falling back to public interface 2024-09-16T04:39:42.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:39:42.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:39:42.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:39:42.180 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:39:42.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:39:42.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:39:42.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:39:43.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:39:43.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:39:43.642 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:39:43.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:39:43.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:39:43.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:39:44.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:39:44.601 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:39:44.600+0000 7fcab421b640 -1 osd.0 39 log_to_monitors true 2024-09-16T04:39:45.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:39:45.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:39:45.057 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:39:45.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:39:45.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:39:45.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:39:45.687 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 45 up_thru 0 down_at 42 last_clean_interval [5,39) [v2:127.0.0.1:6802/2990259823,v1:127.0.0.1:6803/2990259823] [v2:127.0.0.1:6804/2990259823,v1:127.0.0.1:6805/2990259823] exists,up 5c3e8621-3489-49f4-a7f7-548aa3a1141a 2024-09-16T04:39:45.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:39:45.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:39:45.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:39:45.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1162: TEST_ec_backfill_grow: ceph tell osd.1 debug kick_recovery_wq 0 2024-09-16T04:39:45.816 INFO:tasks.workunit.client.0.smithi026.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-09-16T04:39:45.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1164: TEST_ec_backfill_grow: sleep 2 2024-09-16T04:39:47.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1166: TEST_ec_backfill_grow: wait_for_clean 2024-09-16T04:39:47.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T04:39:47.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T04:39:47.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T04:39:47.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T04:39:47.829 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:39:47.829 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:39:47.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:39:47.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:39:47.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:39:47.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T04:39:47.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T04:39:47.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T04:39:47.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T04:39:47.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:39:47.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:39:48.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:39:48.347 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:39:48.347 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:39:48.348 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:39:48.348 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T04:39:48.348 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T04:39:48.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:39:48.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:39:48.348 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:39:48.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=193273528323 2024-09-16T04:39:48.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 193273528323 2024-09-16T04:39:48.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-193273528323' 2024-09-16T04:39:48.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:39:48.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:39:48.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673020 2024-09-16T04:39:48.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673020 2024-09-16T04:39:48.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-193273528323 1-42949673020' 2024-09-16T04:39:48.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:39:48.662 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:39:48.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509492 2024-09-16T04:39:48.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509492 2024-09-16T04:39:48.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-193273528323 1-42949673020 2-64424509492' 2024-09-16T04:39:48.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:39:48.790 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:39:48.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345969 2024-09-16T04:39:48.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345969 2024-09-16T04:39:48.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-193273528323 1-42949673020 2-64424509492 3-85899345969' 2024-09-16T04:39:48.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:39:48.910 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:39:49.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182447 2024-09-16T04:39:49.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182447 2024-09-16T04:39:49.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-193273528323 1-42949673020 2-64424509492 3-85899345969 4-107374182447' 2024-09-16T04:39:49.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:39:49.035 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T04:39:49.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018913 2024-09-16T04:39:49.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018913 2024-09-16T04:39:49.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-193273528323 1-42949673020 2-64424509492 3-85899345969 4-107374182447 5-128849018913' 2024-09-16T04:39:49.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:39:49.173 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-193273528323 2024-09-16T04:39:49.173 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:39:49.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:39:49.174 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-193273528323 2024-09-16T04:39:49.174 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:39:49.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=193273528323 2024-09-16T04:39:49.175 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 193273528323 2024-09-16T04:39:49.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 193273528323' 2024-09-16T04:39:49.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:39:49.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 193273528323 -lt 193273528323 2024-09-16T04:39:49.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:39:49.584 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673020 2024-09-16T04:39:49.584 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:39:49.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:39:49.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673020 2024-09-16T04:39:49.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:39:49.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673020 2024-09-16T04:39:49.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673020' 2024-09-16T04:39:49.587 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673020 2024-09-16T04:39:49.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:39:50.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673020 -lt 42949673020 2024-09-16T04:39:50.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:39:50.054 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509492 2024-09-16T04:39:50.055 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:39:50.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:39:50.055 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509492 2024-09-16T04:39:50.055 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:39:50.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509492 2024-09-16T04:39:50.056 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509492 2024-09-16T04:39:50.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509492' 2024-09-16T04:39:50.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:39:50.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509492 -lt 64424509492 2024-09-16T04:39:50.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:39:50.523 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345969 2024-09-16T04:39:50.523 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:39:50.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:39:50.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345969 2024-09-16T04:39:50.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:39:50.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345969 2024-09-16T04:39:50.525 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345969 2024-09-16T04:39:50.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345969' 2024-09-16T04:39:50.526 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:39:50.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345969 -lt 85899345969 2024-09-16T04:39:50.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:39:50.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182447 2024-09-16T04:39:50.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:39:50.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:39:50.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182447 2024-09-16T04:39:50.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:39:50.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182447 2024-09-16T04:39:50.940 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182447 2024-09-16T04:39:50.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182447' 2024-09-16T04:39:50.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:39:51.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182447 -lt 107374182447 2024-09-16T04:39:51.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:39:51.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018913 2024-09-16T04:39:51.388 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:39:51.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T04:39:51.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018913 2024-09-16T04:39:51.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:39:51.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018913 2024-09-16T04:39:51.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018913' 2024-09-16T04:39:51.391 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018913 2024-09-16T04:39:51.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T04:39:51.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018913 -lt 128849018913 2024-09-16T04:39:51.804 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T04:39:51.804 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:39:51.804 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:39:52.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T04:39:52.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:39:52.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:39:52.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:39:52.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:39:52.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:39:52.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:39:52.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:39:52.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:39:52.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:39:52.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:39:52.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:39:53.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:39:53.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T04:39:53.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T04:39:53.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T04:39:53.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:39:53.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:39:53.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:39:53.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:39:53.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:39:53.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:39:53.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:39:53.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:39:53.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:39:53.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:39:53.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:39:53.899 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:39:53.899 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:39:53.899 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:39:54.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:39:54.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:39:54.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:39:54.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:39:54.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:39:54.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:39:54.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:39:54.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:39:54.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:39:55.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=228028 2024-09-16T04:39:55.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 228028 '!=' null 2024-09-16T04:39:55.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:39:55.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:39:55.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:39:55.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:39:55.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:39:55.418 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:39:55.418 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:39:55.418 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:39:55.418 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:39:55.418 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:39:55.418 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:39:55.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:39:55.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:39:55.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:39:55.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:39:56.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:39:56.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:39:56.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:39:56.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:39:56.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:39:56.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:39:56.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:39:56.407 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:39:56.407 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:39:57.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=186428 2024-09-16T04:39:57.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 186428 '!=' null 2024-09-16T04:39:57.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:39:57.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:39:57.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:39:57.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:39:57.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:39:57.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:39:57.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:39:57.154 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:39:57.154 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:39:57.154 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:39:57.154 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:39:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:39:57.561 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:39:57.562 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:39:57.562 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:39:58.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:39:58.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:39:58.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:39:58.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:39:58.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:39:58.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:39:58.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:39:58.141 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:39:58.141 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:39:58.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=312701 2024-09-16T04:39:58.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 312701 '!=' null 2024-09-16T04:39:58.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:39:58.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:39:58.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:39:58.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:39:58.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:39:58.820 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:39:58.820 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:39:58.820 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:39:58.820 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:39:58.820 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:39:58.820 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:39:59.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:39:59.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:39:59.229 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:39:59.229 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:39:59.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:39:59.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:39:59.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:39:59.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:39:59.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:39:59.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:39:59.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:39:59.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:39:59.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:40:00.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=285655 2024-09-16T04:40:00.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 285655 '!=' null 2024-09-16T04:40:00.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:40:00.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:40:00.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:40:00.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:40:00.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:40:00.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:40:00.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:40:00.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:40:00.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:40:00.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:40:00.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:40:00.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:40:00.967 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:40:00.967 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:40:00.967 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:40:01.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:40:01.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:40:01.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:40:01.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:40:01.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:40:01.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:40:01.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:40:01.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:40:01.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:40:02.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=359375 2024-09-16T04:40:02.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 359375 '!=' null 2024-09-16T04:40:02.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:40:02.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:40:02.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:40:02.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:40:02.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:40:02.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:40:02.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:40:02.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:40:02.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:40:02.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:40:02.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:40:02.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:40:02.763 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:40:02.763 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:40:02.763 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:40:03.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:40:03.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:40:03.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:40:03.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:40:03.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:40:03.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:40:03.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:40:03.320 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:40:03.320 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:40:03.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=433098 2024-09-16T04:40:03.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 433098 '!=' null 2024-09-16T04:40:03.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:40:03.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:40:03.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:40:04.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:40:04.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:40:04.004 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:40:04.004 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:40:04.004 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:40:04.004 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:40:04.004 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:40:04.004 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:40:04.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:40:04.408 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:40:04.408 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:40:04.408 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:40:04.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:40:04.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:40:04.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:40:04.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:40:04.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:40:04.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:40:04.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:40:04.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:40:04.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:40:05.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=225763 2024-09-16T04:40:05.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 225763 '!=' null 2024-09-16T04:40:05.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:40:05.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:40:05.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:40:05.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:40:05.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:40:05.635 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:40:05.635 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:40:05.635 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:40:05.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:40:05.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:40:05.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:40:06.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:40:06.036 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:40:06.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:40:06.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:40:06.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:40:06.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:40:06.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:40:06.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:40:06.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:40:06.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:40:06.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:40:06.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:40:06.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:40:07.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=225763 2024-09-16T04:40:07.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 225763 '!=' null 2024-09-16T04:40:07.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:40:07.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:40:07.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:40:07.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:40:07.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:40:07.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:40:07.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:40:07.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:40:07.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:40:07.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:40:07.269 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:40:07.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T04:40:07.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:40:07.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:40:07.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:40:08.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T04:40:08.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T04:40:08.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T04:40:08.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1168: TEST_ec_backfill_grow: delete_pool test 2024-09-16T04:40:08.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T04:40:08.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T04:40:08.920 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T04:40:08.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:1169: TEST_ec_backfill_grow: kill_daemons td/osd-backfill-space 2024-09-16T04:40:08.932 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:40:08.932 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:40:08.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:40:08.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:40:08.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:40:14.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:40:14.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-09-16T04:40:14.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:40:14.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:40:14.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:40:14.250 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:40:14.250 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:40:14.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:40:14.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:40:14.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:40:14.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:40:14.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:40:14.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:40:14.260 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:40:14.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:40:14.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:40:14.262 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:40:14.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:40:14.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:40:14.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:40:14.264 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:40:14.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:40:14.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:40:14.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:40:14.321 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:40:14.321 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:40:14.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:40:14.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:40:14.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:40:14.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:40:14.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-09-16T04:40:14.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-09-16T04:40:14.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-space 2024-09-16T04:40:14.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-space 2024-09-16T04:40:14.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:40:14.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:40:14.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:40:14.325 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:40:14.325 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:40:14.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:40:14.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:40:14.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:40:14.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:40:14.326 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:40:14.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:40:14.327 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:40:14.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:40:14.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:40:14.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:40:14.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:40:14.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:40:14.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:40:14.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:40:14.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:40:14.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:40:14.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:40:14.333 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:40:14.333 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:40:14.333 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:40:14.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:40:14.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:40:14.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:40:14.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-space 2024-09-16T04:40:14.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:40:14.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:40:14.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:40:14.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.114688 2024-09-16T04:40:14.339 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:40:14.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:40:14.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:40:14.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-09-16T04:40:14.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_ec_backfill_multi td/osd-backfill-space 2024-09-16T04:40:14.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:749: TEST_ec_backfill_multi: local dir=td/osd-backfill-space 2024-09-16T04:40:14.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:750: TEST_ec_backfill_multi: local EC= 2024-09-16T04:40:14.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:751: TEST_ec_backfill_multi: local pools=2 2024-09-16T04:40:14.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:752: TEST_ec_backfill_multi: local OSDS=6 2024-09-16T04:40:14.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:753: TEST_ec_backfill_multi: local k=3 2024-09-16T04:40:14.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:754: TEST_ec_backfill_multi: local m=2 2024-09-16T04:40:14.339 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:755: TEST_ec_backfill_multi: expr 600 / 3 2024-09-16T04:40:14.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:755: TEST_ec_backfill_multi: local ecobjects=200 2024-09-16T04:40:14.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:757: TEST_ec_backfill_multi: run_mon td/osd-backfill-space a 2024-09-16T04:40:14.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-space 2024-09-16T04:40:14.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:40:14.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:40:14.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:40:14.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-space/a 2024-09-16T04:40:14.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-09-16T04:40:14.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:40:14.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:40:14.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:40:14.853 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:40:14.853 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:40:14.853 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:40:14.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:40:14.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:40:15.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:40:15.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:40:15.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:40:15.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:40:15.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:40:15.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:40:15.065 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:40:15.065 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:40:15.066 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:40:15.066 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:40:15.066 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:40:15.066 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:40:15.066 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T04:40:15.067 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:40:15.067 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get fsid 2024-09-16T04:40:15.156 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:40:15.156 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:40:15.156 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:40:15.156 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:40:15.156 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:40:15.156 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:40:15.156 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:40:15.156 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:40:15.157 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:40:15.157 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:40:15.157 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:40:15.158 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T04:40:15.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:40:15.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get mon_host 2024-09-16T04:40:15.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:758: TEST_ec_backfill_multi: run_mgr td/osd-backfill-space x 2024-09-16T04:40:15.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-space 2024-09-16T04:40:15.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:40:15.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:40:15.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:40:15.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-space/x 2024-09-16T04:40:15.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:40:16.103 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:40:16.103 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:40:16.103 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:40:16.103 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:40:16.103 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:40:16.103 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:40:16.103 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:40:16.103 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:40:16.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:40:16.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:759: TEST_ec_backfill_multi: export CEPH_ARGS 2024-09-16T04:40:16.137 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: expr 6 - 1 2024-09-16T04:40:16.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: seq 0 5 2024-09-16T04:40:16.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:40:16.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:763: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 0 2024-09-16T04:40:16.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/0 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:40:16.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:40:16.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:40:16.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:40:16.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:40:16.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:40:16.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:40:16.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:40:16.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:40:16.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/0 2024-09-16T04:40:16.145 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:40:16.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e7ce33ea-17ba-4f19-ae79-40b875e5f7a9 2024-09-16T04:40:16.146 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 e7ce33ea-17ba-4f19-ae79-40b875e5f7a9 2024-09-16T04:40:16.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 e7ce33ea-17ba-4f19-ae79-40b875e5f7a9' 2024-09-16T04:40:16.146 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:40:16.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCwtudmaXfhCRAAlTd/GVdGa0rXe9mBvHPEzg== 2024-09-16T04:40:16.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCwtudmaXfhCRAAlTd/GVdGa0rXe9mBvHPEzg=="}' 2024-09-16T04:40:16.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e7ce33ea-17ba-4f19-ae79-40b875e5f7a9 -i td/osd-backfill-space/0/new.json 2024-09-16T04:40:16.436 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:40:16.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/0/new.json 2024-09-16T04:40:16.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCwtudmaXfhCRAAlTd/GVdGa0rXe9mBvHPEzg== --osd-uuid e7ce33ea-17ba-4f19-ae79-40b875e5f7a9 2024-09-16T04:40:16.483 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:16.481+0000 7fd327615640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:40:16.496 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:16.494+0000 7fd327615640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:40:16.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:16.495+0000 7fd327615640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:40:16.498 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:16.496+0000 7fd327615640 -1 bdev(0x557fe772fc00 td/osd-backfill-space/0/block) open stat got: (1) Operation not permitted 2024-09-16T04:40:16.498 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:16.496+0000 7fd327615640 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-09-16T04:40:22.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-09-16T04:40:22.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:40:22.228 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T04:40:22.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T04:40:22.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:40:22.803 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T04:40:22.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T04:40:22.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:40:22.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:40:22.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:40:22.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:40:22.838 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:22.837+0000 7f9845ca5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:40:22.840 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:22.839+0000 7f9845ca5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:40:22.841 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:22.840+0000 7f9845ca5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:40:23.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T04:40:23.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:40:23.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:40:23.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:40:23.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:40:23.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:23.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:40:23.264 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:40:23.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:23.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:23.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:24.431 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:24.430+0000 7f9845ca5640 -1 Falling back to public interface 2024-09-16T04:40:24.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:24.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:24.707 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:40:24.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:40:24.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:24.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:25.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:26.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:26.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:26.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:40:26.167 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:40:26.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:26.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:26.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:27.361 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:27.360+0000 7f9845ca5640 -1 osd.0 0 log_to_monitors true 2024-09-16T04:40:27.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:27.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:27.635 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:40:27.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:40:27.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:27.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:28.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:29.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:29.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:29.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:40:29.163 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:40:29.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:29.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:29.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:30.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:30.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:30.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:40:30.590 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:40:30.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:30.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:31.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:32.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:32.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:32.152 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:40:32.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:40:32.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:32.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:32.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:33.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:33.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:33.603 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:40:33.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:40:33.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:33.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:34.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:35.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:35.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:35.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:40:35.208 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:40:35.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:35.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:35.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:36.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:36.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:36.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:40:36.667 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:40:36.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:36.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:37.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:38.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:38.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:40:38.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:40:38.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:38.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:38.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:39.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:39.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:39.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:40:39.633 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:40:39.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:39.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:40.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:41.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:41.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:41.187 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:40:41.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:40:41.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:41.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:41.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:42.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:42.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:42.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:40:42.899 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:40:42.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:42.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:43.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:44.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:44.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:44.990 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:40:44.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:40:44.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:44.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:45.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:46.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:46.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:46.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:40:46.641 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:40:46.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:46.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:47.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:48.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:48.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:48.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:40:48.423 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:40:48.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:48.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:49.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:50.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:40:50.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:50.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:40:50.567 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:40:50.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:50.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:40:51.034 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3339975467,v1:127.0.0.1:6803/3339975467] [v2:127.0.0.1:6804/3339975467,v1:127.0.0.1:6805/3339975467] exists,up e7ce33ea-17ba-4f19-ae79-40b875e5f7a9 2024-09-16T04:40:51.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:40:51.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:763: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 1 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/1 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:40:51.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-09-16T04:40:51.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-09-16T04:40:51.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:40:51.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:40:51.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:40:51.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:40:51.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:40:51.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:40:51.040 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:40:51.040 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:40:51.040 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:40:51.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:40:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:40:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:40:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:40:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:40:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:40:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:40:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:40:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:40:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:40:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:40:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:40:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:40:51.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/1 2024-09-16T04:40:51.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:40:51.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cce71507-4066-43a4-970e-32aa9a607af9 2024-09-16T04:40:51.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 cce71507-4066-43a4-970e-32aa9a607af9' 2024-09-16T04:40:51.042 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 cce71507-4066-43a4-970e-32aa9a607af9 2024-09-16T04:40:51.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:40:51.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDTtudmdAaxAxAAohDekIUaHILmLR9uL+EJWA== 2024-09-16T04:40:51.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDTtudmdAaxAxAAohDekIUaHILmLR9uL+EJWA=="}' 2024-09-16T04:40:51.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cce71507-4066-43a4-970e-32aa9a607af9 -i td/osd-backfill-space/1/new.json 2024-09-16T04:40:51.547 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:40:51.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/1/new.json 2024-09-16T04:40:51.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDTtudmdAaxAxAAohDekIUaHILmLR9uL+EJWA== --osd-uuid cce71507-4066-43a4-970e-32aa9a607af9 2024-09-16T04:40:51.595 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:51.594+0000 7faaccf41640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:40:51.597 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:51.596+0000 7faaccf41640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:40:51.598 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:51.597+0000 7faaccf41640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:40:51.598 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:51.597+0000 7faaccf41640 -1 bdev(0x55c5b027dc00 td/osd-backfill-space/1/block) open stat got: (1) Operation not permitted 2024-09-16T04:40:51.598 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:51.597+0000 7faaccf41640 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-09-16T04:40:57.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-09-16T04:40:57.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:40:57.829 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T04:40:57.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T04:40:57.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:40:58.402 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T04:40:58.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T04:40:58.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:40:58.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:40:58.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:40:58.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:40:58.436 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:58.435+0000 7f318b219640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:40:58.439 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:58.438+0000 7f318b219640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:40:58.440 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:58.439+0000 7f318b219640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:40:58.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T04:40:58.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:40:58.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:40:58.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:40:58.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:40:58.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:40:58.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:40:58.853 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:40:58.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:40:58.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:40:59.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:40:59.771 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:40:59.770+0000 7f318b219640 -1 Falling back to public interface 2024-09-16T04:41:00.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:00.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:00.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:41:00.293 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:41:00.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:00.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:00.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:01.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:01.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:01.748 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:41:01.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:41:01.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:01.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:02.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:02.650 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:41:02.649+0000 7f318b219640 -1 osd.1 0 log_to_monitors true 2024-09-16T04:41:03.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:03.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:03.169 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:41:03.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:41:03.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:03.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:03.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:04.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:04.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:04.816 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:41:04.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:41:04.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:04.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:05.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:06.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:06.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:06.277 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:41:06.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:41:06.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:06.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:06.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:07.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:07.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:07.911 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:41:07.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:41:07.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:07.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:08.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:09.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:09.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:09.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:41:09.339 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:41:09.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:09.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:09.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:10.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:10.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:10.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:41:10.840 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:41:10.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:10.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:11.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:12.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:12.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:12.277 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:41:12.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:41:12.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:12.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:12.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:13.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:13.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:13.902 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:41:13.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:41:13.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:13.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:14.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:15.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:15.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:15.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:41:15.324 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:41:15.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:15.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:16.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:17.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:17.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:17.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:41:17.211 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:41:17.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:17.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:18.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:19.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:19.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:19.120 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:41:19.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:41:19.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:19.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:19.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:20.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:20.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:20.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:41:20.906 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:41:20.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:20.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:21.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:22.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:22.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:22.633 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:41:22.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:41:22.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:22.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:23.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:24.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:24.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:24.749 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:41:24.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:41:24.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:24.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:25.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:26.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:26.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:26.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:41:26.611 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:41:26.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:26.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:41:27.063 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2178480481,v1:127.0.0.1:6811/2178480481] [v2:127.0.0.1:6812/2178480481,v1:127.0.0.1:6813/2178480481] exists,up cce71507-4066-43a4-970e-32aa9a607af9 2024-09-16T04:41:27.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:41:27.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:41:27.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:41:27.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:41:27.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:763: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 2 2024-09-16T04:41:27.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:41:27.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:41:27.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T04:41:27.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:41:27.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/2 2024-09-16T04:41:27.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:41:27.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:41:27.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:41:27.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:41:27.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-09-16T04:41:27.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-09-16T04:41:27.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:41:27.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:41:27.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:41:27.068 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:41:27.068 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:41:27.068 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:41:27.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:41:27.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:41:27.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:41:27.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:41:27.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/2 2024-09-16T04:41:27.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:41:27.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5bdcd37f-ec6b-4664-b0ba-932816ef4d6e 2024-09-16T04:41:27.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 5bdcd37f-ec6b-4664-b0ba-932816ef4d6e' 2024-09-16T04:41:27.070 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 5bdcd37f-ec6b-4664-b0ba-932816ef4d6e 2024-09-16T04:41:27.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:41:27.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD3tudmTU5TBRAA1f/vekA+1cMZkqFdijkFVg== 2024-09-16T04:41:27.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD3tudmTU5TBRAA1f/vekA+1cMZkqFdijkFVg=="}' 2024-09-16T04:41:27.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5bdcd37f-ec6b-4664-b0ba-932816ef4d6e -i td/osd-backfill-space/2/new.json 2024-09-16T04:41:27.656 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:41:27.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/2/new.json 2024-09-16T04:41:27.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD3tudmTU5TBRAA1f/vekA+1cMZkqFdijkFVg== --osd-uuid 5bdcd37f-ec6b-4664-b0ba-932816ef4d6e 2024-09-16T04:41:27.704 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:41:27.702+0000 7f2f5581f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:41:27.721 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:41:27.719+0000 7f2f5581f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:41:27.723 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:41:27.721+0000 7f2f5581f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:41:27.723 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:41:27.721+0000 7f2f5581f640 -1 bdev(0x555c61705c00 td/osd-backfill-space/2/block) open stat got: (1) Operation not permitted 2024-09-16T04:41:27.723 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:41:27.721+0000 7f2f5581f640 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-09-16T04:41:33.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-09-16T04:41:33.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:41:33.643 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T04:41:33.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T04:41:33.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:41:34.211 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T04:41:34.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T04:41:34.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:41:34.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:41:34.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:41:34.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:41:34.246 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:41:34.245+0000 7f182b52e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:41:34.249 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:41:34.248+0000 7f182b52e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:41:34.250 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:41:34.249+0000 7f182b52e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:41:34.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T04:41:34.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:41:34.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:41:34.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:41:34.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:41:34.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:34.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:41:34.655 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:41:34.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:34.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:35.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:35.366 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:41:35.365+0000 7f182b52e640 -1 Falling back to public interface 2024-09-16T04:41:36.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:36.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:36.101 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:41:36.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:41:36.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:36.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:36.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:37.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:37.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:37.524 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:41:37.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:41:37.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:37.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:37.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:38.097 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:41:38.096+0000 7f182b52e640 -1 osd.2 0 log_to_monitors true 2024-09-16T04:41:38.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:38.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:38.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:41:38.946 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:41:38.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:38.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:39.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:40.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:40.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:40.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:41:40.552 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:41:40.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:40.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:40.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:41.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:41.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:41.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:41:41.999 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:41:41.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:41.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:42.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:43.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:43.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:43.429 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:41:43.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:41:43.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:43.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:43.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:45.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:45.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:45.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:41:45.001 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:41:45.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:45.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:45.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:46.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:46.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:46.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:41:46.490 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:41:46.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:46.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:47.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:48.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:48.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:48.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:41:48.011 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:41:48.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:48.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:48.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:49.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:49.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:49.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:41:49.547 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:41:49.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:49.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:50.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:51.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:51.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:51.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:41:51.106 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:41:51.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:51.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:51.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:52.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:52.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:52.852 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:41:52.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:41:52.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:52.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:53.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:54.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:54.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:54.556 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:41:54.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:41:54.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:54.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:55.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:56.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:56.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:56.218 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:41:56.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:41:56.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:56.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:56.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:57.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:57.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:57.660 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:41:57.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:41:57.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:57.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:41:58.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:41:59.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:41:59.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:41:59.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:41:59.433 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:41:59.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:41:59.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:42:00.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:01.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:01.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:01.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:42:01.202 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:42:01.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:01.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:42:01.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:02.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:02.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:02.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:42:02.739 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:42:02.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:02.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:42:03.193 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3073945029,v1:127.0.0.1:6819/3073945029] [v2:127.0.0.1:6820/3073945029,v1:127.0.0.1:6821/3073945029] exists,up 5bdcd37f-ec6b-4664-b0ba-932816ef4d6e 2024-09-16T04:42:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:42:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:42:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:42:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:42:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:763: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 3 2024-09-16T04:42:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:42:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:42:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T04:42:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:42:03.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/3 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:42:03.198 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:42:03.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:42:03.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:42:03.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/3 2024-09-16T04:42:03.200 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:42:03.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ba9fbfe2-cc2c-4189-88f7-520ddb274b44 2024-09-16T04:42:03.200 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 ba9fbfe2-cc2c-4189-88f7-520ddb274b44 2024-09-16T04:42:03.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 ba9fbfe2-cc2c-4189-88f7-520ddb274b44' 2024-09-16T04:42:03.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:42:03.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAbt+dmZf0ZDRAAWE56DecgrkWz4awLK92hKA== 2024-09-16T04:42:03.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAbt+dmZf0ZDRAAWE56DecgrkWz4awLK92hKA=="}' 2024-09-16T04:42:03.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ba9fbfe2-cc2c-4189-88f7-520ddb274b44 -i td/osd-backfill-space/3/new.json 2024-09-16T04:42:03.783 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:42:03.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/3/new.json 2024-09-16T04:42:03.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAbt+dmZf0ZDRAAWE56DecgrkWz4awLK92hKA== --osd-uuid ba9fbfe2-cc2c-4189-88f7-520ddb274b44 2024-09-16T04:42:03.832 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:03.831+0000 7f8a6a80f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:42:03.834 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:03.833+0000 7f8a6a80f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:42:03.835 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:03.834+0000 7f8a6a80f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:42:03.835 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:03.834+0000 7f8a6a80f640 -1 bdev(0x55aeecfb9c00 td/osd-backfill-space/3/block) open stat got: (1) Operation not permitted 2024-09-16T04:42:03.835 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:03.834+0000 7f8a6a80f640 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2024-09-16T04:42:09.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2024-09-16T04:42:09.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:42:09.497 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T04:42:09.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T04:42:09.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:42:10.068 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T04:42:10.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T04:42:10.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:42:10.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:42:10.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:42:10.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:42:10.103 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:10.101+0000 7f6138f69640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:42:10.104 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:10.104+0000 7f6138f69640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:42:10.105 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:10.105+0000 7f6138f69640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:42:10.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T04:42:10.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:42:10.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T04:42:10.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:42:10.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:42:10.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:10.492 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:42:10.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:42:10.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:10.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:10.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:11.465 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:11.464+0000 7f6138f69640 -1 Falling back to public interface 2024-09-16T04:42:11.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:11.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:11.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:42:11.956 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:42:11.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:11.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:12.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:13.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:13.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:13.439 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:42:13.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:42:13.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:13.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:13.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:14.721 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:14.719+0000 7f6138f69640 -1 osd.3 0 log_to_monitors true 2024-09-16T04:42:14.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:14.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:14.862 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:42:14.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:42:14.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:14.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:15.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:16.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:16.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:16.425 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:42:16.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:42:16.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:16.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:16.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:17.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:17.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:17.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:42:17.908 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:42:17.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:17.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:18.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:19.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:19.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:19.338 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:42:19.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:42:19.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:19.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:19.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:20.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:20.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:42:20.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:42:20.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:20.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:21.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:22.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:22.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:22.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:42:22.268 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:42:22.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:22.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:22.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:23.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:23.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:23.787 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:42:23.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:42:23.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:23.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:24.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:25.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:25.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:25.215 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:42:25.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:42:25.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:25.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:25.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:26.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:26.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:26.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:42:26.639 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:42:26.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:26.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:27.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:28.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:28.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:28.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:42:28.063 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:42:28.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:28.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:28.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:29.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:29.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:29.666 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:42:29.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:42:29.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:29.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:30.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:31.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:31.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:31.345 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:42:31.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:42:31.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:31.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:32.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:33.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:33.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:33.081 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:42:33.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:42:33.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:33.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:33.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:34.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:34.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:34.830 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:42:34.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:42:34.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:34.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:35.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:36.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:36.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:36.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:42:36.553 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:42:36.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:36.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:37.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:38.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:38.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:38.620 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:42:38.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:42:38.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:38.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:42:39.080 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/954416346,v1:127.0.0.1:6827/954416346] [v2:127.0.0.1:6828/954416346,v1:127.0.0.1:6829/954416346] exists,up ba9fbfe2-cc2c-4189-88f7-520ddb274b44 2024-09-16T04:42:39.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:42:39.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:42:39.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:42:39.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:42:39.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:763: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 4 2024-09-16T04:42:39.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/4 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:42:39.085 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:42:39.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:42:39.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:42:39.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:42:39.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:42:39.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:42:39.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:42:39.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/4 2024-09-16T04:42:39.087 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:42:39.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cc1c8bb2-c09d-40c9-a45c-f072abc2b281 2024-09-16T04:42:39.088 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 cc1c8bb2-c09d-40c9-a45c-f072abc2b281 2024-09-16T04:42:39.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 cc1c8bb2-c09d-40c9-a45c-f072abc2b281' 2024-09-16T04:42:39.088 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:42:39.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA/t+dmmAxlBhAAXh6QtaZvwnAY0I/sUyD6SA== 2024-09-16T04:42:39.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA/t+dmmAxlBhAAXh6QtaZvwnAY0I/sUyD6SA=="}' 2024-09-16T04:42:39.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cc1c8bb2-c09d-40c9-a45c-f072abc2b281 -i td/osd-backfill-space/4/new.json 2024-09-16T04:42:39.587 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:42:39.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/4/new.json 2024-09-16T04:42:39.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA/t+dmmAxlBhAAXh6QtaZvwnAY0I/sUyD6SA== --osd-uuid cc1c8bb2-c09d-40c9-a45c-f072abc2b281 2024-09-16T04:42:39.635 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:39.634+0000 7fa22f633640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:42:39.637 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:39.636+0000 7fa22f633640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:42:39.638 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:39.637+0000 7fa22f633640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:42:39.639 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:39.638+0000 7fa22f633640 -1 bdev(0x5563bcf11c00 td/osd-backfill-space/4/block) open stat got: (1) Operation not permitted 2024-09-16T04:42:39.639 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:39.638+0000 7fa22f633640 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2024-09-16T04:42:45.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2024-09-16T04:42:45.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:42:45.339 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T04:42:45.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T04:42:45.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:42:45.926 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T04:42:45.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T04:42:45.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:42:45.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:42:45.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:42:45.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:42:45.961 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:45.959+0000 7f8cb5483640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:42:45.991 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:45.990+0000 7f8cb5483640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:42:45.992 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:45.991+0000 7f8cb5483640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:42:46.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T04:42:46.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:42:46.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T04:42:46.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:42:46.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:42:46.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:46.360 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:42:46.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:42:46.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:46.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:42:46.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:47.354 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:47.353+0000 7f8cb5483640 -1 Falling back to public interface 2024-09-16T04:42:47.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:47.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:47.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:42:47.804 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:42:47.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:47.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:42:48.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:49.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:49.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:49.264 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:42:49.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:42:49.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:49.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:42:49.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:49.916 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:42:49.915+0000 7f8cb5483640 -1 osd.4 0 log_to_monitors true 2024-09-16T04:42:50.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:50.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:50.687 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:42:50.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:42:50.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:50.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:42:51.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:52.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:52.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:52.153 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:42:52.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:42:52.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:52.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:42:52.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:53.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:53.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:53.599 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:42:53.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:42:53.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:53.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:42:54.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:55.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:55.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:55.048 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:42:55.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:42:55.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:55.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:42:55.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:56.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:56.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:56.611 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:42:56.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:42:56.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:56.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:42:57.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:58.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:58.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:58.185 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:42:58.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:42:58.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:58.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:42:58.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:42:59.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:42:59.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:42:59.608 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:42:59.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:42:59.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:42:59.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:43:00.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:01.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:01.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:01.082 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:43:01.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:43:01.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:01.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:43:01.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:02.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:02.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:02.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:43:02.647 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:43:02.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:02.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:43:03.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:04.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:04.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:04.386 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:43:04.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:43:04.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:04.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:43:05.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:06.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:06.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:06.575 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:43:06.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:43:06.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:06.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:43:07.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:08.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:08.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:08.379 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:43:08.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:43:08.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:08.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:43:09.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:10.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:10.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:10.261 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:43:10.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:43:10.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:10.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:43:11.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:12.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:12.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:12.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:43:12.176 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:43:12.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:12.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:43:12.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:13.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:13.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:13.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:43:13.790 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:43:13.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:13.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:43:14.303 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3615715807,v1:127.0.0.1:6835/3615715807] [v2:127.0.0.1:6836/3615715807,v1:127.0.0.1:6837/3615715807] exists,up cc1c8bb2-c09d-40c9-a45c-f072abc2b281 2024-09-16T04:43:14.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:43:14.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:43:14.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:43:14.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:761: TEST_ec_backfill_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:43:14.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:763: TEST_ec_backfill_multi: run_osd td/osd-backfill-space 5 2024-09-16T04:43:14.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:43:14.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/5 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/5' 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/5/journal' 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:43:14.308 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:43:14.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:43:14.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:43:14.309 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:43:14.309 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:43:14.309 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:43:14.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:43:14.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:43:14.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:43:14.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:43:14.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:43:14.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:43:14.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:43:14.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:43:14.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:43:14.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:43:14.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:43:14.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:43:14.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:43:14.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/5 2024-09-16T04:43:14.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:43:14.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a63a2e76-ccc1-42b6-bb3a-602a9d41964c 2024-09-16T04:43:14.310 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 a63a2e76-ccc1-42b6-bb3a-602a9d41964c 2024-09-16T04:43:14.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 a63a2e76-ccc1-42b6-bb3a-602a9d41964c' 2024-09-16T04:43:14.311 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:43:14.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBit+dmZ3anExAAZlFXQo8msa4YisbVdoG15Q== 2024-09-16T04:43:14.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBit+dmZ3anExAAZlFXQo8msa4YisbVdoG15Q=="}' 2024-09-16T04:43:14.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a63a2e76-ccc1-42b6-bb3a-602a9d41964c -i td/osd-backfill-space/5/new.json 2024-09-16T04:43:14.983 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:43:14.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/5/new.json 2024-09-16T04:43:14.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBit+dmZ3anExAAZlFXQo8msa4YisbVdoG15Q== --osd-uuid a63a2e76-ccc1-42b6-bb3a-602a9d41964c 2024-09-16T04:43:15.033 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:43:15.031+0000 7f6738517640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:43:15.052 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:43:15.049+0000 7f6738517640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:43:15.052 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:43:15.050+0000 7f6738517640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:43:15.052 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:43:15.050+0000 7f6738517640 -1 bdev(0x55cad8eedc00 td/osd-backfill-space/5/block) open stat got: (1) Operation not permitted 2024-09-16T04:43:15.053 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:43:15.051+0000 7f6738517640 -1 bluestore(td/osd-backfill-space/5) _read_fsid unparsable uuid 2024-09-16T04:43:20.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/5/keyring 2024-09-16T04:43:20.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:43:20.716 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T04:43:20.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T04:43:20.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:43:21.289 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T04:43:21.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T04:43:21.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:43:21.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:43:21.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:43:21.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:43:21.325 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:43:21.324+0000 7f7e8600b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:43:21.327 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:43:21.326+0000 7f7e8600b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:43:21.328 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:43:21.327+0000 7f7e8600b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:43:21.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T04:43:21.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:43:21.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T04:43:21.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:43:21.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:43:21.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:21.755 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:43:21.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:43:21.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:21.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:22.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:22.203 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:43:22.203+0000 7f7e8600b640 -1 Falling back to public interface 2024-09-16T04:43:23.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:23.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:23.199 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:43:23.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:43:23.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:23.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:23.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:24.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:24.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:24.676 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:43:24.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:43:24.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:24.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:24.863 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:43:24.862+0000 7f7e8600b640 -1 osd.5 0 log_to_monitors true 2024-09-16T04:43:25.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:26.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:26.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:26.184 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:43:26.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:43:26.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:26.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:26.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:27.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:27.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:27.705 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:43:27.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:43:27.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:27.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:28.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:29.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:29.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:29.286 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:43:29.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:43:29.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:29.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:29.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:30.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:30.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:30.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:43:30.724 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:43:30.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:30.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:31.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:32.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:32.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:32.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:43:32.157 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:43:32.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:32.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:32.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:33.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:33.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:33.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:43:33.582 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:43:33.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:33.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:34.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:35.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:35.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:35.008 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:43:35.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:43:35.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:35.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:35.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:36.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:36.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:36.479 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:43:36.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:43:36.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:36.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:36.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:37.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:37.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:37.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:43:37.909 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:43:37.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:37.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:38.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:39.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:39.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:39.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:43:39.338 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:43:39.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:39.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:40.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:41.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:41.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:41.168 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:43:41.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:43:41.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:41.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:42.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:43.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:43.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:43.029 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:43:43.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:43:43.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:43.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:43.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:44.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:44.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:44.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:43:44.971 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:43:44.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:44.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:45.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:46.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:46.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:46.718 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:43:46.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:43:46.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:46.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:47.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:43:48.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:43:48.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:43:48.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:43:48.474 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:43:48.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:43:48.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:43:48.986 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/1186535631,v1:127.0.0.1:6843/1186535631] [v2:127.0.0.1:6844/1186535631,v1:127.0.0.1:6845/1186535631] exists,up a63a2e76-ccc1-42b6-bb3a-602a9d41964c 2024-09-16T04:43:48.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:43:48.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:43:48.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:43:48.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:770: TEST_ec_backfill_multi: ceph osd set-backfillfull-ratio .85 2024-09-16T04:43:49.666 INFO:tasks.workunit.client.0.smithi026.stderr:osd set-backfillfull-ratio 0.85 2024-09-16T04:43:49.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:772: TEST_ec_backfill_multi: ceph osd set-require-min-compat-client luminous 2024-09-16T04:43:50.684 INFO:tasks.workunit.client.0.smithi026.stderr:set require_min_compat_client to luminous 2024-09-16T04:43:50.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:773: TEST_ec_backfill_multi: create_pool fillpool 1 1 2024-09-16T04:43:50.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create fillpool 1 1 2024-09-16T04:43:51.330 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'fillpool' already exists 2024-09-16T04:43:51.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:43:52.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:774: TEST_ec_backfill_multi: ceph osd pool set fillpool size 1 --yes-i-really-mean-it 2024-09-16T04:43:52.985 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 1 2024-09-16T04:43:52.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:782: TEST_ec_backfill_multi: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=9 2024-09-16T04:43:52.997 INFO:tasks.workunit.client.0.smithi026.stderr:9+0 records in 2024-09-16T04:43:52.998 INFO:tasks.workunit.client.0.smithi026.stderr:9+0 records out 2024-09-16T04:43:52.998 INFO:tasks.workunit.client.0.smithi026.stderr:9216 bytes (9.2 kB, 9.0 KiB) copied, 9.7986e-05 s, 94.1 MB/s 2024-09-16T04:43:52.998 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: seq 1 200 2024-09-16T04:43:52.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:52.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj1 td/osd-backfill-space/datafile 2024-09-16T04:43:53.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:53.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj2 td/osd-backfill-space/datafile 2024-09-16T04:43:54.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:54.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj3 td/osd-backfill-space/datafile 2024-09-16T04:43:54.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:54.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj4 td/osd-backfill-space/datafile 2024-09-16T04:43:54.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:54.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj5 td/osd-backfill-space/datafile 2024-09-16T04:43:54.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:54.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj6 td/osd-backfill-space/datafile 2024-09-16T04:43:54.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:54.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj7 td/osd-backfill-space/datafile 2024-09-16T04:43:54.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:54.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj8 td/osd-backfill-space/datafile 2024-09-16T04:43:54.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:54.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj9 td/osd-backfill-space/datafile 2024-09-16T04:43:54.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:54.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj10 td/osd-backfill-space/datafile 2024-09-16T04:43:54.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:54.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj11 td/osd-backfill-space/datafile 2024-09-16T04:43:54.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:54.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj12 td/osd-backfill-space/datafile 2024-09-16T04:43:55.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:55.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj13 td/osd-backfill-space/datafile 2024-09-16T04:43:55.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:55.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj14 td/osd-backfill-space/datafile 2024-09-16T04:43:55.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:55.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj15 td/osd-backfill-space/datafile 2024-09-16T04:43:55.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:55.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj16 td/osd-backfill-space/datafile 2024-09-16T04:43:55.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:55.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj17 td/osd-backfill-space/datafile 2024-09-16T04:43:55.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:55.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj18 td/osd-backfill-space/datafile 2024-09-16T04:43:55.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:55.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj19 td/osd-backfill-space/datafile 2024-09-16T04:43:55.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:55.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj20 td/osd-backfill-space/datafile 2024-09-16T04:43:56.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:56.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj21 td/osd-backfill-space/datafile 2024-09-16T04:43:56.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:56.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj22 td/osd-backfill-space/datafile 2024-09-16T04:43:56.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:56.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj23 td/osd-backfill-space/datafile 2024-09-16T04:43:56.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:56.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj24 td/osd-backfill-space/datafile 2024-09-16T04:43:56.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:56.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj25 td/osd-backfill-space/datafile 2024-09-16T04:43:56.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:56.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj26 td/osd-backfill-space/datafile 2024-09-16T04:43:56.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:56.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj27 td/osd-backfill-space/datafile 2024-09-16T04:43:56.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:56.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj28 td/osd-backfill-space/datafile 2024-09-16T04:43:56.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:56.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj29 td/osd-backfill-space/datafile 2024-09-16T04:43:56.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:56.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj30 td/osd-backfill-space/datafile 2024-09-16T04:43:56.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:56.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj31 td/osd-backfill-space/datafile 2024-09-16T04:43:57.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:57.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj32 td/osd-backfill-space/datafile 2024-09-16T04:43:57.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:57.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj33 td/osd-backfill-space/datafile 2024-09-16T04:43:57.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:57.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj34 td/osd-backfill-space/datafile 2024-09-16T04:43:57.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:57.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj35 td/osd-backfill-space/datafile 2024-09-16T04:43:57.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:57.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj36 td/osd-backfill-space/datafile 2024-09-16T04:43:57.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:57.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj37 td/osd-backfill-space/datafile 2024-09-16T04:43:57.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:57.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj38 td/osd-backfill-space/datafile 2024-09-16T04:43:57.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:57.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj39 td/osd-backfill-space/datafile 2024-09-16T04:43:57.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:57.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj40 td/osd-backfill-space/datafile 2024-09-16T04:43:57.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:57.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj41 td/osd-backfill-space/datafile 2024-09-16T04:43:57.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:57.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj42 td/osd-backfill-space/datafile 2024-09-16T04:43:58.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:58.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj43 td/osd-backfill-space/datafile 2024-09-16T04:43:58.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:58.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj44 td/osd-backfill-space/datafile 2024-09-16T04:43:58.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:58.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj45 td/osd-backfill-space/datafile 2024-09-16T04:43:58.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:58.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj46 td/osd-backfill-space/datafile 2024-09-16T04:43:58.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:58.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj47 td/osd-backfill-space/datafile 2024-09-16T04:43:58.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:58.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj48 td/osd-backfill-space/datafile 2024-09-16T04:43:58.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:58.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj49 td/osd-backfill-space/datafile 2024-09-16T04:43:58.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:58.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj50 td/osd-backfill-space/datafile 2024-09-16T04:43:58.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:58.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj51 td/osd-backfill-space/datafile 2024-09-16T04:43:58.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:58.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj52 td/osd-backfill-space/datafile 2024-09-16T04:43:58.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:58.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj53 td/osd-backfill-space/datafile 2024-09-16T04:43:59.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:59.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj54 td/osd-backfill-space/datafile 2024-09-16T04:43:59.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:59.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj55 td/osd-backfill-space/datafile 2024-09-16T04:43:59.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:59.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj56 td/osd-backfill-space/datafile 2024-09-16T04:43:59.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:59.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj57 td/osd-backfill-space/datafile 2024-09-16T04:43:59.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:59.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj58 td/osd-backfill-space/datafile 2024-09-16T04:43:59.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:59.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj59 td/osd-backfill-space/datafile 2024-09-16T04:43:59.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:59.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj60 td/osd-backfill-space/datafile 2024-09-16T04:43:59.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:59.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj61 td/osd-backfill-space/datafile 2024-09-16T04:43:59.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:59.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj62 td/osd-backfill-space/datafile 2024-09-16T04:43:59.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:59.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj63 td/osd-backfill-space/datafile 2024-09-16T04:43:59.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:43:59.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj64 td/osd-backfill-space/datafile 2024-09-16T04:44:00.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:00.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj65 td/osd-backfill-space/datafile 2024-09-16T04:44:00.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:00.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj66 td/osd-backfill-space/datafile 2024-09-16T04:44:00.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:00.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj67 td/osd-backfill-space/datafile 2024-09-16T04:44:00.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:00.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj68 td/osd-backfill-space/datafile 2024-09-16T04:44:00.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:00.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj69 td/osd-backfill-space/datafile 2024-09-16T04:44:00.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:00.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj70 td/osd-backfill-space/datafile 2024-09-16T04:44:00.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:00.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj71 td/osd-backfill-space/datafile 2024-09-16T04:44:00.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:00.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj72 td/osd-backfill-space/datafile 2024-09-16T04:44:00.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:00.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj73 td/osd-backfill-space/datafile 2024-09-16T04:44:00.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:00.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj74 td/osd-backfill-space/datafile 2024-09-16T04:44:00.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:00.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj75 td/osd-backfill-space/datafile 2024-09-16T04:44:01.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:01.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj76 td/osd-backfill-space/datafile 2024-09-16T04:44:01.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:01.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj77 td/osd-backfill-space/datafile 2024-09-16T04:44:01.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:01.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj78 td/osd-backfill-space/datafile 2024-09-16T04:44:01.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:01.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj79 td/osd-backfill-space/datafile 2024-09-16T04:44:01.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:01.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj80 td/osd-backfill-space/datafile 2024-09-16T04:44:01.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:01.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj81 td/osd-backfill-space/datafile 2024-09-16T04:44:01.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:01.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj82 td/osd-backfill-space/datafile 2024-09-16T04:44:01.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:01.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj83 td/osd-backfill-space/datafile 2024-09-16T04:44:01.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:01.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj84 td/osd-backfill-space/datafile 2024-09-16T04:44:01.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:01.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj85 td/osd-backfill-space/datafile 2024-09-16T04:44:01.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:01.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj86 td/osd-backfill-space/datafile 2024-09-16T04:44:02.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:02.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj87 td/osd-backfill-space/datafile 2024-09-16T04:44:02.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:02.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj88 td/osd-backfill-space/datafile 2024-09-16T04:44:02.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:02.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj89 td/osd-backfill-space/datafile 2024-09-16T04:44:02.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:02.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj90 td/osd-backfill-space/datafile 2024-09-16T04:44:02.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:02.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj91 td/osd-backfill-space/datafile 2024-09-16T04:44:02.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:02.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj92 td/osd-backfill-space/datafile 2024-09-16T04:44:02.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:02.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj93 td/osd-backfill-space/datafile 2024-09-16T04:44:02.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:02.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj94 td/osd-backfill-space/datafile 2024-09-16T04:44:02.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:02.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj95 td/osd-backfill-space/datafile 2024-09-16T04:44:02.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:02.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj96 td/osd-backfill-space/datafile 2024-09-16T04:44:02.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:02.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj97 td/osd-backfill-space/datafile 2024-09-16T04:44:03.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:03.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj98 td/osd-backfill-space/datafile 2024-09-16T04:44:03.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:03.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj99 td/osd-backfill-space/datafile 2024-09-16T04:44:03.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:03.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj100 td/osd-backfill-space/datafile 2024-09-16T04:44:03.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:03.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj101 td/osd-backfill-space/datafile 2024-09-16T04:44:03.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:03.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj102 td/osd-backfill-space/datafile 2024-09-16T04:44:03.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:03.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj103 td/osd-backfill-space/datafile 2024-09-16T04:44:03.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:03.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj104 td/osd-backfill-space/datafile 2024-09-16T04:44:03.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:03.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj105 td/osd-backfill-space/datafile 2024-09-16T04:44:03.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:03.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj106 td/osd-backfill-space/datafile 2024-09-16T04:44:03.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:03.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj107 td/osd-backfill-space/datafile 2024-09-16T04:44:03.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:03.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj108 td/osd-backfill-space/datafile 2024-09-16T04:44:04.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:04.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj109 td/osd-backfill-space/datafile 2024-09-16T04:44:04.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:04.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj110 td/osd-backfill-space/datafile 2024-09-16T04:44:04.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:04.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj111 td/osd-backfill-space/datafile 2024-09-16T04:44:04.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:04.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj112 td/osd-backfill-space/datafile 2024-09-16T04:44:04.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:04.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj113 td/osd-backfill-space/datafile 2024-09-16T04:44:04.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:04.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj114 td/osd-backfill-space/datafile 2024-09-16T04:44:04.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:04.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj115 td/osd-backfill-space/datafile 2024-09-16T04:44:04.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:04.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj116 td/osd-backfill-space/datafile 2024-09-16T04:44:04.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:04.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj117 td/osd-backfill-space/datafile 2024-09-16T04:44:04.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:04.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj118 td/osd-backfill-space/datafile 2024-09-16T04:44:04.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:04.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj119 td/osd-backfill-space/datafile 2024-09-16T04:44:05.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:05.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj120 td/osd-backfill-space/datafile 2024-09-16T04:44:05.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:05.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj121 td/osd-backfill-space/datafile 2024-09-16T04:44:05.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:05.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj122 td/osd-backfill-space/datafile 2024-09-16T04:44:05.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:05.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj123 td/osd-backfill-space/datafile 2024-09-16T04:44:05.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:05.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj124 td/osd-backfill-space/datafile 2024-09-16T04:44:05.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:05.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj125 td/osd-backfill-space/datafile 2024-09-16T04:44:05.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:05.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj126 td/osd-backfill-space/datafile 2024-09-16T04:44:05.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:05.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj127 td/osd-backfill-space/datafile 2024-09-16T04:44:05.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:05.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj128 td/osd-backfill-space/datafile 2024-09-16T04:44:05.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:05.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj129 td/osd-backfill-space/datafile 2024-09-16T04:44:05.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:05.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj130 td/osd-backfill-space/datafile 2024-09-16T04:44:06.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:06.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj131 td/osd-backfill-space/datafile 2024-09-16T04:44:06.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:06.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj132 td/osd-backfill-space/datafile 2024-09-16T04:44:06.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:06.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj133 td/osd-backfill-space/datafile 2024-09-16T04:44:06.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:06.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj134 td/osd-backfill-space/datafile 2024-09-16T04:44:06.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:06.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj135 td/osd-backfill-space/datafile 2024-09-16T04:44:06.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:06.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj136 td/osd-backfill-space/datafile 2024-09-16T04:44:06.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:06.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj137 td/osd-backfill-space/datafile 2024-09-16T04:44:06.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:06.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj138 td/osd-backfill-space/datafile 2024-09-16T04:44:06.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:06.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj139 td/osd-backfill-space/datafile 2024-09-16T04:44:06.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:06.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj140 td/osd-backfill-space/datafile 2024-09-16T04:44:06.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:06.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj141 td/osd-backfill-space/datafile 2024-09-16T04:44:06.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:06.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj142 td/osd-backfill-space/datafile 2024-09-16T04:44:07.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:07.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj143 td/osd-backfill-space/datafile 2024-09-16T04:44:07.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:07.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj144 td/osd-backfill-space/datafile 2024-09-16T04:44:07.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:07.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj145 td/osd-backfill-space/datafile 2024-09-16T04:44:07.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:07.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj146 td/osd-backfill-space/datafile 2024-09-16T04:44:07.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:07.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj147 td/osd-backfill-space/datafile 2024-09-16T04:44:07.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:07.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj148 td/osd-backfill-space/datafile 2024-09-16T04:44:07.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:07.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj149 td/osd-backfill-space/datafile 2024-09-16T04:44:07.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:07.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj150 td/osd-backfill-space/datafile 2024-09-16T04:44:07.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:07.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj151 td/osd-backfill-space/datafile 2024-09-16T04:44:07.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:07.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj152 td/osd-backfill-space/datafile 2024-09-16T04:44:07.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:07.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj153 td/osd-backfill-space/datafile 2024-09-16T04:44:08.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:08.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj154 td/osd-backfill-space/datafile 2024-09-16T04:44:08.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:08.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj155 td/osd-backfill-space/datafile 2024-09-16T04:44:08.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:08.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj156 td/osd-backfill-space/datafile 2024-09-16T04:44:08.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:08.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj157 td/osd-backfill-space/datafile 2024-09-16T04:44:08.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:08.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj158 td/osd-backfill-space/datafile 2024-09-16T04:44:08.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:08.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj159 td/osd-backfill-space/datafile 2024-09-16T04:44:08.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:08.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj160 td/osd-backfill-space/datafile 2024-09-16T04:44:08.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:08.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj161 td/osd-backfill-space/datafile 2024-09-16T04:44:08.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:08.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj162 td/osd-backfill-space/datafile 2024-09-16T04:44:08.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:08.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj163 td/osd-backfill-space/datafile 2024-09-16T04:44:08.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:08.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj164 td/osd-backfill-space/datafile 2024-09-16T04:44:09.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:09.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj165 td/osd-backfill-space/datafile 2024-09-16T04:44:09.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:09.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj166 td/osd-backfill-space/datafile 2024-09-16T04:44:09.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:09.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj167 td/osd-backfill-space/datafile 2024-09-16T04:44:09.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:09.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj168 td/osd-backfill-space/datafile 2024-09-16T04:44:09.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:09.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj169 td/osd-backfill-space/datafile 2024-09-16T04:44:09.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:09.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj170 td/osd-backfill-space/datafile 2024-09-16T04:44:09.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:09.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj171 td/osd-backfill-space/datafile 2024-09-16T04:44:09.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:09.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj172 td/osd-backfill-space/datafile 2024-09-16T04:44:09.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:09.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj173 td/osd-backfill-space/datafile 2024-09-16T04:44:09.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:09.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj174 td/osd-backfill-space/datafile 2024-09-16T04:44:09.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:09.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj175 td/osd-backfill-space/datafile 2024-09-16T04:44:10.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:10.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj176 td/osd-backfill-space/datafile 2024-09-16T04:44:10.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:10.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj177 td/osd-backfill-space/datafile 2024-09-16T04:44:10.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:10.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj178 td/osd-backfill-space/datafile 2024-09-16T04:44:10.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:10.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj179 td/osd-backfill-space/datafile 2024-09-16T04:44:10.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:10.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj180 td/osd-backfill-space/datafile 2024-09-16T04:44:10.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:10.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj181 td/osd-backfill-space/datafile 2024-09-16T04:44:10.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:10.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj182 td/osd-backfill-space/datafile 2024-09-16T04:44:10.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:10.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj183 td/osd-backfill-space/datafile 2024-09-16T04:44:10.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:10.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj184 td/osd-backfill-space/datafile 2024-09-16T04:44:10.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:10.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj185 td/osd-backfill-space/datafile 2024-09-16T04:44:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj186 td/osd-backfill-space/datafile 2024-09-16T04:44:11.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:11.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj187 td/osd-backfill-space/datafile 2024-09-16T04:44:11.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:11.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj188 td/osd-backfill-space/datafile 2024-09-16T04:44:11.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:11.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj189 td/osd-backfill-space/datafile 2024-09-16T04:44:11.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:11.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj190 td/osd-backfill-space/datafile 2024-09-16T04:44:11.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:11.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj191 td/osd-backfill-space/datafile 2024-09-16T04:44:11.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:11.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj192 td/osd-backfill-space/datafile 2024-09-16T04:44:11.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:11.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj193 td/osd-backfill-space/datafile 2024-09-16T04:44:11.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:11.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj194 td/osd-backfill-space/datafile 2024-09-16T04:44:11.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:11.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj195 td/osd-backfill-space/datafile 2024-09-16T04:44:11.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:11.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj196 td/osd-backfill-space/datafile 2024-09-16T04:44:11.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:11.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj197 td/osd-backfill-space/datafile 2024-09-16T04:44:12.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:12.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj198 td/osd-backfill-space/datafile 2024-09-16T04:44:12.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:12.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj199 td/osd-backfill-space/datafile 2024-09-16T04:44:12.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:783: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:12.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:785: TEST_ec_backfill_multi: rados -p fillpool put obj200 td/osd-backfill-space/datafile 2024-09-16T04:44:12.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:788: TEST_ec_backfill_multi: get_primary fillpool obj1 2024-09-16T04:44:12.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=fillpool 2024-09-16T04:44:12.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T04:44:12.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map fillpool obj1 2024-09-16T04:44:12.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T04:44:13.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:788: TEST_ec_backfill_multi: local fillosd=1 2024-09-16T04:44:13.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:789: TEST_ec_backfill_multi: ceph osd erasure-code-profile set ec-profile k=3 m=2 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure 2024-09-16T04:44:13.735 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:791: TEST_ec_backfill_multi: osdlist 6 1 2024-09-16T04:44:13.736 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:724: osdlist: local OSDS=6 2024-09-16T04:44:13.736 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:725: osdlist: local excludeosd=1 2024-09-16T04:44:13.736 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:727: osdlist: osds= 2024-09-16T04:44:13.736 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: expr 6 - 1 2024-09-16T04:44:13.737 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: seq 0 5 2024-09-16T04:44:13.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:44:13.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:730: osdlist: '[' 0 = 1 ']' 2024-09-16T04:44:13.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:734: osdlist: '[' -n '' ']' 2024-09-16T04:44:13.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:737: osdlist: osds=0 2024-09-16T04:44:13.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:44:13.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:730: osdlist: '[' 1 = 1 ']' 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:732: osdlist: continue 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:730: osdlist: '[' 2 = 1 ']' 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:734: osdlist: '[' -n 0 ']' 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:735: osdlist: osds='0 ' 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:737: osdlist: osds='0 2' 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:730: osdlist: '[' 3 = 1 ']' 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:734: osdlist: '[' -n '0 2' ']' 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:735: osdlist: osds='0 2 ' 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:737: osdlist: osds='0 2 3' 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:44:13.741 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:730: osdlist: '[' 4 = 1 ']' 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:734: osdlist: '[' -n '0 2 3' ']' 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:735: osdlist: osds='0 2 3 ' 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:737: osdlist: osds='0 2 3 4' 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:728: osdlist: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:730: osdlist: '[' 5 = 1 ']' 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:734: osdlist: '[' -n '0 2 3 4' ']' 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:735: osdlist: osds='0 2 3 4 ' 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:737: osdlist: osds='0 2 3 4 5' 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:739: osdlist: echo 0 2 3 4 5 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:791: TEST_ec_backfill_multi: nonfillosds='0 2 3 4 5' 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:793: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:793: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:13.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:795: TEST_ec_backfill_multi: ceph osd pool create test1 1 1 erasure ec-profile 2024-09-16T04:44:14.575 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' already exists 2024-09-16T04:44:14.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:796: TEST_ec_backfill_multi: expr 1 + 1 2024-09-16T04:44:14.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:796: TEST_ec_backfill_multi: ceph osd pg-upmap 2.0 0 2 3 4 5 2024-09-16T04:44:15.433 INFO:tasks.workunit.client.0.smithi026.stderr:set 2.0 pg_upmap mapping to [0,2,3,4,5] 2024-09-16T04:44:15.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:793: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:15.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:795: TEST_ec_backfill_multi: ceph osd pool create test2 1 1 erasure ec-profile 2024-09-16T04:44:16.506 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' already exists 2024-09-16T04:44:16.518 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:796: TEST_ec_backfill_multi: expr 2 + 1 2024-09-16T04:44:16.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:796: TEST_ec_backfill_multi: ceph osd pg-upmap 3.0 0 2 3 4 5 2024-09-16T04:44:17.692 INFO:tasks.workunit.client.0.smithi026.stderr:set 3.0 pg_upmap mapping to [0,2,3,4,5] 2024-09-16T04:44:17.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:801: TEST_ec_backfill_multi: sleep 15 2024-09-16T04:44:32.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:803: TEST_ec_backfill_multi: ceph pg dump pgs 2024-09-16T04:44:33.113 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:44:33.113 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T04:44:19.130315+0000 0'0 53:16 [0,2,3,4,5] 0 [0,2,3,4,5] 0 0'0 2024-09-16T04:44:15.958635+0000 0'0 2024-09-16T04:44:15.958635+0000 0 0 periodic scrub scheduled @ 2024-09-17T14:42:12.082525+0000 0 0 2024-09-16T04:44:33.113 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2024-09-16T04:44:17.260875+0000 0'0 53:22 [0,2,3,4,5] 0 [0,2,3,4,5] 0 0'0 2024-09-16T04:44:14.300564+0000 0'0 2024-09-16T04:44:14.300564+0000 0 0 periodic scrub scheduled @ 2024-09-17T08:07:19.025487+0000 0 0 2024-09-16T04:44:33.113 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 200 0 0 0 0 1843200 0 0 100 100 100 active+clean 2024-09-16T04:43:53.803308+0000 41'200 53:244 [1] 1 [1] 1 0'0 2024-09-16T04:43:51.098014+0000 0'0 2024-09-16T04:43:51.098014+0000 0 0 periodic scrub scheduled @ 2024-09-17T08:03:17.558781+0000 0 0 2024-09-16T04:44:33.113 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:44:33.113 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:44:33.114 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:44:33.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:805: TEST_ec_backfill_multi: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=12 2024-09-16T04:44:33.125 INFO:tasks.workunit.client.0.smithi026.stderr:12+0 records in 2024-09-16T04:44:33.125 INFO:tasks.workunit.client.0.smithi026.stderr:12+0 records out 2024-09-16T04:44:33.125 INFO:tasks.workunit.client.0.smithi026.stderr:12288 bytes (12 kB, 12 KiB) copied, 0.000130319 s, 94.3 MB/s 2024-09-16T04:44:33.126 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: seq 1 200 2024-09-16T04:44:33.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:33.127 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:33.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:33.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj1-1 td/osd-backfill-space/datafile 2024-09-16T04:44:33.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:33.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj1-2 td/osd-backfill-space/datafile 2024-09-16T04:44:33.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:33.589 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:33.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:33.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj2-1 td/osd-backfill-space/datafile 2024-09-16T04:44:33.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:33.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj2-2 td/osd-backfill-space/datafile 2024-09-16T04:44:34.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:34.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:34.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:34.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj3-1 td/osd-backfill-space/datafile 2024-09-16T04:44:34.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:34.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj3-2 td/osd-backfill-space/datafile 2024-09-16T04:44:34.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:34.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:34.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:34.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj4-1 td/osd-backfill-space/datafile 2024-09-16T04:44:34.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:34.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj4-2 td/osd-backfill-space/datafile 2024-09-16T04:44:35.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:35.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:35.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:35.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj5-1 td/osd-backfill-space/datafile 2024-09-16T04:44:35.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:35.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj5-2 td/osd-backfill-space/datafile 2024-09-16T04:44:35.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:35.690 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:35.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:35.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj6-1 td/osd-backfill-space/datafile 2024-09-16T04:44:35.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:35.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj6-2 td/osd-backfill-space/datafile 2024-09-16T04:44:36.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:36.278 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:36.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:36.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj7-1 td/osd-backfill-space/datafile 2024-09-16T04:44:36.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:36.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj7-2 td/osd-backfill-space/datafile 2024-09-16T04:44:36.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:36.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:36.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:36.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj8-1 td/osd-backfill-space/datafile 2024-09-16T04:44:37.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:37.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj8-2 td/osd-backfill-space/datafile 2024-09-16T04:44:37.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:37.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:37.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:37.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj9-1 td/osd-backfill-space/datafile 2024-09-16T04:44:37.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:37.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj9-2 td/osd-backfill-space/datafile 2024-09-16T04:44:37.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:37.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:37.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:37.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj10-1 td/osd-backfill-space/datafile 2024-09-16T04:44:38.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:38.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj10-2 td/osd-backfill-space/datafile 2024-09-16T04:44:38.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:38.512 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:38.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:38.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj11-1 td/osd-backfill-space/datafile 2024-09-16T04:44:38.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:38.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj11-2 td/osd-backfill-space/datafile 2024-09-16T04:44:38.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:38.974 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:38.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:38.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj12-1 td/osd-backfill-space/datafile 2024-09-16T04:44:39.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:39.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj12-2 td/osd-backfill-space/datafile 2024-09-16T04:44:39.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:39.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:39.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:39.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj13-1 td/osd-backfill-space/datafile 2024-09-16T04:44:39.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:39.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj13-2 td/osd-backfill-space/datafile 2024-09-16T04:44:40.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:40.108 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:40.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:40.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj14-1 td/osd-backfill-space/datafile 2024-09-16T04:44:40.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:40.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj14-2 td/osd-backfill-space/datafile 2024-09-16T04:44:40.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:40.662 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:40.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:40.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj15-1 td/osd-backfill-space/datafile 2024-09-16T04:44:40.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:40.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj15-2 td/osd-backfill-space/datafile 2024-09-16T04:44:41.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:41.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:41.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:41.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj16-1 td/osd-backfill-space/datafile 2024-09-16T04:44:41.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:41.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj16-2 td/osd-backfill-space/datafile 2024-09-16T04:44:41.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:41.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:41.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:41.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj17-1 td/osd-backfill-space/datafile 2024-09-16T04:44:42.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:42.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj17-2 td/osd-backfill-space/datafile 2024-09-16T04:44:42.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:42.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:42.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:42.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj18-1 td/osd-backfill-space/datafile 2024-09-16T04:44:42.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:42.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj18-2 td/osd-backfill-space/datafile 2024-09-16T04:44:42.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:42.904 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:42.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:42.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj19-1 td/osd-backfill-space/datafile 2024-09-16T04:44:43.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:43.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj19-2 td/osd-backfill-space/datafile 2024-09-16T04:44:43.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:43.667 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:43.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:43.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj20-1 td/osd-backfill-space/datafile 2024-09-16T04:44:43.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:43.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj20-2 td/osd-backfill-space/datafile 2024-09-16T04:44:44.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:44.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:44.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:44.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj21-1 td/osd-backfill-space/datafile 2024-09-16T04:44:44.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:44.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj21-2 td/osd-backfill-space/datafile 2024-09-16T04:44:44.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:44.801 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:44.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:44.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj22-1 td/osd-backfill-space/datafile 2024-09-16T04:44:45.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:45.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj22-2 td/osd-backfill-space/datafile 2024-09-16T04:44:45.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:45.312 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:45.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:45.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj23-1 td/osd-backfill-space/datafile 2024-09-16T04:44:45.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:45.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj23-2 td/osd-backfill-space/datafile 2024-09-16T04:44:45.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:45.919 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:45.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:45.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj24-1 td/osd-backfill-space/datafile 2024-09-16T04:44:46.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:46.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj24-2 td/osd-backfill-space/datafile 2024-09-16T04:44:46.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:46.507 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:46.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:46.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj25-1 td/osd-backfill-space/datafile 2024-09-16T04:44:46.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:46.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj25-2 td/osd-backfill-space/datafile 2024-09-16T04:44:47.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:47.078 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:47.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:47.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj26-1 td/osd-backfill-space/datafile 2024-09-16T04:44:47.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:47.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj26-2 td/osd-backfill-space/datafile 2024-09-16T04:44:47.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:47.641 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:47.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:47.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj27-1 td/osd-backfill-space/datafile 2024-09-16T04:44:47.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:47.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj27-2 td/osd-backfill-space/datafile 2024-09-16T04:44:48.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:48.253 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:48.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:48.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj28-1 td/osd-backfill-space/datafile 2024-09-16T04:44:48.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:48.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj28-2 td/osd-backfill-space/datafile 2024-09-16T04:44:48.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:48.716 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:48.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:48.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj29-1 td/osd-backfill-space/datafile 2024-09-16T04:44:48.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:48.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj29-2 td/osd-backfill-space/datafile 2024-09-16T04:44:49.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:49.278 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:49.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:49.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj30-1 td/osd-backfill-space/datafile 2024-09-16T04:44:49.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:49.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj30-2 td/osd-backfill-space/datafile 2024-09-16T04:44:49.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:49.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:49.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:49.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj31-1 td/osd-backfill-space/datafile 2024-09-16T04:44:50.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:50.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj31-2 td/osd-backfill-space/datafile 2024-09-16T04:44:50.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:50.398 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:50.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:50.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj32-1 td/osd-backfill-space/datafile 2024-09-16T04:44:50.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:50.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj32-2 td/osd-backfill-space/datafile 2024-09-16T04:44:50.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:50.991 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:50.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:50.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj33-1 td/osd-backfill-space/datafile 2024-09-16T04:44:51.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:51.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj33-2 td/osd-backfill-space/datafile 2024-09-16T04:44:51.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:51.604 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:51.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:51.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj34-1 td/osd-backfill-space/datafile 2024-09-16T04:44:51.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:51.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj34-2 td/osd-backfill-space/datafile 2024-09-16T04:44:52.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:52.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:52.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:52.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj35-1 td/osd-backfill-space/datafile 2024-09-16T04:44:52.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:52.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj35-2 td/osd-backfill-space/datafile 2024-09-16T04:44:52.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:52.582 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:52.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:52.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj36-1 td/osd-backfill-space/datafile 2024-09-16T04:44:52.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:52.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj36-2 td/osd-backfill-space/datafile 2024-09-16T04:44:53.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:53.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:53.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:53.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj37-1 td/osd-backfill-space/datafile 2024-09-16T04:44:53.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:53.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj37-2 td/osd-backfill-space/datafile 2024-09-16T04:44:53.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:53.679 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:53.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:53.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj38-1 td/osd-backfill-space/datafile 2024-09-16T04:44:53.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:53.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj38-2 td/osd-backfill-space/datafile 2024-09-16T04:44:54.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:54.267 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:54.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:54.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj39-1 td/osd-backfill-space/datafile 2024-09-16T04:44:54.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:54.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj39-2 td/osd-backfill-space/datafile 2024-09-16T04:44:54.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:54.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:54.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:54.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj40-1 td/osd-backfill-space/datafile 2024-09-16T04:44:55.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:55.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj40-2 td/osd-backfill-space/datafile 2024-09-16T04:44:55.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:55.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:55.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:55.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj41-1 td/osd-backfill-space/datafile 2024-09-16T04:44:55.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:55.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj41-2 td/osd-backfill-space/datafile 2024-09-16T04:44:55.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:55.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:55.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:55.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj42-1 td/osd-backfill-space/datafile 2024-09-16T04:44:56.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:56.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj42-2 td/osd-backfill-space/datafile 2024-09-16T04:44:56.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:56.510 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:56.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:56.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj43-1 td/osd-backfill-space/datafile 2024-09-16T04:44:56.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:56.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj43-2 td/osd-backfill-space/datafile 2024-09-16T04:44:56.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:56.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:56.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:56.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj44-1 td/osd-backfill-space/datafile 2024-09-16T04:44:57.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:57.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj44-2 td/osd-backfill-space/datafile 2024-09-16T04:44:57.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:57.560 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj45-1 td/osd-backfill-space/datafile 2024-09-16T04:44:57.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:57.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj45-2 td/osd-backfill-space/datafile 2024-09-16T04:44:58.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:58.123 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:58.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:58.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj46-1 td/osd-backfill-space/datafile 2024-09-16T04:44:58.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:58.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj46-2 td/osd-backfill-space/datafile 2024-09-16T04:44:58.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:58.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:58.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:58.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj47-1 td/osd-backfill-space/datafile 2024-09-16T04:44:58.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:58.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj47-2 td/osd-backfill-space/datafile 2024-09-16T04:44:59.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:59.206 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:59.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:59.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj48-1 td/osd-backfill-space/datafile 2024-09-16T04:44:59.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:59.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj48-2 td/osd-backfill-space/datafile 2024-09-16T04:44:59.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:44:59.760 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:44:59.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:44:59.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj49-1 td/osd-backfill-space/datafile 2024-09-16T04:45:00.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:00.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj49-2 td/osd-backfill-space/datafile 2024-09-16T04:45:00.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:00.231 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:00.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:00.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj50-1 td/osd-backfill-space/datafile 2024-09-16T04:45:00.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:00.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj50-2 td/osd-backfill-space/datafile 2024-09-16T04:45:00.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:00.835 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:00.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:00.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj51-1 td/osd-backfill-space/datafile 2024-09-16T04:45:01.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:01.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj51-2 td/osd-backfill-space/datafile 2024-09-16T04:45:01.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:01.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:01.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:01.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj52-1 td/osd-backfill-space/datafile 2024-09-16T04:45:01.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:01.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj52-2 td/osd-backfill-space/datafile 2024-09-16T04:45:01.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:01.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:01.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:01.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj53-1 td/osd-backfill-space/datafile 2024-09-16T04:45:02.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:02.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj53-2 td/osd-backfill-space/datafile 2024-09-16T04:45:02.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:02.458 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:02.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:02.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj54-1 td/osd-backfill-space/datafile 2024-09-16T04:45:02.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:02.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj54-2 td/osd-backfill-space/datafile 2024-09-16T04:45:02.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:02.978 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:02.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:02.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj55-1 td/osd-backfill-space/datafile 2024-09-16T04:45:03.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:03.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj55-2 td/osd-backfill-space/datafile 2024-09-16T04:45:03.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:03.462 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:03.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:03.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj56-1 td/osd-backfill-space/datafile 2024-09-16T04:45:03.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:03.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj56-2 td/osd-backfill-space/datafile 2024-09-16T04:45:04.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:04.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:04.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:04.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj57-1 td/osd-backfill-space/datafile 2024-09-16T04:45:04.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:04.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj57-2 td/osd-backfill-space/datafile 2024-09-16T04:45:04.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:04.699 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:04.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:04.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj58-1 td/osd-backfill-space/datafile 2024-09-16T04:45:04.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:04.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj58-2 td/osd-backfill-space/datafile 2024-09-16T04:45:05.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:05.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:05.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:05.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj59-1 td/osd-backfill-space/datafile 2024-09-16T04:45:05.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:05.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj59-2 td/osd-backfill-space/datafile 2024-09-16T04:45:05.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:05.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:05.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:05.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj60-1 td/osd-backfill-space/datafile 2024-09-16T04:45:06.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:06.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj60-2 td/osd-backfill-space/datafile 2024-09-16T04:45:06.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:06.287 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:06.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:06.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj61-1 td/osd-backfill-space/datafile 2024-09-16T04:45:06.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:06.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj61-2 td/osd-backfill-space/datafile 2024-09-16T04:45:06.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:06.766 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:06.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:06.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj62-1 td/osd-backfill-space/datafile 2024-09-16T04:45:07.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:07.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj62-2 td/osd-backfill-space/datafile 2024-09-16T04:45:07.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:07.398 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:07.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:07.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj63-1 td/osd-backfill-space/datafile 2024-09-16T04:45:07.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:07.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj63-2 td/osd-backfill-space/datafile 2024-09-16T04:45:07.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:07.953 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:07.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:07.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj64-1 td/osd-backfill-space/datafile 2024-09-16T04:45:08.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:08.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj64-2 td/osd-backfill-space/datafile 2024-09-16T04:45:08.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:08.429 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:08.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:08.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj65-1 td/osd-backfill-space/datafile 2024-09-16T04:45:08.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:08.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj65-2 td/osd-backfill-space/datafile 2024-09-16T04:45:09.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:09.025 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:09.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:09.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj66-1 td/osd-backfill-space/datafile 2024-09-16T04:45:09.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:09.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj66-2 td/osd-backfill-space/datafile 2024-09-16T04:45:09.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:09.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:09.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:09.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj67-1 td/osd-backfill-space/datafile 2024-09-16T04:45:09.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:09.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj67-2 td/osd-backfill-space/datafile 2024-09-16T04:45:10.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:10.059 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:10.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:10.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj68-1 td/osd-backfill-space/datafile 2024-09-16T04:45:10.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:10.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj68-2 td/osd-backfill-space/datafile 2024-09-16T04:45:10.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:10.655 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:10.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:10.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj69-1 td/osd-backfill-space/datafile 2024-09-16T04:45:10.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:10.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj69-2 td/osd-backfill-space/datafile 2024-09-16T04:45:11.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:11.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:11.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:11.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj70-1 td/osd-backfill-space/datafile 2024-09-16T04:45:11.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:11.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj70-2 td/osd-backfill-space/datafile 2024-09-16T04:45:11.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:11.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:11.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:11.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj71-1 td/osd-backfill-space/datafile 2024-09-16T04:45:12.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:12.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj71-2 td/osd-backfill-space/datafile 2024-09-16T04:45:12.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:12.326 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:12.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:12.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj72-1 td/osd-backfill-space/datafile 2024-09-16T04:45:12.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:12.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj72-2 td/osd-backfill-space/datafile 2024-09-16T04:45:12.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:12.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:12.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:12.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj73-1 td/osd-backfill-space/datafile 2024-09-16T04:45:13.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:13.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj73-2 td/osd-backfill-space/datafile 2024-09-16T04:45:13.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:13.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:13.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:13.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj74-1 td/osd-backfill-space/datafile 2024-09-16T04:45:13.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:13.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj74-2 td/osd-backfill-space/datafile 2024-09-16T04:45:13.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:13.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:13.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:13.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj75-1 td/osd-backfill-space/datafile 2024-09-16T04:45:14.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:14.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj75-2 td/osd-backfill-space/datafile 2024-09-16T04:45:14.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:14.944 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:14.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:14.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj76-1 td/osd-backfill-space/datafile 2024-09-16T04:45:15.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:15.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj76-2 td/osd-backfill-space/datafile 2024-09-16T04:45:15.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:15.448 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:15.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:15.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj77-1 td/osd-backfill-space/datafile 2024-09-16T04:45:15.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:15.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj77-2 td/osd-backfill-space/datafile 2024-09-16T04:45:15.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:15.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:15.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:15.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj78-1 td/osd-backfill-space/datafile 2024-09-16T04:45:16.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:16.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj78-2 td/osd-backfill-space/datafile 2024-09-16T04:45:16.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:16.507 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:16.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:16.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj79-1 td/osd-backfill-space/datafile 2024-09-16T04:45:16.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:16.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj79-2 td/osd-backfill-space/datafile 2024-09-16T04:45:16.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:16.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:16.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:16.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj80-1 td/osd-backfill-space/datafile 2024-09-16T04:45:17.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:17.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj80-2 td/osd-backfill-space/datafile 2024-09-16T04:45:17.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:17.590 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:17.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:17.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj81-1 td/osd-backfill-space/datafile 2024-09-16T04:45:17.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:17.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj81-2 td/osd-backfill-space/datafile 2024-09-16T04:45:18.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:18.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:18.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:18.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj82-1 td/osd-backfill-space/datafile 2024-09-16T04:45:18.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:18.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj82-2 td/osd-backfill-space/datafile 2024-09-16T04:45:18.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:18.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:18.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:18.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj83-1 td/osd-backfill-space/datafile 2024-09-16T04:45:18.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:18.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj83-2 td/osd-backfill-space/datafile 2024-09-16T04:45:19.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:19.219 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:19.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:19.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj84-1 td/osd-backfill-space/datafile 2024-09-16T04:45:19.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:19.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj84-2 td/osd-backfill-space/datafile 2024-09-16T04:45:19.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:19.751 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:19.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:19.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj85-1 td/osd-backfill-space/datafile 2024-09-16T04:45:19.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:19.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj85-2 td/osd-backfill-space/datafile 2024-09-16T04:45:20.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:20.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:20.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:20.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj86-1 td/osd-backfill-space/datafile 2024-09-16T04:45:20.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:20.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj86-2 td/osd-backfill-space/datafile 2024-09-16T04:45:20.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:20.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:20.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:20.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj87-1 td/osd-backfill-space/datafile 2024-09-16T04:45:21.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:21.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj87-2 td/osd-backfill-space/datafile 2024-09-16T04:45:21.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:21.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:21.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:21.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj88-1 td/osd-backfill-space/datafile 2024-09-16T04:45:21.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:21.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj88-2 td/osd-backfill-space/datafile 2024-09-16T04:45:21.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:21.843 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:21.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:21.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj89-1 td/osd-backfill-space/datafile 2024-09-16T04:45:22.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:22.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj89-2 td/osd-backfill-space/datafile 2024-09-16T04:45:22.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:22.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:22.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:22.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj90-1 td/osd-backfill-space/datafile 2024-09-16T04:45:22.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:22.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj90-2 td/osd-backfill-space/datafile 2024-09-16T04:45:23.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:23.001 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:23.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:23.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj91-1 td/osd-backfill-space/datafile 2024-09-16T04:45:23.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:23.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj91-2 td/osd-backfill-space/datafile 2024-09-16T04:45:23.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:23.497 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:23.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:23.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj92-1 td/osd-backfill-space/datafile 2024-09-16T04:45:23.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:23.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj92-2 td/osd-backfill-space/datafile 2024-09-16T04:45:24.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:24.085 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:24.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:24.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj93-1 td/osd-backfill-space/datafile 2024-09-16T04:45:24.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:24.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj93-2 td/osd-backfill-space/datafile 2024-09-16T04:45:24.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:24.614 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:24.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:24.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj94-1 td/osd-backfill-space/datafile 2024-09-16T04:45:24.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:24.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj94-2 td/osd-backfill-space/datafile 2024-09-16T04:45:25.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:25.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:25.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:25.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj95-1 td/osd-backfill-space/datafile 2024-09-16T04:45:25.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:25.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj95-2 td/osd-backfill-space/datafile 2024-09-16T04:45:25.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:25.673 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:25.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:25.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj96-1 td/osd-backfill-space/datafile 2024-09-16T04:45:25.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:25.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj96-2 td/osd-backfill-space/datafile 2024-09-16T04:45:26.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:26.235 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:26.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:26.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj97-1 td/osd-backfill-space/datafile 2024-09-16T04:45:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:26.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj97-2 td/osd-backfill-space/datafile 2024-09-16T04:45:26.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:26.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:26.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:26.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj98-1 td/osd-backfill-space/datafile 2024-09-16T04:45:27.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:27.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj98-2 td/osd-backfill-space/datafile 2024-09-16T04:45:27.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:27.393 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:27.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:27.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj99-1 td/osd-backfill-space/datafile 2024-09-16T04:45:27.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:27.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj99-2 td/osd-backfill-space/datafile 2024-09-16T04:45:27.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:27.931 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:27.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:27.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj100-1 td/osd-backfill-space/datafile 2024-09-16T04:45:28.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:28.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj100-2 td/osd-backfill-space/datafile 2024-09-16T04:45:28.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:28.460 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:28.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:28.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj101-1 td/osd-backfill-space/datafile 2024-09-16T04:45:28.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:28.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj101-2 td/osd-backfill-space/datafile 2024-09-16T04:45:29.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:29.014 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:29.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:29.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj102-1 td/osd-backfill-space/datafile 2024-09-16T04:45:29.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:29.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj102-2 td/osd-backfill-space/datafile 2024-09-16T04:45:29.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:29.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:29.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:29.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj103-1 td/osd-backfill-space/datafile 2024-09-16T04:45:29.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:29.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj103-2 td/osd-backfill-space/datafile 2024-09-16T04:45:30.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:30.107 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:30.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:30.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj104-1 td/osd-backfill-space/datafile 2024-09-16T04:45:30.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:30.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj104-2 td/osd-backfill-space/datafile 2024-09-16T04:45:30.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:30.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:30.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:30.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj105-1 td/osd-backfill-space/datafile 2024-09-16T04:45:30.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:30.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj105-2 td/osd-backfill-space/datafile 2024-09-16T04:45:31.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:31.165 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:31.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:31.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj106-1 td/osd-backfill-space/datafile 2024-09-16T04:45:31.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:31.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj106-2 td/osd-backfill-space/datafile 2024-09-16T04:45:31.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:31.711 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:31.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:31.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj107-1 td/osd-backfill-space/datafile 2024-09-16T04:45:32.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:32.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj107-2 td/osd-backfill-space/datafile 2024-09-16T04:45:32.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:32.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:32.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:32.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj108-1 td/osd-backfill-space/datafile 2024-09-16T04:45:32.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:32.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj108-2 td/osd-backfill-space/datafile 2024-09-16T04:45:32.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:32.862 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:32.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:32.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj109-1 td/osd-backfill-space/datafile 2024-09-16T04:45:33.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:33.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj109-2 td/osd-backfill-space/datafile 2024-09-16T04:45:33.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:33.366 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:33.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:33.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj110-1 td/osd-backfill-space/datafile 2024-09-16T04:45:33.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:33.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj110-2 td/osd-backfill-space/datafile 2024-09-16T04:45:33.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:33.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:33.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:33.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj111-1 td/osd-backfill-space/datafile 2024-09-16T04:45:34.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:34.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj111-2 td/osd-backfill-space/datafile 2024-09-16T04:45:34.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:34.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:34.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:34.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj112-1 td/osd-backfill-space/datafile 2024-09-16T04:45:34.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:34.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj112-2 td/osd-backfill-space/datafile 2024-09-16T04:45:34.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:34.953 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:34.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:34.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj113-1 td/osd-backfill-space/datafile 2024-09-16T04:45:35.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:35.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj113-2 td/osd-backfill-space/datafile 2024-09-16T04:45:35.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:35.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:35.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:35.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj114-1 td/osd-backfill-space/datafile 2024-09-16T04:45:35.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:35.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj114-2 td/osd-backfill-space/datafile 2024-09-16T04:45:36.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:36.054 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:36.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:36.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj115-1 td/osd-backfill-space/datafile 2024-09-16T04:45:36.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:36.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj115-2 td/osd-backfill-space/datafile 2024-09-16T04:45:36.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:36.617 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:36.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:36.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj116-1 td/osd-backfill-space/datafile 2024-09-16T04:45:36.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:36.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj116-2 td/osd-backfill-space/datafile 2024-09-16T04:45:37.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:37.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:37.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:37.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj117-1 td/osd-backfill-space/datafile 2024-09-16T04:45:37.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:37.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj117-2 td/osd-backfill-space/datafile 2024-09-16T04:45:37.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:37.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:37.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:37.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj118-1 td/osd-backfill-space/datafile 2024-09-16T04:45:37.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:37.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj118-2 td/osd-backfill-space/datafile 2024-09-16T04:45:38.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:38.254 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:38.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:38.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj119-1 td/osd-backfill-space/datafile 2024-09-16T04:45:38.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:38.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj119-2 td/osd-backfill-space/datafile 2024-09-16T04:45:38.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:38.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:38.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:38.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj120-1 td/osd-backfill-space/datafile 2024-09-16T04:45:39.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:39.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj120-2 td/osd-backfill-space/datafile 2024-09-16T04:45:39.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:39.338 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:39.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:39.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj121-1 td/osd-backfill-space/datafile 2024-09-16T04:45:39.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:39.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj121-2 td/osd-backfill-space/datafile 2024-09-16T04:45:39.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:39.800 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:39.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:39.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj122-1 td/osd-backfill-space/datafile 2024-09-16T04:45:40.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:40.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj122-2 td/osd-backfill-space/datafile 2024-09-16T04:45:40.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:40.321 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:40.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:40.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj123-1 td/osd-backfill-space/datafile 2024-09-16T04:45:40.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:40.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj123-2 td/osd-backfill-space/datafile 2024-09-16T04:45:40.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:40.917 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:40.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:40.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj124-1 td/osd-backfill-space/datafile 2024-09-16T04:45:41.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:41.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj124-2 td/osd-backfill-space/datafile 2024-09-16T04:45:41.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:41.472 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:41.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:41.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj125-1 td/osd-backfill-space/datafile 2024-09-16T04:45:41.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:41.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj125-2 td/osd-backfill-space/datafile 2024-09-16T04:45:42.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:42.034 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:42.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:42.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj126-1 td/osd-backfill-space/datafile 2024-09-16T04:45:42.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:42.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj126-2 td/osd-backfill-space/datafile 2024-09-16T04:45:42.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:42.538 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:42.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:42.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj127-1 td/osd-backfill-space/datafile 2024-09-16T04:45:42.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:42.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj127-2 td/osd-backfill-space/datafile 2024-09-16T04:45:43.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:43.025 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:43.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:43.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj128-1 td/osd-backfill-space/datafile 2024-09-16T04:45:43.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:43.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj128-2 td/osd-backfill-space/datafile 2024-09-16T04:45:43.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:43.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:43.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:43.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj129-1 td/osd-backfill-space/datafile 2024-09-16T04:45:43.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:43.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj129-2 td/osd-backfill-space/datafile 2024-09-16T04:45:44.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:44.176 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:44.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:44.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj130-1 td/osd-backfill-space/datafile 2024-09-16T04:45:44.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:44.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj130-2 td/osd-backfill-space/datafile 2024-09-16T04:45:44.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:44.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:44.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:44.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj131-1 td/osd-backfill-space/datafile 2024-09-16T04:45:44.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:44.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj131-2 td/osd-backfill-space/datafile 2024-09-16T04:45:45.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:45.234 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:45.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:45.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj132-1 td/osd-backfill-space/datafile 2024-09-16T04:45:45.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:45.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj132-2 td/osd-backfill-space/datafile 2024-09-16T04:45:46.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:46.164 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:46.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:46.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj133-1 td/osd-backfill-space/datafile 2024-09-16T04:45:46.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:46.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj133-2 td/osd-backfill-space/datafile 2024-09-16T04:45:46.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:46.677 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:46.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:46.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj134-1 td/osd-backfill-space/datafile 2024-09-16T04:45:46.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:46.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj134-2 td/osd-backfill-space/datafile 2024-09-16T04:45:47.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:47.314 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:47.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:47.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj135-1 td/osd-backfill-space/datafile 2024-09-16T04:45:47.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:47.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj135-2 td/osd-backfill-space/datafile 2024-09-16T04:45:47.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:47.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:47.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:47.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj136-1 td/osd-backfill-space/datafile 2024-09-16T04:45:48.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:48.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj136-2 td/osd-backfill-space/datafile 2024-09-16T04:45:48.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:48.364 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:48.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:48.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj137-1 td/osd-backfill-space/datafile 2024-09-16T04:45:48.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:48.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj137-2 td/osd-backfill-space/datafile 2024-09-16T04:45:48.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:48.935 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:48.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:48.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj138-1 td/osd-backfill-space/datafile 2024-09-16T04:45:49.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:49.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj138-2 td/osd-backfill-space/datafile 2024-09-16T04:45:49.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:49.464 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:49.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:49.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj139-1 td/osd-backfill-space/datafile 2024-09-16T04:45:49.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:49.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj139-2 td/osd-backfill-space/datafile 2024-09-16T04:45:49.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:49.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:49.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:49.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj140-1 td/osd-backfill-space/datafile 2024-09-16T04:45:50.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:50.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj140-2 td/osd-backfill-space/datafile 2024-09-16T04:45:50.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:50.525 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:50.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:50.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj141-1 td/osd-backfill-space/datafile 2024-09-16T04:45:50.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:50.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj141-2 td/osd-backfill-space/datafile 2024-09-16T04:45:51.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:51.088 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:51.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:51.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj142-1 td/osd-backfill-space/datafile 2024-09-16T04:45:51.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:51.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj142-2 td/osd-backfill-space/datafile 2024-09-16T04:45:51.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:51.609 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:51.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:51.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj143-1 td/osd-backfill-space/datafile 2024-09-16T04:45:51.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:51.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj143-2 td/osd-backfill-space/datafile 2024-09-16T04:45:52.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:52.280 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:52.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:52.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj144-1 td/osd-backfill-space/datafile 2024-09-16T04:45:52.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:52.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj144-2 td/osd-backfill-space/datafile 2024-09-16T04:45:52.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:52.817 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:52.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:52.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj145-1 td/osd-backfill-space/datafile 2024-09-16T04:45:53.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:53.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj145-2 td/osd-backfill-space/datafile 2024-09-16T04:45:53.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:53.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:53.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:53.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj146-1 td/osd-backfill-space/datafile 2024-09-16T04:45:53.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:53.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj146-2 td/osd-backfill-space/datafile 2024-09-16T04:45:53.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:53.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:53.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:53.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj147-1 td/osd-backfill-space/datafile 2024-09-16T04:45:54.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:54.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj147-2 td/osd-backfill-space/datafile 2024-09-16T04:45:54.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:54.355 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:54.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:54.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj148-1 td/osd-backfill-space/datafile 2024-09-16T04:45:54.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:54.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj148-2 td/osd-backfill-space/datafile 2024-09-16T04:45:54.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:54.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:54.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:54.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj149-1 td/osd-backfill-space/datafile 2024-09-16T04:45:55.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:55.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj149-2 td/osd-backfill-space/datafile 2024-09-16T04:45:55.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:55.430 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:55.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:55.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj150-1 td/osd-backfill-space/datafile 2024-09-16T04:45:55.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:55.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj150-2 td/osd-backfill-space/datafile 2024-09-16T04:45:55.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:55.935 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:55.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:55.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj151-1 td/osd-backfill-space/datafile 2024-09-16T04:45:56.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:56.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj151-2 td/osd-backfill-space/datafile 2024-09-16T04:45:56.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:56.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:56.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:56.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj152-1 td/osd-backfill-space/datafile 2024-09-16T04:45:56.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:56.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj152-2 td/osd-backfill-space/datafile 2024-09-16T04:45:57.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:57.002 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:57.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:57.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj153-1 td/osd-backfill-space/datafile 2024-09-16T04:45:57.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:57.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj153-2 td/osd-backfill-space/datafile 2024-09-16T04:45:57.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:57.514 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:57.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:57.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj154-1 td/osd-backfill-space/datafile 2024-09-16T04:45:57.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:57.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj154-2 td/osd-backfill-space/datafile 2024-09-16T04:45:58.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:58.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:58.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:58.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj155-1 td/osd-backfill-space/datafile 2024-09-16T04:45:58.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:58.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj155-2 td/osd-backfill-space/datafile 2024-09-16T04:45:58.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:58.598 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:58.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:58.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj156-1 td/osd-backfill-space/datafile 2024-09-16T04:45:58.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:58.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj156-2 td/osd-backfill-space/datafile 2024-09-16T04:45:59.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:59.093 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:59.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:59.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj157-1 td/osd-backfill-space/datafile 2024-09-16T04:45:59.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:59.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj157-2 td/osd-backfill-space/datafile 2024-09-16T04:45:59.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:45:59.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:45:59.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:59.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj158-1 td/osd-backfill-space/datafile 2024-09-16T04:45:59.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:45:59.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj158-2 td/osd-backfill-space/datafile 2024-09-16T04:46:00.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:00.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:00.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:00.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj159-1 td/osd-backfill-space/datafile 2024-09-16T04:46:00.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:00.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj159-2 td/osd-backfill-space/datafile 2024-09-16T04:46:00.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:00.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:00.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:00.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj160-1 td/osd-backfill-space/datafile 2024-09-16T04:46:00.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:00.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj160-2 td/osd-backfill-space/datafile 2024-09-16T04:46:01.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:01.218 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:01.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:01.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj161-1 td/osd-backfill-space/datafile 2024-09-16T04:46:01.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:01.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj161-2 td/osd-backfill-space/datafile 2024-09-16T04:46:01.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:01.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:01.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:01.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj162-1 td/osd-backfill-space/datafile 2024-09-16T04:46:02.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:02.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj162-2 td/osd-backfill-space/datafile 2024-09-16T04:46:02.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:02.436 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:02.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:02.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj163-1 td/osd-backfill-space/datafile 2024-09-16T04:46:02.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:02.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj163-2 td/osd-backfill-space/datafile 2024-09-16T04:46:02.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:02.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:02.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:02.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj164-1 td/osd-backfill-space/datafile 2024-09-16T04:46:03.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:03.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj164-2 td/osd-backfill-space/datafile 2024-09-16T04:46:03.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:03.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:03.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:03.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj165-1 td/osd-backfill-space/datafile 2024-09-16T04:46:03.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:03.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj165-2 td/osd-backfill-space/datafile 2024-09-16T04:46:03.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:03.981 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:03.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:03.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj166-1 td/osd-backfill-space/datafile 2024-09-16T04:46:04.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:04.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj166-2 td/osd-backfill-space/datafile 2024-09-16T04:46:04.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:04.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:04.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:04.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj167-1 td/osd-backfill-space/datafile 2024-09-16T04:46:04.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:04.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj167-2 td/osd-backfill-space/datafile 2024-09-16T04:46:05.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:05.107 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:05.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:05.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj168-1 td/osd-backfill-space/datafile 2024-09-16T04:46:05.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:05.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj168-2 td/osd-backfill-space/datafile 2024-09-16T04:46:05.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:05.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:05.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:05.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj169-1 td/osd-backfill-space/datafile 2024-09-16T04:46:05.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:05.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj169-2 td/osd-backfill-space/datafile 2024-09-16T04:46:06.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:06.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:06.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:06.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj170-1 td/osd-backfill-space/datafile 2024-09-16T04:46:06.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:06.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj170-2 td/osd-backfill-space/datafile 2024-09-16T04:46:06.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:06.712 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:06.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:06.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj171-1 td/osd-backfill-space/datafile 2024-09-16T04:46:06.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:06.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj171-2 td/osd-backfill-space/datafile 2024-09-16T04:46:07.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:07.140 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:07.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:07.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj172-1 td/osd-backfill-space/datafile 2024-09-16T04:46:07.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:07.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj172-2 td/osd-backfill-space/datafile 2024-09-16T04:46:07.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:07.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:07.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:07.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj173-1 td/osd-backfill-space/datafile 2024-09-16T04:46:08.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:08.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj173-2 td/osd-backfill-space/datafile 2024-09-16T04:46:08.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:08.274 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:08.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:08.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj174-1 td/osd-backfill-space/datafile 2024-09-16T04:46:08.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:08.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj174-2 td/osd-backfill-space/datafile 2024-09-16T04:46:08.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:08.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:08.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:08.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj175-1 td/osd-backfill-space/datafile 2024-09-16T04:46:09.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:09.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj175-2 td/osd-backfill-space/datafile 2024-09-16T04:46:09.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:09.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:09.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:09.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj176-1 td/osd-backfill-space/datafile 2024-09-16T04:46:09.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:09.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj176-2 td/osd-backfill-space/datafile 2024-09-16T04:46:09.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:09.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:09.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:09.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj177-1 td/osd-backfill-space/datafile 2024-09-16T04:46:10.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:10.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj177-2 td/osd-backfill-space/datafile 2024-09-16T04:46:10.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:10.399 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:10.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:10.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj178-1 td/osd-backfill-space/datafile 2024-09-16T04:46:10.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:10.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj178-2 td/osd-backfill-space/datafile 2024-09-16T04:46:10.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:10.919 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:10.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:10.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj179-1 td/osd-backfill-space/datafile 2024-09-16T04:46:11.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:11.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj179-2 td/osd-backfill-space/datafile 2024-09-16T04:46:11.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:11.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:11.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:11.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj180-1 td/osd-backfill-space/datafile 2024-09-16T04:46:11.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:11.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj180-2 td/osd-backfill-space/datafile 2024-09-16T04:46:11.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:11.978 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:11.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:11.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj181-1 td/osd-backfill-space/datafile 2024-09-16T04:46:12.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:12.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj181-2 td/osd-backfill-space/datafile 2024-09-16T04:46:12.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:12.533 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:12.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:12.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj182-1 td/osd-backfill-space/datafile 2024-09-16T04:46:12.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:12.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj182-2 td/osd-backfill-space/datafile 2024-09-16T04:46:13.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:13.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:13.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:13.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj183-1 td/osd-backfill-space/datafile 2024-09-16T04:46:13.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:13.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj183-2 td/osd-backfill-space/datafile 2024-09-16T04:46:13.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:13.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:13.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:13.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj184-1 td/osd-backfill-space/datafile 2024-09-16T04:46:13.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:13.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj184-2 td/osd-backfill-space/datafile 2024-09-16T04:46:14.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:14.187 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:14.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:14.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj185-1 td/osd-backfill-space/datafile 2024-09-16T04:46:14.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:14.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj185-2 td/osd-backfill-space/datafile 2024-09-16T04:46:14.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:14.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:14.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:14.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj186-1 td/osd-backfill-space/datafile 2024-09-16T04:46:14.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:14.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj186-2 td/osd-backfill-space/datafile 2024-09-16T04:46:15.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:15.212 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:15.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:15.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj187-1 td/osd-backfill-space/datafile 2024-09-16T04:46:15.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:15.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj187-2 td/osd-backfill-space/datafile 2024-09-16T04:46:15.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:15.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:15.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:15.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj188-1 td/osd-backfill-space/datafile 2024-09-16T04:46:16.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:16.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj188-2 td/osd-backfill-space/datafile 2024-09-16T04:46:16.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:16.339 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:16.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:16.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj189-1 td/osd-backfill-space/datafile 2024-09-16T04:46:16.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:16.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj189-2 td/osd-backfill-space/datafile 2024-09-16T04:46:16.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:16.809 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:16.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:16.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj190-1 td/osd-backfill-space/datafile 2024-09-16T04:46:17.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:17.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj190-2 td/osd-backfill-space/datafile 2024-09-16T04:46:17.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:17.797 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:17.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:17.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj191-1 td/osd-backfill-space/datafile 2024-09-16T04:46:18.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:18.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj191-2 td/osd-backfill-space/datafile 2024-09-16T04:46:18.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:18.376 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:18.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:18.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj192-1 td/osd-backfill-space/datafile 2024-09-16T04:46:18.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:18.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj192-2 td/osd-backfill-space/datafile 2024-09-16T04:46:18.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:18.864 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:18.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:18.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj193-1 td/osd-backfill-space/datafile 2024-09-16T04:46:19.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:19.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj193-2 td/osd-backfill-space/datafile 2024-09-16T04:46:19.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:19.427 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:19.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:19.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj194-1 td/osd-backfill-space/datafile 2024-09-16T04:46:19.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:19.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj194-2 td/osd-backfill-space/datafile 2024-09-16T04:46:19.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:19.986 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:19.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:19.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj195-1 td/osd-backfill-space/datafile 2024-09-16T04:46:20.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:20.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj195-2 td/osd-backfill-space/datafile 2024-09-16T04:46:20.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:20.498 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:20.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:20.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj196-1 td/osd-backfill-space/datafile 2024-09-16T04:46:20.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:20.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj196-2 td/osd-backfill-space/datafile 2024-09-16T04:46:21.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:21.019 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:21.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:21.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj197-1 td/osd-backfill-space/datafile 2024-09-16T04:46:21.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:21.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj197-2 td/osd-backfill-space/datafile 2024-09-16T04:46:21.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:21.613 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:21.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:21.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj198-1 td/osd-backfill-space/datafile 2024-09-16T04:46:21.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:21.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj198-2 td/osd-backfill-space/datafile 2024-09-16T04:46:22.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:22.149 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:22.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:22.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj199-1 td/osd-backfill-space/datafile 2024-09-16T04:46:22.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:22.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj199-2 td/osd-backfill-space/datafile 2024-09-16T04:46:22.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:806: TEST_ec_backfill_multi: for o in $(seq 1 $ecobjects) 2024-09-16T04:46:22.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:22.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:22.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test1 put obj200-1 td/osd-backfill-space/datafile 2024-09-16T04:46:22.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:808: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:22.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:810: TEST_ec_backfill_multi: rados -p test2 put obj200-2 td/osd-backfill-space/datafile 2024-09-16T04:46:23.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:814: TEST_ec_backfill_multi: ceph pg dump pgs 2024-09-16T04:46:23.517 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:46:23.517 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 196 0 0 0 0 2408448 0 0 96 100 96 active+clean 2024-09-16T04:44:19.130315+0000 53'196 53:212 [0,2,3,4,5] 0 [0,2,3,4,5] 0 0'0 2024-09-16T04:44:15.958635+0000 0'0 2024-09-16T04:44:15.958635+0000 0 0 periodic scrub scheduled @ 2024-09-17T14:42:12.082525+0000 0 0 2024-09-16T04:46:23.517 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 196 0 0 0 0 2408448 0 0 96 100 96 active+clean 2024-09-16T04:44:17.260875+0000 53'196 53:219 [0,2,3,4,5] 0 [0,2,3,4,5] 0 0'0 2024-09-16T04:44:14.300564+0000 0'0 2024-09-16T04:44:14.300564+0000 0 0 periodic scrub scheduled @ 2024-09-17T08:07:19.025487+0000 0 0 2024-09-16T04:46:23.517 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 200 0 0 0 0 1843200 0 0 100 100 100 active+clean 2024-09-16T04:43:53.803308+0000 41'200 54:248 [1] 1 [1] 1 0'0 2024-09-16T04:43:51.098014+0000 0'0 2024-09-16T04:43:51.098014+0000 0 0 periodic scrub scheduled @ 2024-09-17T16:16:15.594480+0000 0 0 2024-09-16T04:46:23.518 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:46:23.518 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:46:23.518 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:46:23.528 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:816: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:46:23.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:816: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:23.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:818: TEST_ec_backfill_multi: expr 1 + 1 2024-09-16T04:46:23.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:818: TEST_ec_backfill_multi: ceph osd pg-upmap 2.0 0 2 3 4 1 2024-09-16T04:46:24.287 INFO:tasks.workunit.client.0.smithi026.stderr:set 2.0 pg_upmap mapping to [0,2,3,4,1] 2024-09-16T04:46:24.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:816: TEST_ec_backfill_multi: for p in $(seq 1 $pools) 2024-09-16T04:46:24.299 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:818: TEST_ec_backfill_multi: expr 2 + 1 2024-09-16T04:46:24.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:818: TEST_ec_backfill_multi: ceph osd pg-upmap 3.0 0 2 3 4 1 2024-09-16T04:46:25.744 INFO:tasks.workunit.client.0.smithi026.stderr:set 3.0 pg_upmap mapping to [0,2,3,4,1] 2024-09-16T04:46:25.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:821: TEST_ec_backfill_multi: sleep 30 2024-09-16T04:46:55.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:823: TEST_ec_backfill_multi: wait_for_not_backfilling 1200 2024-09-16T04:46:55.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:83: wait_for_not_backfilling: local timeout=1200 2024-09-16T04:46:55.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:84: wait_for_not_backfilling: wait_for_not_state backfilling 1200 2024-09-16T04:46:55.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=backfilling 2024-09-16T04:46:55.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-09-16T04:46:55.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-09-16T04:46:55.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 1200 5 2024-09-16T04:46:55.762 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:46:55.763 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:46:55.763 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:46:55.763 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:46:55.763 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:46:56.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15') 2024-09-16T04:46:56.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-09-16T04:46:56.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-09-16T04:46:56.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-09-16T04:46:56.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:46:56.365 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:46:56.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:46:56.808 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:46:56.808 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:46:56.808 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:46:56.808 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T04:46:56.808 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T04:46:56.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:46:56.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:46:56.808 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:46:56.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836557 2024-09-16T04:46:56.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836557 2024-09-16T04:46:56.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836557' 2024-09-16T04:46:56.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:46:56.931 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:46:57.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673030 2024-09-16T04:46:57.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673030 2024-09-16T04:46:57.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836557 1-42949673030' 2024-09-16T04:46:57.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:46:57.054 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:46:57.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509508 2024-09-16T04:46:57.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509508 2024-09-16T04:46:57.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836557 1-42949673030 2-64424509508' 2024-09-16T04:46:57.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:46:57.177 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:46:57.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345978 2024-09-16T04:46:57.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345978 2024-09-16T04:46:57.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836557 1-42949673030 2-64424509508 3-85899345978' 2024-09-16T04:46:57.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:46:57.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:46:57.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182450 2024-09-16T04:46:57.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182450 2024-09-16T04:46:57.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836557 1-42949673030 2-64424509508 3-85899345978 4-107374182450' 2024-09-16T04:46:57.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:46:57.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T04:46:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018921 2024-09-16T04:46:57.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018921 2024-09-16T04:46:57.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836557 1-42949673030 2-64424509508 3-85899345978 4-107374182450 5-128849018921' 2024-09-16T04:46:57.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:46:57.562 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836557 2024-09-16T04:46:57.562 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:46:57.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:46:57.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836557 2024-09-16T04:46:57.563 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:46:57.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836557 2024-09-16T04:46:57.564 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836557 2024-09-16T04:46:57.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836557' 2024-09-16T04:46:57.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:46:58.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836555 -lt 21474836557 2024-09-16T04:46:58.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:46:59.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:46:59.012 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:46:59.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836557 -lt 21474836557 2024-09-16T04:46:59.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:46:59.468 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673030 2024-09-16T04:46:59.468 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:46:59.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:46:59.469 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673030 2024-09-16T04:46:59.469 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:46:59.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673030 2024-09-16T04:46:59.470 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673030 2024-09-16T04:46:59.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673030' 2024-09-16T04:46:59.471 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:46:59.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673031 -lt 42949673030 2024-09-16T04:46:59.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:46:59.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509508 2024-09-16T04:46:59.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:46:59.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:46:59.915 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509508 2024-09-16T04:46:59.915 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:46:59.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509508 2024-09-16T04:46:59.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509508' 2024-09-16T04:46:59.917 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509508 2024-09-16T04:46:59.917 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:47:00.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509509 -lt 64424509508 2024-09-16T04:47:00.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:47:00.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345978 2024-09-16T04:47:00.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:47:00.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:47:00.359 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345978 2024-09-16T04:47:00.359 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:47:00.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345978 2024-09-16T04:47:00.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345978' 2024-09-16T04:47:00.360 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345978 2024-09-16T04:47:00.360 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:47:00.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345979 -lt 85899345978 2024-09-16T04:47:00.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:47:00.800 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182450 2024-09-16T04:47:00.800 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:47:00.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:47:00.802 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182450 2024-09-16T04:47:00.802 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:47:00.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182450 2024-09-16T04:47:00.803 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182450 2024-09-16T04:47:00.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182450' 2024-09-16T04:47:00.803 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:47:01.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182451 -lt 107374182450 2024-09-16T04:47:01.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:47:01.243 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018921 2024-09-16T04:47:01.244 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:47:01.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T04:47:01.245 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018921 2024-09-16T04:47:01.245 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:47:01.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018921 2024-09-16T04:47:01.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018921' 2024-09-16T04:47:01.247 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018921 2024-09-16T04:47:01.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T04:47:01.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018922 -lt 128849018921 2024-09-16T04:47:01.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-09-16T04:47:01.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:47:01.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:47:02.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 3 == 0 2024-09-16T04:47:02.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:47:02.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:47:02.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:47:02.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:47:02.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:47:02.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:47:02.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:47:02.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-09-16T04:47:02.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-09-16T04:47:02.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-09-16T04:47:02.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-09-16T04:47:02.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:824: TEST_ec_backfill_multi: wait_for_not_activating 60 2024-09-16T04:47:02.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:89: wait_for_not_activating: local timeout=60 2024-09-16T04:47:02.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:90: wait_for_not_activating: wait_for_not_state activating 60 2024-09-16T04:47:02.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=activating 2024-09-16T04:47:02.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-09-16T04:47:02.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-09-16T04:47:02.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 60 5 2024-09-16T04:47:02.665 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:47:02.665 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:47:02.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:47:02.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:47:02.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:47:02.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15') 2024-09-16T04:47:02.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-09-16T04:47:02.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-09-16T04:47:02.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-09-16T04:47:02.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:47:02.707 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:47:03.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:47:03.147 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:47:03.147 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:47:03.148 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:47:03.148 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T04:47:03.148 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T04:47:03.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:47:03.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:47:03.148 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:47:03.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836560 2024-09-16T04:47:03.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836560 2024-09-16T04:47:03.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836560' 2024-09-16T04:47:03.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:47:03.273 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:47:03.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673034 2024-09-16T04:47:03.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673034 2024-09-16T04:47:03.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836560 1-42949673034' 2024-09-16T04:47:03.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:47:03.405 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:47:03.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509512 2024-09-16T04:47:03.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509512 2024-09-16T04:47:03.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836560 1-42949673034 2-64424509512' 2024-09-16T04:47:03.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:47:03.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:47:03.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345981 2024-09-16T04:47:03.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345981 2024-09-16T04:47:03.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836560 1-42949673034 2-64424509512 3-85899345981' 2024-09-16T04:47:03.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:47:03.654 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:47:03.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182453 2024-09-16T04:47:03.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182453 2024-09-16T04:47:03.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836560 1-42949673034 2-64424509512 3-85899345981 4-107374182453' 2024-09-16T04:47:03.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:47:03.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T04:47:03.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018924 2024-09-16T04:47:03.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018924 2024-09-16T04:47:03.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836560 1-42949673034 2-64424509512 3-85899345981 4-107374182453 5-128849018924' 2024-09-16T04:47:03.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:47:03.900 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836560 2024-09-16T04:47:03.900 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:47:03.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:47:03.901 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836560 2024-09-16T04:47:03.901 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:47:03.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836560 2024-09-16T04:47:03.902 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836560 2024-09-16T04:47:03.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836560' 2024-09-16T04:47:03.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:47:04.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836558 -lt 21474836560 2024-09-16T04:47:04.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:47:05.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:47:05.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:47:05.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836560 -lt 21474836560 2024-09-16T04:47:05.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:47:05.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673034 2024-09-16T04:47:05.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:47:05.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:47:05.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673034 2024-09-16T04:47:05.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:47:05.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673034 2024-09-16T04:47:05.788 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673034 2024-09-16T04:47:05.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673034' 2024-09-16T04:47:05.789 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:47:06.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673034 -lt 42949673034 2024-09-16T04:47:06.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:47:06.236 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509512 2024-09-16T04:47:06.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:47:06.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:47:06.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509512 2024-09-16T04:47:06.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:47:06.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509512 2024-09-16T04:47:06.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509512' 2024-09-16T04:47:06.239 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509512 2024-09-16T04:47:06.240 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:47:06.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509512 -lt 64424509512 2024-09-16T04:47:06.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:47:06.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345981 2024-09-16T04:47:06.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:47:06.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:47:06.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345981 2024-09-16T04:47:06.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:47:06.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345981 2024-09-16T04:47:06.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345981' 2024-09-16T04:47:06.651 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345981 2024-09-16T04:47:06.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:47:07.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345982 -lt 85899345981 2024-09-16T04:47:07.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:47:07.123 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182453 2024-09-16T04:47:07.123 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:47:07.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:47:07.124 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182453 2024-09-16T04:47:07.125 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:47:07.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182453 2024-09-16T04:47:07.125 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182453 2024-09-16T04:47:07.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182453' 2024-09-16T04:47:07.126 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:47:07.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182454 -lt 107374182453 2024-09-16T04:47:07.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:47:07.575 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018924 2024-09-16T04:47:07.575 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:47:07.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T04:47:07.577 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018924 2024-09-16T04:47:07.577 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:47:07.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018924 2024-09-16T04:47:07.578 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018924 2024-09-16T04:47:07.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018924' 2024-09-16T04:47:07.578 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T04:47:08.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018925 -lt 128849018924 2024-09-16T04:47:08.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-09-16T04:47:08.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:47:08.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:47:08.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 3 == 0 2024-09-16T04:47:08.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:47:08.574 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state activating 2024-09-16T04:47:08.574 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=activating 2024-09-16T04:47:08.574 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:47:08.574 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("activating"))' 2024-09-16T04:47:08.574 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:47:08.575 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2024-09-16T04:47:09.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-09-16T04:47:09.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-09-16T04:47:09.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-09-16T04:47:09.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-09-16T04:47:09.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:826: TEST_ec_backfill_multi: ceph pg dump pgs 2024-09-16T04:47:09.407 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:47:09.408 INFO:tasks.workunit.client.0.smithi026.stdout:3.0 200 0 0 200 0 2457600 0 0 100 100 100 active+remapped+backfill_toofull 2024-09-16T04:46:56.765207+0000 57'200 69:261 [0,2,3,4,1] 0 [0,2,3,4,5] 0 0'0 2024-09-16T04:44:15.958635+0000 0'0 2024-09-16T04:44:15.958635+0000 0 0 no scrub is scheduled 0 0 2024-09-16T04:47:09.408 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 200 0 0 0 0 2457600 0 0 100 100 100 active+clean 2024-09-16T04:46:42.601658+0000 57'200 69:675 [0,2,3,4,1] 0 [0,2,3,4,1] 0 0'0 2024-09-16T04:44:14.300564+0000 0'0 2024-09-16T04:44:14.300564+0000 0 0 periodic scrub scheduled @ 2024-09-17T06:28:42.761578+0000 0 0 2024-09-16T04:47:09.408 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 200 0 0 0 0 1843200 0 0 100 100 100 active+clean 2024-09-16T04:43:53.803308+0000 41'200 69:277 [1] 1 [1] 1 0'0 2024-09-16T04:43:51.098014+0000 0'0 2024-09-16T04:43:51.098014+0000 0 0 periodic scrub scheduled @ 2024-09-17T16:16:15.594480+0000 0 0 2024-09-16T04:47:09.408 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:47:09.408 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:47:09.408 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:47:09.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:828: TEST_ec_backfill_multi: ERRORS=0 2024-09-16T04:47:09.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:829: TEST_ec_backfill_multi: ceph pg dump pgs 2024-09-16T04:47:09.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:829: TEST_ec_backfill_multi: grep -v '^1.0' 2024-09-16T04:47:09.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:829: TEST_ec_backfill_multi: grep +backfill_toofull 2024-09-16T04:47:09.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:829: TEST_ec_backfill_multi: wc -l 2024-09-16T04:47:09.813 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:47:09.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:829: TEST_ec_backfill_multi: '[' 1 '!=' 1 ']' 2024-09-16T04:47:09.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:835: TEST_ec_backfill_multi: ceph pg dump pgs 2024-09-16T04:47:09.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:835: TEST_ec_backfill_multi: grep -v '^1.0' 2024-09-16T04:47:09.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:835: TEST_ec_backfill_multi: grep active+clean 2024-09-16T04:47:09.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:835: TEST_ec_backfill_multi: wc -l 2024-09-16T04:47:10.214 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:47:10.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:835: TEST_ec_backfill_multi: '[' 1 '!=' 1 ']' 2024-09-16T04:47:10.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:841: TEST_ec_backfill_multi: '[' 0 '!=' 0 ']' 2024-09-16T04:47:10.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:846: TEST_ec_backfill_multi: delete_pool fillpool 2024-09-16T04:47:10.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=fillpool 2024-09-16T04:47:10.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it 2024-09-16T04:47:10.836 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'fillpool' does not exist 2024-09-16T04:47:10.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:847: TEST_ec_backfill_multi: seq 1 2 2024-09-16T04:47:10.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:847: TEST_ec_backfill_multi: for i in $(seq 1 $pools) 2024-09-16T04:47:10.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:849: TEST_ec_backfill_multi: delete_pool test1 2024-09-16T04:47:10.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test1 2024-09-16T04:47:10.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-09-16T04:47:11.413 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' does not exist 2024-09-16T04:47:11.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:847: TEST_ec_backfill_multi: for i in $(seq 1 $pools) 2024-09-16T04:47:11.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:849: TEST_ec_backfill_multi: delete_pool test2 2024-09-16T04:47:11.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test2 2024-09-16T04:47:11.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test2 test2 --yes-i-really-really-mean-it 2024-09-16T04:47:12.173 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test2' does not exist 2024-09-16T04:47:12.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:851: TEST_ec_backfill_multi: kill_daemons td/osd-backfill-space 2024-09-16T04:47:12.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:47:12.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:47:12.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:47:12.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:47:12.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:47:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:47:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-09-16T04:47:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:47:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:47:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:47:17.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:47:17.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:47:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:47:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:47:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:47:17.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:47:17.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:47:17.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:47:17.514 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:47:17.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:47:17.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:47:17.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:47:17.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:47:17.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:47:17.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:47:17.518 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:47:17.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:47:17.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:47:17.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:47:17.584 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:47:17.584 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:47:17.584 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:47:17.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:47:17.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:47:17.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:47:17.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:36: run: for func in $funcs 2024-09-16T04:47:17.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:37: run: setup td/osd-backfill-space 2024-09-16T04:47:17.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-space 2024-09-16T04:47:17.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-space 2024-09-16T04:47:17.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:47:17.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:47:17.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:47:17.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:47:17.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:47:17.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:47:17.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:47:17.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:47:17.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:47:17.588 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:47:17.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:47:17.589 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:47:17.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:47:17.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:47:17.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:47:17.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:47:17.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:47:17.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:47:17.592 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:47:17.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:47:17.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:47:17.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:47:17.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:47:17.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:47:17.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:47:17.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:47:17.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:47:17.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:47:17.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-space 2024-09-16T04:47:17.598 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:47:17.598 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:47:17.598 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:47:17.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.114688 2024-09-16T04:47:17.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:47:17.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:47:17.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:47:17.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-space 1' TERM HUP INT 2024-09-16T04:47:17.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:38: run: TEST_ec_backfill_simple td/osd-backfill-space 2024-09-16T04:47:17.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:624: TEST_ec_backfill_simple: local dir=td/osd-backfill-space 2024-09-16T04:47:17.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:625: TEST_ec_backfill_simple: local EC= 2024-09-16T04:47:17.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:626: TEST_ec_backfill_simple: local pools=1 2024-09-16T04:47:17.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:627: TEST_ec_backfill_simple: local OSDS=6 2024-09-16T04:47:17.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:628: TEST_ec_backfill_simple: local k=3 2024-09-16T04:47:17.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:629: TEST_ec_backfill_simple: local m=2 2024-09-16T04:47:17.602 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:630: TEST_ec_backfill_simple: expr 600 / 3 2024-09-16T04:47:17.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:630: TEST_ec_backfill_simple: local ecobjects=200 2024-09-16T04:47:17.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:632: TEST_ec_backfill_simple: run_mon td/osd-backfill-space a 2024-09-16T04:47:17.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-space 2024-09-16T04:47:17.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:47:17.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:47:17.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:47:17.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-space/a 2024-09-16T04:47:17.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-space/a --run-dir=td/osd-backfill-space 2024-09-16T04:47:18.103 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:47:18.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:47:18.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:47:18.104 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:47:18.104 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:47:18.104 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:47:18.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:47:18.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-space/a '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-space/log --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:47:18.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:47:18.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:47:18.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:47:18.308 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:47:18.308 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:47:18.308 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:47:18.308 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:47:18.308 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:47:18.308 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:47:18.308 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:47:18.309 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:47:18.309 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:47:18.309 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T04:47:18.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:47:18.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get fsid 2024-09-16T04:47:18.401 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:47:18.401 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:47:18.401 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:47:18.401 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:47:18.402 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:47:18.402 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:47:18.402 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:47:18.402 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:47:18.402 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:47:18.402 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:47:18.402 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:47:18.402 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.114688/ceph-mon.a.asok 2024-09-16T04:47:18.402 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:47:18.402 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.114688/ceph-mon.a.asok config get mon_host 2024-09-16T04:47:18.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:633: TEST_ec_backfill_simple: run_mgr td/osd-backfill-space x 2024-09-16T04:47:18.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-space 2024-09-16T04:47:18.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:47:18.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:47:18.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:47:18.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-space/x 2024-09-16T04:47:18.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:47:19.354 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:47:19.354 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:47:19.354 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:47:19.354 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:47:19.354 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:47:19.354 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:47:19.354 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:47:19.355 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:47:19.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-space/x '--log-file=td/osd-backfill-space/$name.log' '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --run-dir=td/osd-backfill-space '--pid-file=td/osd-backfill-space/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:47:19.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:634: TEST_ec_backfill_simple: export CEPH_ARGS 2024-09-16T04:47:19.389 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: expr 6 - 1 2024-09-16T04:47:19.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: seq 0 5 2024-09-16T04:47:19.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:47:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:638: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 0 2024-09-16T04:47:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:47:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:47:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T04:47:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:47:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/0 2024-09-16T04:47:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:47:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:47:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:47:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:47:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/0' 2024-09-16T04:47:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/0/journal' 2024-09-16T04:47:19.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:47:19.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:47:19.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:47:19.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:47:19.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:47:19.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:47:19.395 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:47:19.395 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:47:19.395 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:47:19.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:47:19.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:47:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:47:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:47:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:47:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:47:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:47:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:47:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:47:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:47:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:47:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:47:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:47:19.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/0 2024-09-16T04:47:19.397 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:47:19.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1f59c95c-b458-4549-b48d-cef63200e198 2024-09-16T04:47:19.397 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 1f59c95c-b458-4549-b48d-cef63200e198 2024-09-16T04:47:19.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1f59c95c-b458-4549-b48d-cef63200e198' 2024-09-16T04:47:19.398 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:47:19.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBXuOdmXrvmGBAAx/3EjNtCp7xpk90cIW4lkA== 2024-09-16T04:47:19.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBXuOdmXrvmGBAAx/3EjNtCp7xpk90cIW4lkA=="}' 2024-09-16T04:47:19.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1f59c95c-b458-4549-b48d-cef63200e198 -i td/osd-backfill-space/0/new.json 2024-09-16T04:47:19.695 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:47:19.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/0/new.json 2024-09-16T04:47:19.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBXuOdmXrvmGBAAx/3EjNtCp7xpk90cIW4lkA== --osd-uuid 1f59c95c-b458-4549-b48d-cef63200e198 2024-09-16T04:47:19.742 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:19.741+0000 7faba28e0640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:47:19.755 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:19.754+0000 7faba28e0640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:47:19.756 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:19.755+0000 7faba28e0640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:47:19.757 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:19.756+0000 7faba28e0640 -1 bdev(0x563fec789c00 td/osd-backfill-space/0/block) open stat got: (1) Operation not permitted 2024-09-16T04:47:19.757 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:19.756+0000 7faba28e0640 -1 bluestore(td/osd-backfill-space/0) _read_fsid unparsable uuid 2024-09-16T04:47:25.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/0/keyring 2024-09-16T04:47:25.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:47:25.317 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T04:47:25.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T04:47:25.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:47:25.929 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T04:47:25.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T04:47:25.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/0 --osd-journal=td/osd-backfill-space/0/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:47:25.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:47:25.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:47:25.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:47:25.964 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:25.963+0000 7fe3b55fd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:47:25.966 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:25.965+0000 7fe3b55fd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:47:25.967 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:25.966+0000 7fe3b55fd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:47:26.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T04:47:26.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:47:26.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:47:26.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:47:26.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:47:26.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:26.382 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:47:26.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:47:26.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:26.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:26.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:27.322 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:27.321+0000 7fe3b55fd640 -1 Falling back to public interface 2024-09-16T04:47:27.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:27.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:27.825 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:47:27.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:47:27.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:27.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:28.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:29.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:29.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:29.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:47:29.293 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:47:29.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:29.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:29.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:29.768 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:29.767+0000 7fe3b55fd640 -1 osd.0 0 log_to_monitors true 2024-09-16T04:47:30.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:30.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:30.714 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:47:30.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:47:30.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:30.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:31.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:32.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:32.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:32.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:47:32.151 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:47:32.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:32.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:32.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:33.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:33.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:33.688 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:47:33.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:47:33.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:33.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:34.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:35.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:35.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:35.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:47:35.130 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:47:35.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:35.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:35.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:36.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:36.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:36.677 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:47:36.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:47:36.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:36.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:37.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:38.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:38.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:38.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:47:38.117 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:47:38.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:38.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:38.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:39.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:39.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:39.683 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:47:39.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:47:39.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:39.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:40.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:41.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:41.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:41.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:47:41.110 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:47:41.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:41.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:41.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:42.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:42.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:42.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:47:42.687 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:47:42.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:42.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:43.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:44.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:44.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:44.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:47:44.109 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:47:44.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:44.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:45.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:46.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:46.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:46.088 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:47:46.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:47:46.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:46.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:47.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:48.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:48.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:48.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:47:48.131 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:47:48.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:48.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:48.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:49.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:49.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:49.866 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:47:49.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:47:49.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:49.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:51.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:47:52.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:47:52.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:52.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:47:52.083 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:47:52.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:52.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:47:52.519 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4227866741,v1:127.0.0.1:6803/4227866741] [v2:127.0.0.1:6804/4227866741,v1:127.0.0.1:6805/4227866741] exists,up 1f59c95c-b458-4549-b48d-cef63200e198 2024-09-16T04:47:52.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:47:52.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:47:52.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:47:52.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:47:52.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:638: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 1 2024-09-16T04:47:52.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:47:52.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:47:52.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T04:47:52.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:47:52.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/1 2024-09-16T04:47:52.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:47:52.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:47:52.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:47:52.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:47:52.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-09-16T04:47:52.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-09-16T04:47:52.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:47:52.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:47:52.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:47:52.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:47:52.525 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:47:52.525 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:47:52.525 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:47:52.525 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:47:52.525 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:47:52.525 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:47:52.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:47:52.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:47:52.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:47:52.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:47:52.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:47:52.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:47:52.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:47:52.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:47:52.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:47:52.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:47:52.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:47:52.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:47:52.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/1 2024-09-16T04:47:52.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:47:52.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=73c5e3d2-e23f-4ca9-8c8a-3a3f611b1a95 2024-09-16T04:47:52.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 73c5e3d2-e23f-4ca9-8c8a-3a3f611b1a95' 2024-09-16T04:47:52.527 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 73c5e3d2-e23f-4ca9-8c8a-3a3f611b1a95 2024-09-16T04:47:52.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:47:52.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB4uOdmiwiLIBAA+M5Nr9lFBnk0Wvdvro/Rcw== 2024-09-16T04:47:52.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB4uOdmiwiLIBAA+M5Nr9lFBnk0Wvdvro/Rcw=="}' 2024-09-16T04:47:52.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 73c5e3d2-e23f-4ca9-8c8a-3a3f611b1a95 -i td/osd-backfill-space/1/new.json 2024-09-16T04:47:53.235 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:47:53.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/1/new.json 2024-09-16T04:47:53.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB4uOdmiwiLIBAA+M5Nr9lFBnk0Wvdvro/Rcw== --osd-uuid 73c5e3d2-e23f-4ca9-8c8a-3a3f611b1a95 2024-09-16T04:47:53.284 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:53.282+0000 7fa817485640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:47:53.285 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:53.284+0000 7fa817485640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:47:53.286 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:53.285+0000 7fa817485640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:47:53.286 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:53.285+0000 7fa817485640 -1 bdev(0x55c448317c00 td/osd-backfill-space/1/block) open stat got: (1) Operation not permitted 2024-09-16T04:47:53.286 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:53.286+0000 7fa817485640 -1 bluestore(td/osd-backfill-space/1) _read_fsid unparsable uuid 2024-09-16T04:47:58.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/1/keyring 2024-09-16T04:47:58.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:47:58.932 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T04:47:58.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T04:47:58.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:47:59.503 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T04:47:59.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T04:47:59.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:47:59.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:47:59.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:47:59.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:47:59.538 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:59.537+0000 7fbc0492c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:47:59.540 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:59.539+0000 7fbc0492c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:47:59.541 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:47:59.540+0000 7fbc0492c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:47:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T04:47:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:47:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:47:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:47:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:47:59.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:47:59.973 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:47:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:47:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:47:59.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:00.376 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:48:00.375+0000 7fbc0492c640 -1 Falling back to public interface 2024-09-16T04:48:00.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:01.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:01.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:01.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:48:01.406 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:48:01.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:01.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:01.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:02.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:02.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:02.842 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:48:02.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:48:02.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:02.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:03.010 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:48:03.008+0000 7fbc0492c640 -1 osd.1 0 log_to_monitors true 2024-09-16T04:48:03.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:04.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:04.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:04.328 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:48:04.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:48:04.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:04.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:04.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:05.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:05.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:05.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:48:05.843 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:48:05.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:05.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:06.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:07.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:07.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:07.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:48:07.265 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:48:07.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:07.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:07.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:08.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:08.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:08.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:48:08.907 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:48:08.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:08.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:09.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:10.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:10.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:10.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:48:10.371 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:48:10.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:10.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:10.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:11.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:11.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:11.910 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:48:11.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:48:11.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:11.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:12.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:13.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:13.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:13.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:48:13.360 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:48:13.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:13.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:13.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:14.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:14.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:14.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:48:14.898 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:48:14.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:14.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:15.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:16.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:16.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:16.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:48:16.478 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:48:16.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:16.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:17.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:18.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:18.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:18.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:48:18.484 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:48:18.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:18.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:19.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:20.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:20.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:20.212 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:48:20.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:48:20.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:20.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:21.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:22.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:22.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:22.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:48:22.237 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:48:22.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:22.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:23.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:24.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:24.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:24.401 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:48:24.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:48:24.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:24.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:25.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:26.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:26.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:26.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:48:26.411 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:48:26.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:26.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:48:26.899 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1104664284,v1:127.0.0.1:6811/1104664284] [v2:127.0.0.1:6812/1104664284,v1:127.0.0.1:6813/1104664284] exists,up 73c5e3d2-e23f-4ca9-8c8a-3a3f611b1a95 2024-09-16T04:48:26.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:48:26.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:48:26.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:48:26.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:48:26.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:638: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 2 2024-09-16T04:48:26.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:48:26.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:48:26.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T04:48:26.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:48:26.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/2 2024-09-16T04:48:26.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:48:26.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:48:26.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:48:26.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:48:26.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/2' 2024-09-16T04:48:26.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/2/journal' 2024-09-16T04:48:26.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:48:26.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:48:26.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:48:26.906 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:48:26.906 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:48:26.906 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:48:26.906 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:48:26.906 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:48:26.906 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:48:26.906 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:48:26.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:48:26.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:48:26.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:48:26.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:48:26.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:48:26.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:48:26.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:48:26.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:48:26.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:48:26.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:48:26.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:48:26.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:48:26.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/2 2024-09-16T04:48:26.907 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:48:26.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d3087286-0e3d-419e-a436-1ca07ff7b3db 2024-09-16T04:48:26.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 d3087286-0e3d-419e-a436-1ca07ff7b3db' 2024-09-16T04:48:26.908 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 d3087286-0e3d-419e-a436-1ca07ff7b3db 2024-09-16T04:48:26.908 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:48:26.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCauOdmCLonNxAAJOlU/R2ep7NBkf11i50Exw== 2024-09-16T04:48:26.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCauOdmCLonNxAAJOlU/R2ep7NBkf11i50Exw=="}' 2024-09-16T04:48:26.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d3087286-0e3d-419e-a436-1ca07ff7b3db -i td/osd-backfill-space/2/new.json 2024-09-16T04:48:27.574 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:48:27.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/2/new.json 2024-09-16T04:48:27.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCauOdmCLonNxAAJOlU/R2ep7NBkf11i50Exw== --osd-uuid d3087286-0e3d-419e-a436-1ca07ff7b3db 2024-09-16T04:48:27.623 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:48:27.622+0000 7f706cae4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:48:27.625 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:48:27.624+0000 7f706cae4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:48:27.626 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:48:27.625+0000 7f706cae4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:48:27.626 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:48:27.625+0000 7f706cae4640 -1 bdev(0x55954b21dc00 td/osd-backfill-space/2/block) open stat got: (1) Operation not permitted 2024-09-16T04:48:27.626 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:48:27.626+0000 7f706cae4640 -1 bluestore(td/osd-backfill-space/2) _read_fsid unparsable uuid 2024-09-16T04:48:34.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/2/keyring 2024-09-16T04:48:34.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:48:34.300 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T04:48:34.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T04:48:34.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:48:34.876 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T04:48:34.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T04:48:34.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/2 --osd-journal=td/osd-backfill-space/2/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:48:34.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:48:34.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:48:34.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:48:34.910 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:48:34.909+0000 7f198bafe640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:48:34.912 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:48:34.911+0000 7f198bafe640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:48:34.913 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:48:34.912+0000 7f198bafe640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:48:35.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T04:48:35.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:48:35.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:48:35.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:48:35.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:48:35.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:35.335 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:48:35.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:48:35.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:35.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:35.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:36.503 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:48:36.502+0000 7f198bafe640 -1 Falling back to public interface 2024-09-16T04:48:36.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:36.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:36.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:48:36.743 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:48:36.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:36.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:37.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:38.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:38.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:38.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:48:38.189 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:48:38.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:38.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:38.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:39.175 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:48:39.174+0000 7f198bafe640 -1 osd.2 0 log_to_monitors true 2024-09-16T04:48:39.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:39.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:39.614 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:48:39.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:48:39.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:39.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:40.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:41.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:41.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:41.083 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:48:41.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:48:41.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:41.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:41.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:42.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:42.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:42.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:48:42.549 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:48:42.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:42.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:43.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:44.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:44.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:44.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:48:44.149 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:48:44.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:44.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:44.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:45.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:45.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:45.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:48:45.575 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:48:45.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:45.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:46.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:47.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:47.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:47.030 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:48:47.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:48:47.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:47.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:47.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:48.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:48.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:48.457 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:48:48.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:48:48.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:48.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:48.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:49.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:49.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:49.882 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:48:49.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:48:49.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:49.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:50.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:51.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:51.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:51.428 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:48:51.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:48:51.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:51.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:51.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:52.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:52.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:52.848 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:48:52.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:48:52.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:52.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:54.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:55.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:55.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:55.200 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:48:55.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:48:55.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:55.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:55.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:56.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:56.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:56.984 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:48:56.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:48:56.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:56.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:57.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:48:58.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:48:58.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:48:58.753 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:48:58.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:48:58.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:48:58.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:48:59.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:00.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:00.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:00.581 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:49:00.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:49:00.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:00.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:49:01.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:02.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:02.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:02.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:49:02.417 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:49:02.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:02.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:49:02.909 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1687461089,v1:127.0.0.1:6819/1687461089] [v2:127.0.0.1:6820/1687461089,v1:127.0.0.1:6821/1687461089] exists,up d3087286-0e3d-419e-a436-1ca07ff7b3db 2024-09-16T04:49:02.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:49:02.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:49:02.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:49:02.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:49:02.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:638: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 3 2024-09-16T04:49:02.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:49:02.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:49:02.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T04:49:02.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/3 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/3' 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/3/journal' 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:49:02.914 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:49:02.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:49:02.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:49:02.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/3 2024-09-16T04:49:02.916 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:49:02.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a814ecf3-74e5-4901-b186-937ce0440cc7 2024-09-16T04:49:02.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 a814ecf3-74e5-4901-b186-937ce0440cc7' 2024-09-16T04:49:02.916 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 a814ecf3-74e5-4901-b186-937ce0440cc7 2024-09-16T04:49:02.916 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:49:02.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC+uOdmPzDCNxAABOdS9lUdLXs+TclMFCXRVQ== 2024-09-16T04:49:02.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC+uOdmPzDCNxAABOdS9lUdLXs+TclMFCXRVQ=="}' 2024-09-16T04:49:02.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a814ecf3-74e5-4901-b186-937ce0440cc7 -i td/osd-backfill-space/3/new.json 2024-09-16T04:49:03.416 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:49:03.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/3/new.json 2024-09-16T04:49:03.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC+uOdmPzDCNxAABOdS9lUdLXs+TclMFCXRVQ== --osd-uuid a814ecf3-74e5-4901-b186-937ce0440cc7 2024-09-16T04:49:03.464 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:03.463+0000 7fb3197cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:49:03.471 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:03.470+0000 7fb3197cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:49:03.472 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:03.471+0000 7fb3197cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:49:03.473 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:03.472+0000 7fb3197cc640 -1 bdev(0x55c9ec3bfc00 td/osd-backfill-space/3/block) open stat got: (1) Operation not permitted 2024-09-16T04:49:03.473 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:03.472+0000 7fb3197cc640 -1 bluestore(td/osd-backfill-space/3) _read_fsid unparsable uuid 2024-09-16T04:49:09.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/3/keyring 2024-09-16T04:49:09.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:49:09.502 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T04:49:09.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T04:49:09.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:49:10.079 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T04:49:10.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T04:49:10.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/3 --osd-journal=td/osd-backfill-space/3/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:49:10.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:49:10.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:49:10.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:49:10.114 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:10.112+0000 7fb1e5644640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:49:10.116 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:10.114+0000 7fb1e5644640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:49:10.117 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:10.115+0000 7fb1e5644640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:49:10.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T04:49:10.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:49:10.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T04:49:10.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:49:10.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:49:10.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:10.501 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:49:10.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:49:10.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:10.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:10.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:11.721 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:11.719+0000 7fb1e5644640 -1 Falling back to public interface 2024-09-16T04:49:11.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:11.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:11.934 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:49:11.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:49:11.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:11.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:12.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:13.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:13.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:13.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:49:13.386 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:49:13.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:13.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:13.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:14.716 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:14.713+0000 7fb1e5644640 -1 osd.3 0 log_to_monitors true 2024-09-16T04:49:14.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:14.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:14.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:49:14.837 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:49:14.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:14.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:15.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:16.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:16.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:16.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:49:16.412 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:49:16.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:16.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:16.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:17.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:17.968 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:49:17.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:49:17.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:17.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:18.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:19.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:19.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:19.584 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:49:19.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:49:19.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:19.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:20.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:21.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:21.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:21.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:49:21.036 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:49:21.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:21.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:21.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:22.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:22.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:22.565 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:49:22.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:49:22.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:22.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:23.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:24.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:24.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:24.036 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:49:24.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:49:24.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:24.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:24.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:25.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:25.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:25.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:49:25.539 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:49:25.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:25.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:26.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:27.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:27.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:27.026 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:49:27.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:49:27.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:27.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:27.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:28.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:28.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:28.592 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:49:28.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:49:28.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:28.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:29.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:30.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:30.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:30.370 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:49:30.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:49:30.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:30.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:31.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:32.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:32.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:32.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:49:32.346 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:49:32.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:32.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:33.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:34.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:34.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:34.007 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:49:34.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:49:34.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:34.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:34.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:35.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:35.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:35.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:49:35.783 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:49:35.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:35.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:36.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:37.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:37.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:37.592 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:49:37.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:49:37.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:37.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:49:38.197 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/4021717162,v1:127.0.0.1:6827/4021717162] [v2:127.0.0.1:6828/4021717162,v1:127.0.0.1:6829/4021717162] exists,up a814ecf3-74e5-4901-b186-937ce0440cc7 2024-09-16T04:49:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:49:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:49:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:49:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:49:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:638: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 4 2024-09-16T04:49:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:49:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:49:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/4 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/4' 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/4/journal' 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:49:38.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:49:38.204 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:49:38.204 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:49:38.204 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:49:38.204 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:49:38.204 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:49:38.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:49:38.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:49:38.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:49:38.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:49:38.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:49:38.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:49:38.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:49:38.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:49:38.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:49:38.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:49:38.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:49:38.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:49:38.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/4 2024-09-16T04:49:38.205 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:49:38.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e60aeb3a-58dc-4e5f-b570-ee6af79bd93f 2024-09-16T04:49:38.205 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 e60aeb3a-58dc-4e5f-b570-ee6af79bd93f 2024-09-16T04:49:38.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 e60aeb3a-58dc-4e5f-b570-ee6af79bd93f' 2024-09-16T04:49:38.206 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:49:38.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDiuOdm1dBYDRAAGvJQWx+8GhFLxsfrMqkkgw== 2024-09-16T04:49:38.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDiuOdm1dBYDRAAGvJQWx+8GhFLxsfrMqkkgw=="}' 2024-09-16T04:49:38.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e60aeb3a-58dc-4e5f-b570-ee6af79bd93f -i td/osd-backfill-space/4/new.json 2024-09-16T04:49:38.798 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:49:38.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/4/new.json 2024-09-16T04:49:38.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDiuOdm1dBYDRAAGvJQWx+8GhFLxsfrMqkkgw== --osd-uuid e60aeb3a-58dc-4e5f-b570-ee6af79bd93f 2024-09-16T04:49:38.847 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:38.846+0000 7fb86e812640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:49:38.849 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:38.848+0000 7fb86e812640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:49:38.850 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:38.849+0000 7fb86e812640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:49:38.851 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:38.850+0000 7fb86e812640 -1 bdev(0x5622e08ebc00 td/osd-backfill-space/4/block) open stat got: (1) Operation not permitted 2024-09-16T04:49:38.851 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:38.850+0000 7fb86e812640 -1 bluestore(td/osd-backfill-space/4) _read_fsid unparsable uuid 2024-09-16T04:49:44.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/4/keyring 2024-09-16T04:49:44.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:49:44.822 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T04:49:44.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T04:49:44.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:49:45.405 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T04:49:45.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T04:49:45.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/4 --osd-journal=td/osd-backfill-space/4/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:49:45.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:49:45.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:49:45.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:49:45.440 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:45.439+0000 7efd30c1b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:49:45.442 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:45.441+0000 7efd30c1b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:49:45.443 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:45.442+0000 7efd30c1b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:49:45.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T04:49:45.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:49:45.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T04:49:45.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:49:45.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:49:45.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:45.816 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:49:45.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:49:45.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:45.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:49:46.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:46.275 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:46.275+0000 7efd30c1b640 -1 Falling back to public interface 2024-09-16T04:49:47.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:47.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:47.255 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:49:47.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:49:47.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:47.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:49:47.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:48.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:48.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:48.681 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:49:48.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:49:48.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:48.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:49:49.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:49.301 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:49:49.300+0000 7efd30c1b640 -1 osd.4 0 log_to_monitors true 2024-09-16T04:49:50.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:50.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:50.103 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:49:50.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:49:50.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:50.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:49:50.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:51.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:51.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:51.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:49:51.532 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:49:51.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:51.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:49:52.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:53.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:53.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:53.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:49:53.138 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:49:53.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:53.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:49:53.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:54.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:54.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:54.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:49:54.580 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:49:54.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:54.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:49:55.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:56.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:56.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:56.164 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:49:56.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:49:56.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:56.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:49:56.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:57.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:57.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:57.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:49:57.587 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:49:57.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:57.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:49:58.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:49:59.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:49:59.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:49:59.109 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:49:59.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:49:59.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:49:59.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:49:59.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:00.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:00.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:00.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:50:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:50:00.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:00.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:50:01.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:02.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:02.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:02.063 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:50:02.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:50:02.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:02.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:50:02.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:03.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:03.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:03.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:50:03.860 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:50:03.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:03.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:50:04.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:05.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:05.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:05.714 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:50:05.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:50:05.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:05.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:50:06.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:07.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:07.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:07.255 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:50:07.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:50:07.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:07.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:50:08.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:09.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:09.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:09.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:50:09.010 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:50:09.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:09.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:50:09.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:10.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:10.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:10.767 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:50:10.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:50:10.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:10.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:50:11.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:12.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:12.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:12.514 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:50:12.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:50:12.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:12.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:50:13.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:14.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:14.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:14.244 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:50:14.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:50:14.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:14.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:50:14.719 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3065829067,v1:127.0.0.1:6835/3065829067] [v2:127.0.0.1:6836/3065829067,v1:127.0.0.1:6837/3065829067] exists,up e60aeb3a-58dc-4e5f-b570-ee6af79bd93f 2024-09-16T04:50:14.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:50:14.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:50:14.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:50:14.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:636: TEST_ec_backfill_simple: for osd in $(seq 0 $(expr $OSDS - 1)) 2024-09-16T04:50:14.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:638: TEST_ec_backfill_simple: run_osd td/osd-backfill-space 5 2024-09-16T04:50:14.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-space 2024-09-16T04:50:14.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:50:14.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T04:50:14.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:50:14.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-space/5 2024-09-16T04:50:14.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-space/5' 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/5/journal' 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:50:14.728 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:50:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:50:14.729 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:50:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:50:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:50:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:50:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:50:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:50:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:50:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:50:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:50:14.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:50:14.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:50:14.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:50:14.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:50:14.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-space/5 2024-09-16T04:50:14.730 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:50:14.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8a230459-f499-4fff-99eb-125df0342289 2024-09-16T04:50:14.730 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 8a230459-f499-4fff-99eb-125df0342289 2024-09-16T04:50:14.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 8a230459-f499-4fff-99eb-125df0342289' 2024-09-16T04:50:14.731 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:50:14.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAGuedmmuV6LBAAyo2zmhLlAIn6LjqQEvCvoQ== 2024-09-16T04:50:14.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAGuedmmuV6LBAAyo2zmhLlAIn6LjqQEvCvoQ=="}' 2024-09-16T04:50:14.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8a230459-f499-4fff-99eb-125df0342289 -i td/osd-backfill-space/5/new.json 2024-09-16T04:50:15.257 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:50:15.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-space/5/new.json 2024-09-16T04:50:15.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAGuedmmuV6LBAAyo2zmhLlAIn6LjqQEvCvoQ== --osd-uuid 8a230459-f499-4fff-99eb-125df0342289 2024-09-16T04:50:15.306 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:50:15.305+0000 7f0d38c9c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:50:15.307 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:50:15.306+0000 7f0d38c9c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:50:15.308 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:50:15.307+0000 7f0d38c9c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:50:15.309 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:50:15.308+0000 7f0d38c9c640 -1 bdev(0x560498ee7c00 td/osd-backfill-space/5/block) open stat got: (1) Operation not permitted 2024-09-16T04:50:15.309 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:50:15.308+0000 7f0d38c9c640 -1 bluestore(td/osd-backfill-space/5) _read_fsid unparsable uuid 2024-09-16T04:50:21.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-space/5/keyring 2024-09-16T04:50:21.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:50:21.421 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T04:50:21.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T04:50:21.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-space/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:50:21.992 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T04:50:21.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T04:50:21.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/5 --osd-journal=td/osd-backfill-space/5/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:50:21.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:50:21.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:50:21.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:50:22.027 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:50:22.025+0000 7facaf00d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:50:22.029 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:50:22.027+0000 7facaf00d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:50:22.030 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:50:22.029+0000 7facaf00d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:50:22.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T04:50:22.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:50:22.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T04:50:22.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:50:22.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:50:22.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:22.449 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:50:22.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:50:22.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:22.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:22.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:23.375 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:50:23.373+0000 7facaf00d640 -1 Falling back to public interface 2024-09-16T04:50:23.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:23.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:23.892 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:50:23.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:50:23.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:23.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:24.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:25.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:25.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:25.351 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:50:25.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:50:25.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:25.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:25.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:26.272 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:50:26.270+0000 7facaf00d640 -1 osd.5 0 log_to_monitors true 2024-09-16T04:50:26.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:26.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:26.771 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:50:26.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:50:26.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:26.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:27.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:28.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:28.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:28.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:50:28.402 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:50:28.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:28.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:28.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:29.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:29.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:29.929 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:50:29.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:50:29.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:29.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:30.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:31.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:31.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:31.452 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:50:31.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:50:31.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:31.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:31.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:32.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:32.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:32.884 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:50:32.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:50:32.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:32.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:33.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:34.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:34.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:34.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:50:34.412 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:50:34.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:34.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:34.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:35.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:35.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:35.864 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:50:35.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:50:35.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:35.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:37.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:37.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:37.312 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:50:37.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:50:37.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:37.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:37.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:38.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:38.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:38.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:50:38.821 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:50:38.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:38.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:39.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:40.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:40.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:40.370 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:50:40.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:50:40.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:40.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:41.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:42.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:42.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:42.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:50:42.241 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:50:42.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:42.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:43.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:44.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:44.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:44.107 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:50:44.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:50:44.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:44.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:45.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:46.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:46.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:46.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:50:46.049 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:50:46.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:46.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:46.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:47.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:47.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:47.793 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:50:47.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:50:47.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:47.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:48.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:49.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:49.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:49.506 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:50:49.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:50:49.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:49.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:49.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:50:50.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:50:50.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:50:50.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:50:50.937 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:50:50.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:50:50.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:50:51.405 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3952606421,v1:127.0.0.1:6843/3952606421] [v2:127.0.0.1:6844/3952606421,v1:127.0.0.1:6845/3952606421] exists,up 8a230459-f499-4fff-99eb-125df0342289 2024-09-16T04:50:51.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:50:51.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:50:51.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:50:51.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:641: TEST_ec_backfill_simple: ceph osd set-backfillfull-ratio .85 2024-09-16T04:50:52.145 INFO:tasks.workunit.client.0.smithi026.stderr:osd set-backfillfull-ratio 0.85 2024-09-16T04:50:52.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:642: TEST_ec_backfill_simple: create_pool fillpool 1 1 2024-09-16T04:50:52.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create fillpool 1 1 2024-09-16T04:50:52.742 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'fillpool' already exists 2024-09-16T04:50:52.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:50:53.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:643: TEST_ec_backfill_simple: ceph osd pool set fillpool size 1 --yes-i-really-mean-it 2024-09-16T04:50:54.582 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 1 2024-09-16T04:50:54.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:652: TEST_ec_backfill_simple: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=13 2024-09-16T04:50:54.596 INFO:tasks.workunit.client.0.smithi026.stderr:13+0 records in 2024-09-16T04:50:54.596 INFO:tasks.workunit.client.0.smithi026.stderr:13+0 records out 2024-09-16T04:50:54.596 INFO:tasks.workunit.client.0.smithi026.stderr:13312 bytes (13 kB, 13 KiB) copied, 0.000109676 s, 121 MB/s 2024-09-16T04:50:54.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: seq 1 200 2024-09-16T04:50:54.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:54.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj1 td/osd-backfill-space/datafile 2024-09-16T04:50:55.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:55.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj2 td/osd-backfill-space/datafile 2024-09-16T04:50:55.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:55.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj3 td/osd-backfill-space/datafile 2024-09-16T04:50:55.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:55.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj4 td/osd-backfill-space/datafile 2024-09-16T04:50:56.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:56.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj5 td/osd-backfill-space/datafile 2024-09-16T04:50:56.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:56.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj6 td/osd-backfill-space/datafile 2024-09-16T04:50:56.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:56.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj7 td/osd-backfill-space/datafile 2024-09-16T04:50:56.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:56.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj8 td/osd-backfill-space/datafile 2024-09-16T04:50:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj9 td/osd-backfill-space/datafile 2024-09-16T04:50:56.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:56.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj10 td/osd-backfill-space/datafile 2024-09-16T04:50:56.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:56.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj11 td/osd-backfill-space/datafile 2024-09-16T04:50:56.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:56.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj12 td/osd-backfill-space/datafile 2024-09-16T04:50:56.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:56.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj13 td/osd-backfill-space/datafile 2024-09-16T04:50:56.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:56.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj14 td/osd-backfill-space/datafile 2024-09-16T04:50:57.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:57.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj15 td/osd-backfill-space/datafile 2024-09-16T04:50:57.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:57.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj16 td/osd-backfill-space/datafile 2024-09-16T04:50:57.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:57.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj17 td/osd-backfill-space/datafile 2024-09-16T04:50:57.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:57.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj18 td/osd-backfill-space/datafile 2024-09-16T04:50:57.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:57.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj19 td/osd-backfill-space/datafile 2024-09-16T04:50:57.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:57.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj20 td/osd-backfill-space/datafile 2024-09-16T04:50:57.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:57.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj21 td/osd-backfill-space/datafile 2024-09-16T04:50:57.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:57.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj22 td/osd-backfill-space/datafile 2024-09-16T04:50:57.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:57.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj23 td/osd-backfill-space/datafile 2024-09-16T04:50:57.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:57.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj24 td/osd-backfill-space/datafile 2024-09-16T04:50:58.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:58.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj25 td/osd-backfill-space/datafile 2024-09-16T04:50:58.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:58.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj26 td/osd-backfill-space/datafile 2024-09-16T04:50:58.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:58.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj27 td/osd-backfill-space/datafile 2024-09-16T04:50:58.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:58.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj28 td/osd-backfill-space/datafile 2024-09-16T04:50:58.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:58.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj29 td/osd-backfill-space/datafile 2024-09-16T04:50:58.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:58.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj30 td/osd-backfill-space/datafile 2024-09-16T04:50:58.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:58.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj31 td/osd-backfill-space/datafile 2024-09-16T04:50:58.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:58.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj32 td/osd-backfill-space/datafile 2024-09-16T04:50:58.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:58.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj33 td/osd-backfill-space/datafile 2024-09-16T04:50:58.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:58.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj34 td/osd-backfill-space/datafile 2024-09-16T04:50:58.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:58.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj35 td/osd-backfill-space/datafile 2024-09-16T04:50:59.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:59.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj36 td/osd-backfill-space/datafile 2024-09-16T04:50:59.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:59.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj37 td/osd-backfill-space/datafile 2024-09-16T04:50:59.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:59.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj38 td/osd-backfill-space/datafile 2024-09-16T04:50:59.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:59.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj39 td/osd-backfill-space/datafile 2024-09-16T04:50:59.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:59.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj40 td/osd-backfill-space/datafile 2024-09-16T04:50:59.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:59.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj41 td/osd-backfill-space/datafile 2024-09-16T04:50:59.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:59.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj42 td/osd-backfill-space/datafile 2024-09-16T04:50:59.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:59.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj43 td/osd-backfill-space/datafile 2024-09-16T04:50:59.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:59.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj44 td/osd-backfill-space/datafile 2024-09-16T04:50:59.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:59.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj45 td/osd-backfill-space/datafile 2024-09-16T04:50:59.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:50:59.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj46 td/osd-backfill-space/datafile 2024-09-16T04:51:00.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:00.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj47 td/osd-backfill-space/datafile 2024-09-16T04:51:00.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:00.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj48 td/osd-backfill-space/datafile 2024-09-16T04:51:00.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:00.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj49 td/osd-backfill-space/datafile 2024-09-16T04:51:00.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:00.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj50 td/osd-backfill-space/datafile 2024-09-16T04:51:00.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:00.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj51 td/osd-backfill-space/datafile 2024-09-16T04:51:00.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:00.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj52 td/osd-backfill-space/datafile 2024-09-16T04:51:00.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:00.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj53 td/osd-backfill-space/datafile 2024-09-16T04:51:00.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:00.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj54 td/osd-backfill-space/datafile 2024-09-16T04:51:00.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:00.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj55 td/osd-backfill-space/datafile 2024-09-16T04:51:00.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:00.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj56 td/osd-backfill-space/datafile 2024-09-16T04:51:00.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:00.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj57 td/osd-backfill-space/datafile 2024-09-16T04:51:01.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:01.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj58 td/osd-backfill-space/datafile 2024-09-16T04:51:01.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:01.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj59 td/osd-backfill-space/datafile 2024-09-16T04:51:01.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:01.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj60 td/osd-backfill-space/datafile 2024-09-16T04:51:01.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:01.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj61 td/osd-backfill-space/datafile 2024-09-16T04:51:01.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:01.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj62 td/osd-backfill-space/datafile 2024-09-16T04:51:01.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:01.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj63 td/osd-backfill-space/datafile 2024-09-16T04:51:01.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:01.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj64 td/osd-backfill-space/datafile 2024-09-16T04:51:01.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:01.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj65 td/osd-backfill-space/datafile 2024-09-16T04:51:01.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:01.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj66 td/osd-backfill-space/datafile 2024-09-16T04:51:01.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:01.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj67 td/osd-backfill-space/datafile 2024-09-16T04:51:01.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:01.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj68 td/osd-backfill-space/datafile 2024-09-16T04:51:02.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:02.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj69 td/osd-backfill-space/datafile 2024-09-16T04:51:02.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:02.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj70 td/osd-backfill-space/datafile 2024-09-16T04:51:02.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:02.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj71 td/osd-backfill-space/datafile 2024-09-16T04:51:02.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:02.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj72 td/osd-backfill-space/datafile 2024-09-16T04:51:02.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:02.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj73 td/osd-backfill-space/datafile 2024-09-16T04:51:02.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:02.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj74 td/osd-backfill-space/datafile 2024-09-16T04:51:02.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:02.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj75 td/osd-backfill-space/datafile 2024-09-16T04:51:02.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:02.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj76 td/osd-backfill-space/datafile 2024-09-16T04:51:02.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:02.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj77 td/osd-backfill-space/datafile 2024-09-16T04:51:02.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:02.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj78 td/osd-backfill-space/datafile 2024-09-16T04:51:02.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:02.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj79 td/osd-backfill-space/datafile 2024-09-16T04:51:03.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:03.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj80 td/osd-backfill-space/datafile 2024-09-16T04:51:03.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:03.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj81 td/osd-backfill-space/datafile 2024-09-16T04:51:03.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:03.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj82 td/osd-backfill-space/datafile 2024-09-16T04:51:03.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:03.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj83 td/osd-backfill-space/datafile 2024-09-16T04:51:03.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:03.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj84 td/osd-backfill-space/datafile 2024-09-16T04:51:03.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:03.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj85 td/osd-backfill-space/datafile 2024-09-16T04:51:03.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:03.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj86 td/osd-backfill-space/datafile 2024-09-16T04:51:03.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:03.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj87 td/osd-backfill-space/datafile 2024-09-16T04:51:03.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:03.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj88 td/osd-backfill-space/datafile 2024-09-16T04:51:03.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:03.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj89 td/osd-backfill-space/datafile 2024-09-16T04:51:03.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:03.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj90 td/osd-backfill-space/datafile 2024-09-16T04:51:03.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:03.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj91 td/osd-backfill-space/datafile 2024-09-16T04:51:04.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:04.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj92 td/osd-backfill-space/datafile 2024-09-16T04:51:04.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:04.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj93 td/osd-backfill-space/datafile 2024-09-16T04:51:04.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:04.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj94 td/osd-backfill-space/datafile 2024-09-16T04:51:04.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:04.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj95 td/osd-backfill-space/datafile 2024-09-16T04:51:04.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:04.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj96 td/osd-backfill-space/datafile 2024-09-16T04:51:04.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:04.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj97 td/osd-backfill-space/datafile 2024-09-16T04:51:04.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:04.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj98 td/osd-backfill-space/datafile 2024-09-16T04:51:04.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:04.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj99 td/osd-backfill-space/datafile 2024-09-16T04:51:04.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:04.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj100 td/osd-backfill-space/datafile 2024-09-16T04:51:04.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:04.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj101 td/osd-backfill-space/datafile 2024-09-16T04:51:04.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:04.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj102 td/osd-backfill-space/datafile 2024-09-16T04:51:05.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:05.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj103 td/osd-backfill-space/datafile 2024-09-16T04:51:05.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:05.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj104 td/osd-backfill-space/datafile 2024-09-16T04:51:05.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:05.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj105 td/osd-backfill-space/datafile 2024-09-16T04:51:05.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:05.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj106 td/osd-backfill-space/datafile 2024-09-16T04:51:05.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:05.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj107 td/osd-backfill-space/datafile 2024-09-16T04:51:05.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:05.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj108 td/osd-backfill-space/datafile 2024-09-16T04:51:05.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:05.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj109 td/osd-backfill-space/datafile 2024-09-16T04:51:05.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:05.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj110 td/osd-backfill-space/datafile 2024-09-16T04:51:05.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:05.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj111 td/osd-backfill-space/datafile 2024-09-16T04:51:05.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:05.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj112 td/osd-backfill-space/datafile 2024-09-16T04:51:05.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:05.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj113 td/osd-backfill-space/datafile 2024-09-16T04:51:06.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:06.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj114 td/osd-backfill-space/datafile 2024-09-16T04:51:06.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:06.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj115 td/osd-backfill-space/datafile 2024-09-16T04:51:06.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:06.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj116 td/osd-backfill-space/datafile 2024-09-16T04:51:06.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:06.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj117 td/osd-backfill-space/datafile 2024-09-16T04:51:06.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:06.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj118 td/osd-backfill-space/datafile 2024-09-16T04:51:06.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:06.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj119 td/osd-backfill-space/datafile 2024-09-16T04:51:06.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:06.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj120 td/osd-backfill-space/datafile 2024-09-16T04:51:06.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:06.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj121 td/osd-backfill-space/datafile 2024-09-16T04:51:07.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:07.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj122 td/osd-backfill-space/datafile 2024-09-16T04:51:07.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:07.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj123 td/osd-backfill-space/datafile 2024-09-16T04:51:07.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:07.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj124 td/osd-backfill-space/datafile 2024-09-16T04:51:07.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:07.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj125 td/osd-backfill-space/datafile 2024-09-16T04:51:07.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:07.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj126 td/osd-backfill-space/datafile 2024-09-16T04:51:07.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:07.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj127 td/osd-backfill-space/datafile 2024-09-16T04:51:07.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:07.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj128 td/osd-backfill-space/datafile 2024-09-16T04:51:07.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:07.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj129 td/osd-backfill-space/datafile 2024-09-16T04:51:07.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:07.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj130 td/osd-backfill-space/datafile 2024-09-16T04:51:07.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:07.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj131 td/osd-backfill-space/datafile 2024-09-16T04:51:07.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:07.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj132 td/osd-backfill-space/datafile 2024-09-16T04:51:08.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:08.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj133 td/osd-backfill-space/datafile 2024-09-16T04:51:08.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:08.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj134 td/osd-backfill-space/datafile 2024-09-16T04:51:08.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:08.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj135 td/osd-backfill-space/datafile 2024-09-16T04:51:08.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:08.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj136 td/osd-backfill-space/datafile 2024-09-16T04:51:08.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:08.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj137 td/osd-backfill-space/datafile 2024-09-16T04:51:08.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:08.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj138 td/osd-backfill-space/datafile 2024-09-16T04:51:08.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:08.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj139 td/osd-backfill-space/datafile 2024-09-16T04:51:08.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:08.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj140 td/osd-backfill-space/datafile 2024-09-16T04:51:08.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:08.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj141 td/osd-backfill-space/datafile 2024-09-16T04:51:08.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:08.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj142 td/osd-backfill-space/datafile 2024-09-16T04:51:08.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:08.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj143 td/osd-backfill-space/datafile 2024-09-16T04:51:09.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:09.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj144 td/osd-backfill-space/datafile 2024-09-16T04:51:09.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:09.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj145 td/osd-backfill-space/datafile 2024-09-16T04:51:09.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:09.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj146 td/osd-backfill-space/datafile 2024-09-16T04:51:09.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:09.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj147 td/osd-backfill-space/datafile 2024-09-16T04:51:09.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:09.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj148 td/osd-backfill-space/datafile 2024-09-16T04:51:09.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:09.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj149 td/osd-backfill-space/datafile 2024-09-16T04:51:09.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:09.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj150 td/osd-backfill-space/datafile 2024-09-16T04:51:09.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:09.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj151 td/osd-backfill-space/datafile 2024-09-16T04:51:09.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:09.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj152 td/osd-backfill-space/datafile 2024-09-16T04:51:09.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:09.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj153 td/osd-backfill-space/datafile 2024-09-16T04:51:09.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:09.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj154 td/osd-backfill-space/datafile 2024-09-16T04:51:10.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj155 td/osd-backfill-space/datafile 2024-09-16T04:51:10.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj156 td/osd-backfill-space/datafile 2024-09-16T04:51:10.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj157 td/osd-backfill-space/datafile 2024-09-16T04:51:10.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj158 td/osd-backfill-space/datafile 2024-09-16T04:51:10.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj159 td/osd-backfill-space/datafile 2024-09-16T04:51:10.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj160 td/osd-backfill-space/datafile 2024-09-16T04:51:10.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj161 td/osd-backfill-space/datafile 2024-09-16T04:51:10.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj162 td/osd-backfill-space/datafile 2024-09-16T04:51:10.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj163 td/osd-backfill-space/datafile 2024-09-16T04:51:10.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj164 td/osd-backfill-space/datafile 2024-09-16T04:51:10.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj165 td/osd-backfill-space/datafile 2024-09-16T04:51:10.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj166 td/osd-backfill-space/datafile 2024-09-16T04:51:10.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:10.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj167 td/osd-backfill-space/datafile 2024-09-16T04:51:11.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj168 td/osd-backfill-space/datafile 2024-09-16T04:51:11.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj169 td/osd-backfill-space/datafile 2024-09-16T04:51:11.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj170 td/osd-backfill-space/datafile 2024-09-16T04:51:11.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj171 td/osd-backfill-space/datafile 2024-09-16T04:51:11.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj172 td/osd-backfill-space/datafile 2024-09-16T04:51:11.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj173 td/osd-backfill-space/datafile 2024-09-16T04:51:11.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj174 td/osd-backfill-space/datafile 2024-09-16T04:51:11.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj175 td/osd-backfill-space/datafile 2024-09-16T04:51:11.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj176 td/osd-backfill-space/datafile 2024-09-16T04:51:11.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj177 td/osd-backfill-space/datafile 2024-09-16T04:51:11.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj178 td/osd-backfill-space/datafile 2024-09-16T04:51:11.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj179 td/osd-backfill-space/datafile 2024-09-16T04:51:11.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:11.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj180 td/osd-backfill-space/datafile 2024-09-16T04:51:12.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj181 td/osd-backfill-space/datafile 2024-09-16T04:51:12.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj182 td/osd-backfill-space/datafile 2024-09-16T04:51:12.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj183 td/osd-backfill-space/datafile 2024-09-16T04:51:12.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj184 td/osd-backfill-space/datafile 2024-09-16T04:51:12.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj185 td/osd-backfill-space/datafile 2024-09-16T04:51:12.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj186 td/osd-backfill-space/datafile 2024-09-16T04:51:12.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj187 td/osd-backfill-space/datafile 2024-09-16T04:51:12.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj188 td/osd-backfill-space/datafile 2024-09-16T04:51:12.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj189 td/osd-backfill-space/datafile 2024-09-16T04:51:12.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj190 td/osd-backfill-space/datafile 2024-09-16T04:51:12.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj191 td/osd-backfill-space/datafile 2024-09-16T04:51:12.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj192 td/osd-backfill-space/datafile 2024-09-16T04:51:12.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:12.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj193 td/osd-backfill-space/datafile 2024-09-16T04:51:13.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:13.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj194 td/osd-backfill-space/datafile 2024-09-16T04:51:13.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:13.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj195 td/osd-backfill-space/datafile 2024-09-16T04:51:13.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:13.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj196 td/osd-backfill-space/datafile 2024-09-16T04:51:13.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:13.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj197 td/osd-backfill-space/datafile 2024-09-16T04:51:13.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:13.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj198 td/osd-backfill-space/datafile 2024-09-16T04:51:13.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:13.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj199 td/osd-backfill-space/datafile 2024-09-16T04:51:13.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:653: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:13.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:655: TEST_ec_backfill_simple: rados -p fillpool put obj200 td/osd-backfill-space/datafile 2024-09-16T04:51:13.484 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:658: TEST_ec_backfill_simple: get_primary fillpool obj1 2024-09-16T04:51:13.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=fillpool 2024-09-16T04:51:13.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T04:51:13.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map fillpool obj1 2024-09-16T04:51:13.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T04:51:13.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:658: TEST_ec_backfill_simple: local fillosd=1 2024-09-16T04:51:13.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:659: TEST_ec_backfill_simple: expr 1 + 1 2024-09-16T04:51:13.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:659: TEST_ec_backfill_simple: osd=2 2024-09-16T04:51:13.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:660: TEST_ec_backfill_simple: '[' 2 = 6 ']' 2024-09-16T04:51:13.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:664: TEST_ec_backfill_simple: sleep 5 2024-09-16T04:51:18.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:665: TEST_ec_backfill_simple: kill_daemon td/osd-backfill-space/osd.1.pid TERM 2024-09-16T04:51:18.932 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: cat td/osd-backfill-space/osd.1.pid 2024-09-16T04:51:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: local pid=459971 2024-09-16T04:51:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:247: kill_daemon: local send_signal=TERM 2024-09-16T04:51:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:248: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2024-09-16T04:51:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:249: kill_daemon: local exit_code=1 2024-09-16T04:51:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T04:51:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -TERM 459971 2024-09-16T04:51:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2024-09-16T04:51:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2024-09-16T04:51:18.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.1 2024-09-16T04:51:19.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T04:51:19.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 459971 2024-09-16T04:51:19.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2024-09-16T04:51:19.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2024-09-16T04:51:19.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.2 2024-09-16T04:51:19.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T04:51:19.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 459971 2024-09-16T04:51:19.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: exit_code=0 2024-09-16T04:51:19.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: break 2024-09-16T04:51:19.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: return 0 2024-09-16T04:51:19.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:666: TEST_ec_backfill_simple: ceph osd out osd.1 2024-09-16T04:51:19.770 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. 2024-09-16T04:51:19.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:667: TEST_ec_backfill_simple: sleep 2 2024-09-16T04:51:21.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:668: TEST_ec_backfill_simple: ceph osd erasure-code-profile set ec-profile k=3 m=2 crush-failure-domain=osd technique=reed_sol_van plugin=jerasure 2024-09-16T04:51:22.328 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:670: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:22.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:670: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:22.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:672: TEST_ec_backfill_simple: ceph osd pool create test1 1 1 erasure ec-profile 2024-09-16T04:51:23.060 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' already exists 2024-09-16T04:51:23.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:677: TEST_ec_backfill_simple: sleep 5 2024-09-16T04:51:28.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:679: TEST_ec_backfill_simple: ceph pg dump pgs 2024-09-16T04:51:28.473 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:51:28.473 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 0 0 0 0 0 0 0 0 0 0 0 unknown 2024-09-16T04:51:22.828975+0000 0'0 0:0 [] -1 [] -1 0'0 2024-09-16T04:51:22.828975+0000 0'0 2024-09-16T04:51:22.828975+0000 0 0 -- 0 0 2024-09-16T04:51:28.473 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 200 0 0 0 0 2662400 0 0 100 100 100 stale+active+clean 2024-09-16T04:50:55.178325+0000 39'200 39:217 [1] 1 [1] 1 0'0 2024-09-16T04:50:52.520732+0000 0'0 2024-09-16T04:50:52.520732+0000 0 0 periodic scrub scheduled @ 2024-09-17T14:03:59.623720+0000 0 0 2024-09-16T04:51:28.473 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:51:28.473 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:51:28.474 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:51:28.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:681: TEST_ec_backfill_simple: dd if=/dev/urandom of=td/osd-backfill-space/datafile bs=1024 count=18 2024-09-16T04:51:28.485 INFO:tasks.workunit.client.0.smithi026.stderr:18+0 records in 2024-09-16T04:51:28.485 INFO:tasks.workunit.client.0.smithi026.stderr:18+0 records out 2024-09-16T04:51:28.485 INFO:tasks.workunit.client.0.smithi026.stderr:18432 bytes (18 kB, 18 KiB) copied, 0.000151511 s, 122 MB/s 2024-09-16T04:51:28.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: seq 1 200 2024-09-16T04:51:28.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:28.486 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:28.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:28.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj1 td/osd-backfill-space/datafile 2024-09-16T04:51:28.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:28.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:28.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:28.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj2 td/osd-backfill-space/datafile 2024-09-16T04:51:28.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:28.927 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:28.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:28.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj3 td/osd-backfill-space/datafile 2024-09-16T04:51:29.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:29.204 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:29.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:29.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj4 td/osd-backfill-space/datafile 2024-09-16T04:51:29.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:29.465 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:29.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:29.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj5 td/osd-backfill-space/datafile 2024-09-16T04:51:29.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:29.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:29.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:29.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj6 td/osd-backfill-space/datafile 2024-09-16T04:51:30.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:30.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:30.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:30.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj7 td/osd-backfill-space/datafile 2024-09-16T04:51:30.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:30.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:30.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:30.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj8 td/osd-backfill-space/datafile 2024-09-16T04:51:30.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:30.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:30.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:30.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj9 td/osd-backfill-space/datafile 2024-09-16T04:51:30.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:30.925 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:30.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:30.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj10 td/osd-backfill-space/datafile 2024-09-16T04:51:31.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:31.211 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:31.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:31.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj11 td/osd-backfill-space/datafile 2024-09-16T04:51:31.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:31.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:31.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:31.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj12 td/osd-backfill-space/datafile 2024-09-16T04:51:31.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:31.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:31.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:31.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj13 td/osd-backfill-space/datafile 2024-09-16T04:51:32.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:32.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:32.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:32.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj14 td/osd-backfill-space/datafile 2024-09-16T04:51:32.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:32.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:32.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:32.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj15 td/osd-backfill-space/datafile 2024-09-16T04:51:32.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:32.713 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:32.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:32.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj16 td/osd-backfill-space/datafile 2024-09-16T04:51:33.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:33.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:33.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:33.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj17 td/osd-backfill-space/datafile 2024-09-16T04:51:33.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:33.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:33.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:33.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj18 td/osd-backfill-space/datafile 2024-09-16T04:51:33.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:33.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:33.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:33.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj19 td/osd-backfill-space/datafile 2024-09-16T04:51:33.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:33.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:33.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:33.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj20 td/osd-backfill-space/datafile 2024-09-16T04:51:34.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:34.182 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:34.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:34.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj21 td/osd-backfill-space/datafile 2024-09-16T04:51:34.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:34.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:34.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:34.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj22 td/osd-backfill-space/datafile 2024-09-16T04:51:34.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:34.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:34.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:34.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj23 td/osd-backfill-space/datafile 2024-09-16T04:51:34.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:34.997 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:34.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:34.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj24 td/osd-backfill-space/datafile 2024-09-16T04:51:35.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:35.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:35.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:35.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj25 td/osd-backfill-space/datafile 2024-09-16T04:51:35.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:35.602 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:35.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:35.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj26 td/osd-backfill-space/datafile 2024-09-16T04:51:35.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:35.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:35.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:35.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj27 td/osd-backfill-space/datafile 2024-09-16T04:51:36.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:36.163 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:36.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:36.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj28 td/osd-backfill-space/datafile 2024-09-16T04:51:36.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:36.448 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:36.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:36.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj29 td/osd-backfill-space/datafile 2024-09-16T04:51:36.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:36.751 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:36.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:36.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj30 td/osd-backfill-space/datafile 2024-09-16T04:51:37.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:37.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:37.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:37.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj31 td/osd-backfill-space/datafile 2024-09-16T04:51:37.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:37.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:37.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:37.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj32 td/osd-backfill-space/datafile 2024-09-16T04:51:37.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:37.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:37.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:37.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj33 td/osd-backfill-space/datafile 2024-09-16T04:51:38.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:38.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:38.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:38.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj34 td/osd-backfill-space/datafile 2024-09-16T04:51:38.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:38.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:38.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:38.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj35 td/osd-backfill-space/datafile 2024-09-16T04:51:38.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:38.772 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:38.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:38.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj36 td/osd-backfill-space/datafile 2024-09-16T04:51:39.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:39.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:39.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:39.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj37 td/osd-backfill-space/datafile 2024-09-16T04:51:39.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:39.326 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:39.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:39.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj38 td/osd-backfill-space/datafile 2024-09-16T04:51:39.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:39.578 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:39.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:39.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj39 td/osd-backfill-space/datafile 2024-09-16T04:51:39.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:39.864 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:39.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:39.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj40 td/osd-backfill-space/datafile 2024-09-16T04:51:40.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:40.124 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:40.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:40.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj41 td/osd-backfill-space/datafile 2024-09-16T04:51:40.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:40.433 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:40.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:40.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj42 td/osd-backfill-space/datafile 2024-09-16T04:51:40.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:40.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:40.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:40.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj43 td/osd-backfill-space/datafile 2024-09-16T04:51:41.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:41.024 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:41.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:41.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj44 td/osd-backfill-space/datafile 2024-09-16T04:51:41.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:41.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:41.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:41.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj45 td/osd-backfill-space/datafile 2024-09-16T04:51:41.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:41.569 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:41.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:41.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj46 td/osd-backfill-space/datafile 2024-09-16T04:51:41.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:41.813 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:41.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:41.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj47 td/osd-backfill-space/datafile 2024-09-16T04:51:42.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:42.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:42.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:42.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj48 td/osd-backfill-space/datafile 2024-09-16T04:51:42.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:42.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:42.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:42.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj49 td/osd-backfill-space/datafile 2024-09-16T04:51:42.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:42.686 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:42.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:42.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj50 td/osd-backfill-space/datafile 2024-09-16T04:51:42.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:42.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:42.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:42.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj51 td/osd-backfill-space/datafile 2024-09-16T04:51:43.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:43.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:43.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:43.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj52 td/osd-backfill-space/datafile 2024-09-16T04:51:43.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:43.517 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:43.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:43.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj53 td/osd-backfill-space/datafile 2024-09-16T04:51:43.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:43.844 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:43.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:43.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj54 td/osd-backfill-space/datafile 2024-09-16T04:51:44.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:44.130 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:44.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:44.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj55 td/osd-backfill-space/datafile 2024-09-16T04:51:44.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:44.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:44.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:44.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj56 td/osd-backfill-space/datafile 2024-09-16T04:51:44.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:44.701 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:44.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:44.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj57 td/osd-backfill-space/datafile 2024-09-16T04:51:44.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:44.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:44.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:44.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj58 td/osd-backfill-space/datafile 2024-09-16T04:51:45.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:45.288 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:45.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:45.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj59 td/osd-backfill-space/datafile 2024-09-16T04:51:45.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:45.557 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:45.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:45.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj60 td/osd-backfill-space/datafile 2024-09-16T04:51:45.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:45.842 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:45.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:45.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj61 td/osd-backfill-space/datafile 2024-09-16T04:51:46.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:46.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:46.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:46.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj62 td/osd-backfill-space/datafile 2024-09-16T04:51:46.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:46.396 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:46.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:46.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj63 td/osd-backfill-space/datafile 2024-09-16T04:51:46.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:46.682 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:46.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:46.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj64 td/osd-backfill-space/datafile 2024-09-16T04:51:46.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:46.976 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:46.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:46.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj65 td/osd-backfill-space/datafile 2024-09-16T04:51:47.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:47.261 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:47.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:47.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj66 td/osd-backfill-space/datafile 2024-09-16T04:51:47.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:47.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:47.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:47.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj67 td/osd-backfill-space/datafile 2024-09-16T04:51:47.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:47.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:47.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:47.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj68 td/osd-backfill-space/datafile 2024-09-16T04:51:48.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:48.134 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:48.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:48.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj69 td/osd-backfill-space/datafile 2024-09-16T04:51:48.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:48.427 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:48.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:48.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj70 td/osd-backfill-space/datafile 2024-09-16T04:51:48.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:48.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:48.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:48.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj71 td/osd-backfill-space/datafile 2024-09-16T04:51:49.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:49.015 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:49.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:49.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj72 td/osd-backfill-space/datafile 2024-09-16T04:51:49.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:49.300 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:49.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:49.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj73 td/osd-backfill-space/datafile 2024-09-16T04:51:49.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:49.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:49.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:49.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj74 td/osd-backfill-space/datafile 2024-09-16T04:51:49.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:49.879 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:49.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:49.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj75 td/osd-backfill-space/datafile 2024-09-16T04:51:50.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:50.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:50.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:50.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj76 td/osd-backfill-space/datafile 2024-09-16T04:51:50.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:50.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:50.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:50.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj77 td/osd-backfill-space/datafile 2024-09-16T04:51:50.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:50.702 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:50.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:50.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj78 td/osd-backfill-space/datafile 2024-09-16T04:51:50.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:50.996 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:50.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:50.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj79 td/osd-backfill-space/datafile 2024-09-16T04:51:51.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:51.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:51.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:51.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj80 td/osd-backfill-space/datafile 2024-09-16T04:51:51.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:51.551 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:51.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:51.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj81 td/osd-backfill-space/datafile 2024-09-16T04:51:51.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:51.844 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:51.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:51.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj82 td/osd-backfill-space/datafile 2024-09-16T04:51:52.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:52.129 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:52.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:52.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj83 td/osd-backfill-space/datafile 2024-09-16T04:51:52.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:52.398 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:52.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:52.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj84 td/osd-backfill-space/datafile 2024-09-16T04:51:52.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:52.700 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:52.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:52.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj85 td/osd-backfill-space/datafile 2024-09-16T04:51:52.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:52.977 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:52.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:52.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj86 td/osd-backfill-space/datafile 2024-09-16T04:51:53.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:53.272 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:53.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:53.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj87 td/osd-backfill-space/datafile 2024-09-16T04:51:53.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:53.548 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:53.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:53.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj88 td/osd-backfill-space/datafile 2024-09-16T04:51:53.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:53.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:53.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:53.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj89 td/osd-backfill-space/datafile 2024-09-16T04:51:54.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:54.094 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:54.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:54.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj90 td/osd-backfill-space/datafile 2024-09-16T04:51:54.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:54.404 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:54.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:54.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj91 td/osd-backfill-space/datafile 2024-09-16T04:51:54.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:54.723 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:54.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:54.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj92 td/osd-backfill-space/datafile 2024-09-16T04:51:55.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:55.025 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:55.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:55.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj93 td/osd-backfill-space/datafile 2024-09-16T04:51:55.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:55.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:55.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:55.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj94 td/osd-backfill-space/datafile 2024-09-16T04:51:55.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:55.604 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:55.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:55.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj95 td/osd-backfill-space/datafile 2024-09-16T04:51:55.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:55.873 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:55.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:55.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj96 td/osd-backfill-space/datafile 2024-09-16T04:51:56.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:56.191 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:56.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:56.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj97 td/osd-backfill-space/datafile 2024-09-16T04:51:56.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:56.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:56.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:56.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj98 td/osd-backfill-space/datafile 2024-09-16T04:51:56.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:56.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:56.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:56.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj99 td/osd-backfill-space/datafile 2024-09-16T04:51:57.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:57.023 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:57.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:57.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj100 td/osd-backfill-space/datafile 2024-09-16T04:51:57.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:57.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:57.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:57.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj101 td/osd-backfill-space/datafile 2024-09-16T04:51:57.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:57.585 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:57.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:57.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj102 td/osd-backfill-space/datafile 2024-09-16T04:51:57.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:57.912 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:57.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:57.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj103 td/osd-backfill-space/datafile 2024-09-16T04:51:58.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:58.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:58.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:58.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj104 td/osd-backfill-space/datafile 2024-09-16T04:51:58.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:58.467 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:58.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:58.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj105 td/osd-backfill-space/datafile 2024-09-16T04:51:58.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:58.760 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:58.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:58.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj106 td/osd-backfill-space/datafile 2024-09-16T04:51:59.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:59.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:59.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:59.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj107 td/osd-backfill-space/datafile 2024-09-16T04:51:59.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:59.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:59.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:59.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj108 td/osd-backfill-space/datafile 2024-09-16T04:51:59.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:51:59.708 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:51:59.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:51:59.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj109 td/osd-backfill-space/datafile 2024-09-16T04:52:00.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:00.002 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:00.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:00.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj110 td/osd-backfill-space/datafile 2024-09-16T04:52:00.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:00.262 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:00.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:00.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj111 td/osd-backfill-space/datafile 2024-09-16T04:52:00.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:00.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:00.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:00.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj112 td/osd-backfill-space/datafile 2024-09-16T04:52:00.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:00.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:00.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:00.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj113 td/osd-backfill-space/datafile 2024-09-16T04:52:01.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:01.102 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:01.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:01.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj114 td/osd-backfill-space/datafile 2024-09-16T04:52:01.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:01.396 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:01.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:01.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj115 td/osd-backfill-space/datafile 2024-09-16T04:52:01.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:01.723 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:01.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:01.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj116 td/osd-backfill-space/datafile 2024-09-16T04:52:02.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:02.000 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:02.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:02.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj117 td/osd-backfill-space/datafile 2024-09-16T04:52:02.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:02.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:02.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:02.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj118 td/osd-backfill-space/datafile 2024-09-16T04:52:02.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:02.554 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:02.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:02.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj119 td/osd-backfill-space/datafile 2024-09-16T04:52:02.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:02.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:02.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:02.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj120 td/osd-backfill-space/datafile 2024-09-16T04:52:03.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:03.142 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:03.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:03.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj121 td/osd-backfill-space/datafile 2024-09-16T04:52:03.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:03.427 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:03.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:03.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj122 td/osd-backfill-space/datafile 2024-09-16T04:52:03.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:03.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:03.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:03.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj123 td/osd-backfill-space/datafile 2024-09-16T04:52:04.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:04.006 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:04.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:04.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj124 td/osd-backfill-space/datafile 2024-09-16T04:52:04.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:04.283 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:04.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:04.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj125 td/osd-backfill-space/datafile 2024-09-16T04:52:04.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:04.602 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:04.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:04.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj126 td/osd-backfill-space/datafile 2024-09-16T04:52:04.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:04.904 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:04.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:04.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj127 td/osd-backfill-space/datafile 2024-09-16T04:52:05.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:05.206 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:05.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:05.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj128 td/osd-backfill-space/datafile 2024-09-16T04:52:05.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:05.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:05.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:05.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj129 td/osd-backfill-space/datafile 2024-09-16T04:52:05.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:05.752 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:05.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:05.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj130 td/osd-backfill-space/datafile 2024-09-16T04:52:05.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:05.996 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:05.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:05.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj131 td/osd-backfill-space/datafile 2024-09-16T04:52:06.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:06.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:06.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:06.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj132 td/osd-backfill-space/datafile 2024-09-16T04:52:06.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:06.583 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:06.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:06.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj133 td/osd-backfill-space/datafile 2024-09-16T04:52:06.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:06.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:06.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:06.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj134 td/osd-backfill-space/datafile 2024-09-16T04:52:07.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:07.121 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:07.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:07.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj135 td/osd-backfill-space/datafile 2024-09-16T04:52:07.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:07.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:07.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:07.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj136 td/osd-backfill-space/datafile 2024-09-16T04:52:07.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:07.691 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:07.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:07.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj137 td/osd-backfill-space/datafile 2024-09-16T04:52:08.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:08.002 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:08.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:08.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj138 td/osd-backfill-space/datafile 2024-09-16T04:52:08.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:08.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:08.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:08.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj139 td/osd-backfill-space/datafile 2024-09-16T04:52:08.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:08.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:08.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:08.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj140 td/osd-backfill-space/datafile 2024-09-16T04:52:09.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:09.184 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:09.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:09.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj141 td/osd-backfill-space/datafile 2024-09-16T04:52:09.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:09.435 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:09.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:09.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj142 td/osd-backfill-space/datafile 2024-09-16T04:52:09.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:09.730 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:09.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:09.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj143 td/osd-backfill-space/datafile 2024-09-16T04:52:10.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:10.014 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:10.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:10.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj144 td/osd-backfill-space/datafile 2024-09-16T04:52:10.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:10.308 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:10.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:10.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj145 td/osd-backfill-space/datafile 2024-09-16T04:52:10.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:10.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:10.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:10.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj146 td/osd-backfill-space/datafile 2024-09-16T04:52:10.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:10.913 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:10.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:10.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj147 td/osd-backfill-space/datafile 2024-09-16T04:52:11.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:11.189 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:11.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:11.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj148 td/osd-backfill-space/datafile 2024-09-16T04:52:11.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:11.467 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:11.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:11.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj149 td/osd-backfill-space/datafile 2024-09-16T04:52:11.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:11.769 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:11.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:11.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj150 td/osd-backfill-space/datafile 2024-09-16T04:52:12.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:12.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:12.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:12.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj151 td/osd-backfill-space/datafile 2024-09-16T04:52:12.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:12.348 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:12.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:12.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj152 td/osd-backfill-space/datafile 2024-09-16T04:52:12.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:12.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:12.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:12.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj153 td/osd-backfill-space/datafile 2024-09-16T04:52:12.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:12.936 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:12.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:12.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj154 td/osd-backfill-space/datafile 2024-09-16T04:52:13.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:13.205 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:13.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:13.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj155 td/osd-backfill-space/datafile 2024-09-16T04:52:13.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:13.498 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:13.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:13.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj156 td/osd-backfill-space/datafile 2024-09-16T04:52:13.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:13.793 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:13.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:13.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj157 td/osd-backfill-space/datafile 2024-09-16T04:52:14.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:14.089 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:14.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:14.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj158 td/osd-backfill-space/datafile 2024-09-16T04:52:14.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:14.472 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:14.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:14.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj159 td/osd-backfill-space/datafile 2024-09-16T04:52:14.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:14.765 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:14.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:14.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj160 td/osd-backfill-space/datafile 2024-09-16T04:52:15.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:15.068 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:15.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:15.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj161 td/osd-backfill-space/datafile 2024-09-16T04:52:15.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:15.361 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:15.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:15.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj162 td/osd-backfill-space/datafile 2024-09-16T04:52:15.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:15.635 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:15.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:15.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj163 td/osd-backfill-space/datafile 2024-09-16T04:52:15.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:15.927 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:15.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:15.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj164 td/osd-backfill-space/datafile 2024-09-16T04:52:16.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:16.212 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:16.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:16.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj165 td/osd-backfill-space/datafile 2024-09-16T04:52:16.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:16.455 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:16.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:16.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj166 td/osd-backfill-space/datafile 2024-09-16T04:52:16.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:16.775 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:16.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:16.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj167 td/osd-backfill-space/datafile 2024-09-16T04:52:17.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:17.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:17.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:17.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj168 td/osd-backfill-space/datafile 2024-09-16T04:52:17.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:17.328 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:17.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:17.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj169 td/osd-backfill-space/datafile 2024-09-16T04:52:17.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:17.647 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:17.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:17.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj170 td/osd-backfill-space/datafile 2024-09-16T04:52:17.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:17.916 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:17.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:17.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj171 td/osd-backfill-space/datafile 2024-09-16T04:52:18.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:18.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:18.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:18.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj172 td/osd-backfill-space/datafile 2024-09-16T04:52:18.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:18.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:18.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:18.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj173 td/osd-backfill-space/datafile 2024-09-16T04:52:18.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:18.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:18.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:18.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj174 td/osd-backfill-space/datafile 2024-09-16T04:52:19.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:19.074 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:19.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:19.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj175 td/osd-backfill-space/datafile 2024-09-16T04:52:19.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:19.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:19.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:19.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj176 td/osd-backfill-space/datafile 2024-09-16T04:52:19.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:19.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:19.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:19.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj177 td/osd-backfill-space/datafile 2024-09-16T04:52:19.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:19.930 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:19.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:19.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj178 td/osd-backfill-space/datafile 2024-09-16T04:52:20.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:20.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:20.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:20.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj179 td/osd-backfill-space/datafile 2024-09-16T04:52:20.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:20.526 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:20.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:20.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj180 td/osd-backfill-space/datafile 2024-09-16T04:52:20.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:20.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:20.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:20.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj181 td/osd-backfill-space/datafile 2024-09-16T04:52:21.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:21.122 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:21.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:21.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj182 td/osd-backfill-space/datafile 2024-09-16T04:52:21.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:21.399 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:21.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:21.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj183 td/osd-backfill-space/datafile 2024-09-16T04:52:21.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:21.667 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:21.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:21.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj184 td/osd-backfill-space/datafile 2024-09-16T04:52:21.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:21.989 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:21.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:21.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj185 td/osd-backfill-space/datafile 2024-09-16T04:52:22.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:22.279 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:22.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:22.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj186 td/osd-backfill-space/datafile 2024-09-16T04:52:22.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:22.581 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:22.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:22.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj187 td/osd-backfill-space/datafile 2024-09-16T04:52:22.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:22.901 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:22.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:22.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj188 td/osd-backfill-space/datafile 2024-09-16T04:52:23.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:23.177 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:23.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:23.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj189 td/osd-backfill-space/datafile 2024-09-16T04:52:23.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:23.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:23.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:23.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj190 td/osd-backfill-space/datafile 2024-09-16T04:52:23.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:23.731 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:23.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:23.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj191 td/osd-backfill-space/datafile 2024-09-16T04:52:24.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:24.008 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:24.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:24.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj192 td/osd-backfill-space/datafile 2024-09-16T04:52:24.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:24.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:24.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:24.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj193 td/osd-backfill-space/datafile 2024-09-16T04:52:24.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:24.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:24.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:24.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj194 td/osd-backfill-space/datafile 2024-09-16T04:52:24.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:24.865 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:24.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:24.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj195 td/osd-backfill-space/datafile 2024-09-16T04:52:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:25.125 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:25.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:25.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj196 td/osd-backfill-space/datafile 2024-09-16T04:52:25.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:25.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:25.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:25.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj197 td/osd-backfill-space/datafile 2024-09-16T04:52:25.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:25.704 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:25.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:25.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj198 td/osd-backfill-space/datafile 2024-09-16T04:52:25.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:25.997 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:25.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:25.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj199 td/osd-backfill-space/datafile 2024-09-16T04:52:26.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:682: TEST_ec_backfill_simple: for o in $(seq 1 $ecobjects) 2024-09-16T04:52:26.241 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:52:26.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:684: TEST_ec_backfill_simple: for p in $(seq 1 $pools) 2024-09-16T04:52:26.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:686: TEST_ec_backfill_simple: rados -p test1 put obj200 td/osd-backfill-space/datafile 2024-09-16T04:52:26.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:690: TEST_ec_backfill_simple: kill_daemon td/osd-backfill-space/osd.2.pid TERM 2024-09-16T04:52:26.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: cat td/osd-backfill-space/osd.2.pid 2024-09-16T04:52:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:246: kill_daemon: local pid=461696 2024-09-16T04:52:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:247: kill_daemon: local send_signal=TERM 2024-09-16T04:52:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:248: kill_daemon: local 'delays=0.1 0.2 1 1 1 2 3 5 5 5 10 10 20 60 60 60 120' 2024-09-16T04:52:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:249: kill_daemon: local exit_code=1 2024-09-16T04:52:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T04:52:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -TERM 461696 2024-09-16T04:52:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2024-09-16T04:52:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2024-09-16T04:52:26.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.1 2024-09-16T04:52:26.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T04:52:26.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 461696 2024-09-16T04:52:26.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2024-09-16T04:52:26.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2024-09-16T04:52:26.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 0.2 2024-09-16T04:52:26.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T04:52:26.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 461696 2024-09-16T04:52:26.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:254: kill_daemon: exit_code=1 2024-09-16T04:52:26.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:259: kill_daemon: send_signal=0 2024-09-16T04:52:26.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:260: kill_daemon: sleep 1 2024-09-16T04:52:27.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:252: kill_daemon: for try in $delays 0 2024-09-16T04:52:27.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:253: kill_daemon: kill -0 461696 2024-09-16T04:52:27.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:256: kill_daemon: exit_code=0 2024-09-16T04:52:27.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:257: kill_daemon: break 2024-09-16T04:52:27.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:262: kill_daemon: return 0 2024-09-16T04:52:27.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:691: TEST_ec_backfill_simple: ceph osd out osd.2 2024-09-16T04:52:28.326 INFO:tasks.workunit.client.0.smithi026.stderr:osd.2 is already out. 2024-09-16T04:52:28.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:693: TEST_ec_backfill_simple: activate_osd td/osd-backfill-space 1 2024-09-16T04:52:28.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-backfill-space 2024-09-16T04:52:28.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2024-09-16T04:52:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2024-09-16T04:52:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2024-09-16T04:52:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-backfill-space/1 2024-09-16T04:52:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true ' 2024-09-16T04:52:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:52:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:52:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:52:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-backfill-space/1' 2024-09-16T04:52:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-backfill-space/1/journal' 2024-09-16T04:52:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2024-09-16T04:52:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2024-09-16T04:52:28.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-backfill-space' 2024-09-16T04:52:28.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2024-09-16T04:52:28.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:52:28.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:52:28.343 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:52:28.343 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:52:28.343 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:52:28.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:52:28.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' 2024-09-16T04:52:28.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:52:28.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-backfill-space/$name.log' 2024-09-16T04:52:28.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-backfill-space/$name.pid' 2024-09-16T04:52:28.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:52:28.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:52:28.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:52:28.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:52:28.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2024-09-16T04:52:28.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2024-09-16T04:52:28.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-backfill-space/1 2024-09-16T04:52:28.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2024-09-16T04:52:28.345 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T04:52:28.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=c285045d-f173-454b-b858-a2830ec25049 --auth-supported=none --mon-host=127.0.0.1:7180 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --fake_statfs_for_testing=3686400 --osd_max_backfills=10 --osd_mclock_override_recovery_settings=true --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-space/1 --osd-journal=td/osd-backfill-space/1/journal --chdir= --run-dir=td/osd-backfill-space '--admin-socket=/tmp/ceph-asok.114688/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-backfill-space/$name.log' '--pid-file=td/osd-backfill-space/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:52:28.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-backfill-space/1/whoami 2024-09-16T04:52:28.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2024-09-16T04:52:28.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2024-09-16T04:52:28.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2024-09-16T04:52:28.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2024-09-16T04:52:28.375 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:52:28.374+0000 7fdbdd822640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:52:28.402 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:52:28.401+0000 7fdbdd822640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:52:28.402 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:52:28.402+0000 7fdbdd822640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:52:28.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2024-09-16T04:52:28.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:52:28.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:52:28.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:52:28.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:52:28.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:52:28.755 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:52:28.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:52:28.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:52:28.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:52:29.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:52:29.248 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:52:29.247+0000 7fdbdd822640 -1 Falling back to public interface 2024-09-16T04:52:30.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:52:30.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:52:30.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:52:30.201 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:52:30.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:52:30.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:52:30.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:52:31.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:52:31.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:52:31.640 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:52:31.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:52:31.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:52:31.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:52:32.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:52:32.515 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:52:32.513+0000 7fdbdd822640 -1 osd.1 39 log_to_monitors true 2024-09-16T04:52:33.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:52:33.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:52:33.065 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:52:33.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:52:33.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:52:33.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:52:33.554 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up out weight 0 up_from 51 up_thru 36 down_at 40 last_clean_interval [10,39) [v2:127.0.0.1:6810/178204827,v1:127.0.0.1:6811/178204827] [v2:127.0.0.1:6812/178204827,v1:127.0.0.1:6813/178204827] exists,up 73c5e3d2-e23f-4ca9-8c8a-3a3f611b1a95 2024-09-16T04:52:33.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:52:33.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:52:33.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:52:33.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:694: TEST_ec_backfill_simple: ceph osd in osd.1 2024-09-16T04:52:34.287 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already in. 2024-09-16T04:52:34.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:695: TEST_ec_backfill_simple: sleep 30 2024-09-16T04:53:04.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:697: TEST_ec_backfill_simple: ceph pg dump pgs 2024-09-16T04:53:04.706 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:53:04.706 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 200 0 200 200 0 3686400 0 0 100 100 100 active+undersized+degraded+remapped+backfill_toofull 2024-09-16T04:52:36.246721+0000 46'200 57:250 [3,5,1,0,4] 3 [3,5,4,0,NONE] 3 0'0 2024-09-16T04:51:22.828975+0000 0'0 2024-09-16T04:51:22.828975+0000 0 0 no scrub is scheduled 0 0 2024-09-16T04:53:04.706 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 200 0 0 0 0 2662400 0 0 100 100 100 active+clean 2024-09-16T04:52:35.333283+0000 39'200 57:232 [1] 1 [1] 1 0'0 2024-09-16T04:50:52.520732+0000 0'0 2024-09-16T04:50:52.520732+0000 0 0 periodic scrub scheduled @ 2024-09-17T16:33:52.341131+0000 0 0 2024-09-16T04:53:04.707 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:53:04.707 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:53:04.707 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:53:04.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:699: TEST_ec_backfill_simple: wait_for_not_backfilling 1200 2024-09-16T04:53:04.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:83: wait_for_not_backfilling: local timeout=1200 2024-09-16T04:53:04.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:84: wait_for_not_backfilling: wait_for_not_state backfilling 1200 2024-09-16T04:53:04.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=backfilling 2024-09-16T04:53:04.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-09-16T04:53:04.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-09-16T04:53:04.719 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 1200 5 2024-09-16T04:53:04.719 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:53:04.720 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:53:04.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:53:04.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:53:04.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:53:05.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15' '15') 2024-09-16T04:53:05.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-09-16T04:53:05.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-09-16T04:53:05.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-09-16T04:53:05.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:53:05.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:53:05.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:53:05.730 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:53:05.730 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:53:05.730 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:53:05.730 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T04:53:05.730 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T04:53:05.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:53:05.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:53:05.731 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:53:05.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836551 2024-09-16T04:53:05.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836551 2024-09-16T04:53:05.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836551' 2024-09-16T04:53:05.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:53:05.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:53:05.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=219043332105 2024-09-16T04:53:05.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 219043332105 2024-09-16T04:53:05.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836551 1-219043332105' 2024-09-16T04:53:05.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:53:05.978 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:53:06.067 INFO:tasks.workunit.client.0.smithi026.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T04:53:06.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq= 2024-09-16T04:53:06.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z '' 2024-09-16T04:53:06.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: continue 2024-09-16T04:53:06.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:53:06.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:53:06.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345966 2024-09-16T04:53:06.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345966 2024-09-16T04:53:06.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836551 1-219043332105 3-85899345966' 2024-09-16T04:53:06.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:53:06.192 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:53:06.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182442 2024-09-16T04:53:06.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182442 2024-09-16T04:53:06.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836551 1-219043332105 3-85899345966 4-107374182442' 2024-09-16T04:53:06.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:53:06.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T04:53:06.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018916 2024-09-16T04:53:06.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018916 2024-09-16T04:53:06.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836551 1-219043332105 3-85899345966 4-107374182442 5-128849018916' 2024-09-16T04:53:06.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:53:06.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836551 2024-09-16T04:53:06.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:53:06.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:53:06.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836551 2024-09-16T04:53:06.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:53:06.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836551 2024-09-16T04:53:06.441 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836551 2024-09-16T04:53:06.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836551' 2024-09-16T04:53:06.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:53:06.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836549 -lt 21474836551 2024-09-16T04:53:06.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:53:07.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:53:07.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:53:08.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836551 -lt 21474836551 2024-09-16T04:53:08.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:53:08.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-219043332105 2024-09-16T04:53:08.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:53:08.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:53:08.340 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-219043332105 2024-09-16T04:53:08.340 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:53:08.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=219043332105 2024-09-16T04:53:08.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 219043332105' 2024-09-16T04:53:08.342 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 219043332105 2024-09-16T04:53:08.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:53:08.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 219043332105 -lt 219043332105 2024-09-16T04:53:08.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:53:08.788 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345966 2024-09-16T04:53:08.788 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:53:08.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:53:08.790 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345966 2024-09-16T04:53:08.790 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:53:08.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345966 2024-09-16T04:53:08.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345966' 2024-09-16T04:53:08.791 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345966 2024-09-16T04:53:08.791 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:53:09.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345966 -lt 85899345966 2024-09-16T04:53:09.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:53:09.230 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182442 2024-09-16T04:53:09.230 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:53:09.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:53:09.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182442 2024-09-16T04:53:09.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:53:09.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182442 2024-09-16T04:53:09.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182442' 2024-09-16T04:53:09.233 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182442 2024-09-16T04:53:09.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:53:09.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182442 -lt 107374182442 2024-09-16T04:53:09.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:53:09.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018916 2024-09-16T04:53:09.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:53:09.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T04:53:09.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018916 2024-09-16T04:53:09.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:53:09.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018916 2024-09-16T04:53:09.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018916' 2024-09-16T04:53:09.759 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018916 2024-09-16T04:53:09.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T04:53:10.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018916 -lt 128849018916 2024-09-16T04:53:10.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-09-16T04:53:10.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:53:10.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:53:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 2 == 0 2024-09-16T04:53:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:53:10.957 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state backfilling 2024-09-16T04:53:10.957 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=backfilling 2024-09-16T04:53:10.957 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:53:10.957 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("backfilling"))' 2024-09-16T04:53:10.957 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:53:10.957 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("backfilling"))] | length' 2024-09-16T04:53:11.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-09-16T04:53:11.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-09-16T04:53:11.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-09-16T04:53:11.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-09-16T04:53:11.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:700: TEST_ec_backfill_simple: wait_for_not_activating 60 2024-09-16T04:53:11.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:89: wait_for_not_activating: local timeout=60 2024-09-16T04:53:11.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:90: wait_for_not_activating: wait_for_not_state activating 60 2024-09-16T04:53:11.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:54: wait_for_not_state: local state=activating 2024-09-16T04:53:11.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:55: wait_for_not_state: local num_in_state=-1 2024-09-16T04:53:11.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:56: wait_for_not_state: local cur_in_state 2024-09-16T04:53:11.374 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: get_timeout_delays 60 5 2024-09-16T04:53:11.374 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:53:11.374 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:53:11.375 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:53:11.375 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:53:11.375 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:53:11.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: delays=('5' '10' '15' '15' '15') 2024-09-16T04:53:11.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:57: wait_for_not_state: local -a delays 2024-09-16T04:53:11.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:58: wait_for_not_state: local -i loop=0 2024-09-16T04:53:11.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:60: wait_for_not_state: flush_pg_stats 2024-09-16T04:53:11.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:53:11.413 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:53:11.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:53:11.839 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:53:11.839 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:53:11.840 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:53:11.840 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T04:53:11.840 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T04:53:11.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:53:11.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:53:11.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:53:11.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836554 2024-09-16T04:53:11.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836554 2024-09-16T04:53:11.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836554' 2024-09-16T04:53:11.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:53:11.963 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:53:12.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=219043332108 2024-09-16T04:53:12.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 219043332108 2024-09-16T04:53:12.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836554 1-219043332108' 2024-09-16T04:53:12.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:53:12.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:53:12.176 INFO:tasks.workunit.client.0.smithi026.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-16T04:53:12.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq= 2024-09-16T04:53:12.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z '' 2024-09-16T04:53:12.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: continue 2024-09-16T04:53:12.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:53:12.178 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:53:12.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345969 2024-09-16T04:53:12.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345969 2024-09-16T04:53:12.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836554 1-219043332108 3-85899345969' 2024-09-16T04:53:12.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:53:12.305 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:53:12.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182445 2024-09-16T04:53:12.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182445 2024-09-16T04:53:12.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836554 1-219043332108 3-85899345969 4-107374182445' 2024-09-16T04:53:12.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:53:12.428 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T04:53:12.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018919 2024-09-16T04:53:12.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018919 2024-09-16T04:53:12.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836554 1-219043332108 3-85899345969 4-107374182445 5-128849018919' 2024-09-16T04:53:12.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:53:12.553 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836554 2024-09-16T04:53:12.553 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:53:12.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:53:12.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836554 2024-09-16T04:53:12.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:53:12.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836554 2024-09-16T04:53:12.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836554' 2024-09-16T04:53:12.556 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836554 2024-09-16T04:53:12.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:53:13.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836552 -lt 21474836554 2024-09-16T04:53:13.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T04:53:14.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T04:53:14.008 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:53:14.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836555 -lt 21474836554 2024-09-16T04:53:14.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:53:14.474 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-219043332108 2024-09-16T04:53:14.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:53:14.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:53:14.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-219043332108 2024-09-16T04:53:14.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:53:14.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=219043332108 2024-09-16T04:53:14.477 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 219043332108 2024-09-16T04:53:14.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 219043332108' 2024-09-16T04:53:14.478 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:53:14.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 219043332109 -lt 219043332108 2024-09-16T04:53:14.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:53:14.991 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345969 2024-09-16T04:53:14.991 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:53:14.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:53:14.993 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345969 2024-09-16T04:53:14.993 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:53:14.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345969 2024-09-16T04:53:14.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345969' 2024-09-16T04:53:14.994 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345969 2024-09-16T04:53:14.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:53:15.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345970 -lt 85899345969 2024-09-16T04:53:15.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:53:15.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182445 2024-09-16T04:53:15.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:53:15.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:53:15.446 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182445 2024-09-16T04:53:15.446 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:53:15.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182445 2024-09-16T04:53:15.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182445' 2024-09-16T04:53:15.448 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182445 2024-09-16T04:53:15.448 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:53:15.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182446 -lt 107374182445 2024-09-16T04:53:15.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:53:15.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018919 2024-09-16T04:53:15.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:53:15.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T04:53:15.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018919 2024-09-16T04:53:15.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:53:15.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018919 2024-09-16T04:53:15.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018919' 2024-09-16T04:53:15.860 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018919 2024-09-16T04:53:15.860 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T04:53:16.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018919 -lt 128849018919 2024-09-16T04:53:16.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: get_num_pgs 2024-09-16T04:53:16.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:53:16.330 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:53:16.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:61: wait_for_not_state: test 2 == 0 2024-09-16T04:53:16.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:65: wait_for_not_state: true 2024-09-16T04:53:16.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: get_num_in_state activating 2024-09-16T04:53:16.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:45: get_num_in_state: local state=activating 2024-09-16T04:53:16.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:46: get_num_in_state: local expression 2024-09-16T04:53:16.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:47: get_num_in_state: expression+='select(contains("activating"))' 2024-09-16T04:53:16.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:48: get_num_in_state: ceph --format json pg dump pgs 2024-09-16T04:53:16.886 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:49: get_num_in_state: jq '.pg_stats | [.[] | .state | select(contains("activating"))] | length' 2024-09-16T04:53:17.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:66: wait_for_not_state: cur_in_state=0 2024-09-16T04:53:17.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: test 0 = 0 2024-09-16T04:53:17.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:67: wait_for_not_state: break 2024-09-16T04:53:17.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:78: wait_for_not_state: return 0 2024-09-16T04:53:17.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:702: TEST_ec_backfill_simple: ceph pg dump pgs 2024-09-16T04:53:17.683 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T04:53:17.683 INFO:tasks.workunit.client.0.smithi026.stdout:2.0 200 0 200 200 0 3686400 0 0 100 100 100 active+undersized+degraded+remapped+backfill_toofull 2024-09-16T04:53:06.247536+0000 46'200 57:254 [3,5,1,0,4] 3 [3,5,4,0,NONE] 3 0'0 2024-09-16T04:51:22.828975+0000 0'0 2024-09-16T04:51:22.828975+0000 0 0 no scrub is scheduled 0 0 2024-09-16T04:53:17.683 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 200 0 0 0 0 2662400 0 0 100 100 100 active+clean 2024-09-16T04:52:35.333283+0000 39'200 57:232 [1] 1 [1] 1 0'0 2024-09-16T04:50:52.520732+0000 0'0 2024-09-16T04:50:52.520732+0000 0 0 periodic scrub scheduled @ 2024-09-17T16:33:52.341131+0000 0 0 2024-09-16T04:53:17.684 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T04:53:17.684 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T04:53:17.684 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:53:17.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:704: TEST_ec_backfill_simple: ERRORS=0 2024-09-16T04:53:17.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:705: TEST_ec_backfill_simple: ceph pg dump pgs 2024-09-16T04:53:17.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:705: TEST_ec_backfill_simple: grep -v '^1.0' 2024-09-16T04:53:17.696 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:705: TEST_ec_backfill_simple: grep +backfill_toofull 2024-09-16T04:53:17.696 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:705: TEST_ec_backfill_simple: wc -l 2024-09-16T04:53:18.086 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T04:53:18.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:705: TEST_ec_backfill_simple: '[' 1 '!=' 1 ']' 2024-09-16T04:53:18.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:710: TEST_ec_backfill_simple: '[' 0 '!=' 0 ']' 2024-09-16T04:53:18.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:715: TEST_ec_backfill_simple: delete_pool fillpool 2024-09-16T04:53:18.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=fillpool 2024-09-16T04:53:18.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete fillpool fillpool --yes-i-really-really-mean-it 2024-09-16T04:53:18.608 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'fillpool' does not exist 2024-09-16T04:53:18.620 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:716: TEST_ec_backfill_simple: seq 1 1 2024-09-16T04:53:18.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:716: TEST_ec_backfill_simple: for i in $(seq 1 $pools) 2024-09-16T04:53:18.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:718: TEST_ec_backfill_simple: delete_pool test1 2024-09-16T04:53:18.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test1 2024-09-16T04:53:18.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test1 test1 --yes-i-really-really-mean-it 2024-09-16T04:53:19.199 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test1' does not exist 2024-09-16T04:53:19.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:720: TEST_ec_backfill_simple: kill_daemons td/osd-backfill-space 2024-09-16T04:53:19.212 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:53:19.212 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:53:19.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:53:19.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:53:19.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:53:24.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:53:24.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh:39: run: teardown td/osd-backfill-space 2024-09-16T04:53:24.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:53:24.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:53:24.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:53:24.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:53:24.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:53:24.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:53:24.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:53:24.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:53:24.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:53:24.539 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:53:24.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:53:24.540 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:53:24.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:53:24.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:53:24.542 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:53:24.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:53:24.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:53:24.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:53:24.544 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:53:24.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:53:24.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:53:24.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:53:24.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:53:24.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:53:24.595 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:53:24.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:53:24.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:53:24.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:53:24.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T04:53:24.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/osd-backfill-space 0 2024-09-16T04:53:24.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-space 2024-09-16T04:53:24.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T04:53:24.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-space KILL 2024-09-16T04:53:24.598 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:53:24.598 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:53:24.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:53:24.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:53:24.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:53:24.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:53:24.599 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:53:24.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:53:24.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:53:24.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:53:24.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:53:24.602 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:53:24.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:53:24.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:53:24.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:53:24.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:53:24.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:53:24.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T04:53:24.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-space 2024-09-16T04:53:24.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:53:24.608 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:53:24.608 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.114688 2024-09-16T04:53:24.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.114688 2024-09-16T04:53:24.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:53:24.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:53:24.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T04:53:24.612 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T04:53:24.612 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T04:53:24.642 INFO:tasks.workunit:Running workunit osd-backfill/osd-backfill-stats.sh... 2024-09-16T04:53:24.643 DEBUG:teuthology.orchestra.run.smithi026:workunit test osd-backfill/osd-backfill-stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh 2024-09-16T04:53:24.707 INFO:tasks.workunit.client.0.smithi026.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-16T04:53:24.724 INFO:tasks.workunit.client.0.smithi026.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2024-09-16T04:53:24.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-16T04:53:24.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2315: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-16T04:53:24.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: export PYTHONWARNINGS=ignore 2024-09-16T04:53:24.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2316: main: PYTHONWARNINGS=ignore 2024-09-16T04:53:24.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: export CEPH_CONF=/dev/null 2024-09-16T04:53:24.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2317: main: CEPH_CONF=/dev/null 2024-09-16T04:53:24.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2318: main: unset CEPH_ARGS 2024-09-16T04:53:24.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2320: main: local code 2024-09-16T04:53:24.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2321: main: run td/osd-backfill-stats 2024-09-16T04:53:24.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:21: run: local dir=td/osd-backfill-stats 2024-09-16T04:53:24.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:22: run: shift 2024-09-16T04:53:24.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:25: run: export CEPH_MON=127.0.0.1:7114 2024-09-16T04:53:24.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:25: run: CEPH_MON=127.0.0.1:7114 2024-09-16T04:53:24.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:26: run: export CEPH_ARGS 2024-09-16T04:53:24.727 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:27: run: uuidgen 2024-09-16T04:53:24.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:27: run: CEPH_ARGS+='--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none ' 2024-09-16T04:53:24.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7114 ' 2024-09-16T04:53:24.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:29: run: CEPH_ARGS+='--osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T04:53:24.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:30: run: export margin=10 2024-09-16T04:53:24.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:30: run: margin=10 2024-09-16T04:53:24.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:31: run: export objects=200 2024-09-16T04:53:24.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:31: run: objects=200 2024-09-16T04:53:24.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:32: run: export poolname=test 2024-09-16T04:53:24.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:32: run: poolname=test 2024-09-16T04:53:24.730 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:34: run: set 2024-09-16T04:53:24.730 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:34: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2024-09-16T04:53:24.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:34: run: local 'funcs=TEST_backfill_down_out 2024-09-16T04:53:24.730 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_ec_all_out 2024-09-16T04:53:24.730 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_ec_down_all_out 2024-09-16T04:53:24.731 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_ec_down_out 2024-09-16T04:53:24.731 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_ec_prim_out 2024-09-16T04:53:24.731 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_out 2024-09-16T04:53:24.731 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_out2 2024-09-16T04:53:24.731 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_remapped 2024-09-16T04:53:24.731 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_sizeup 2024-09-16T04:53:24.732 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_sizeup4_allout 2024-09-16T04:53:24.732 INFO:tasks.workunit.client.0.smithi026.stderr:TEST_backfill_sizeup_out' 2024-09-16T04:53:24.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-09-16T04:53:24.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-09-16T04:53:24.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-stats 2024-09-16T04:53:24.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-stats 2024-09-16T04:53:24.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T04:53:24.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:53:24.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T04:53:24.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:53:24.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:53:24.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:53:24.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:53:24.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:53:24.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:53:24.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:53:24.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:53:24.735 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:53:24.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:53:24.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:53:24.735 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:53:24.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:53:24.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:53:24.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:53:24.736 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:53:24.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:53:24.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:53:24.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T04:53:24.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:53:24.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:53:24.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:53:24.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T04:53:24.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:53:24.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:53:24.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-stats 2024-09-16T04:53:24.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:53:24.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:53:24.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:53:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.478321 2024-09-16T04:53:24.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:53:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2024-09-16T04:53:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2024-09-16T04:53:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:53:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-09-16T04:53:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_down_out td/osd-backfill-stats 2024-09-16T04:53:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:278: TEST_backfill_down_out: local dir=td/osd-backfill-stats 2024-09-16T04:53:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:280: TEST_backfill_down_out: run_mon td/osd-backfill-stats a 2024-09-16T04:53:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-stats 2024-09-16T04:53:24.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:53:24.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:53:24.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:53:24.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-stats/a 2024-09-16T04:53:24.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-09-16T04:53:25.191 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:53:25.191 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:53:25.191 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:53:25.191 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:53:25.191 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:53:25.191 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:53:25.192 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:53:25.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:53:25.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:53:25.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:53:25.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:53:25.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:53:25.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:53:25.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:53:25.386 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:53:25.387 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:53:25.387 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:53:25.387 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:53:25.387 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:53:25.387 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:53:25.387 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T04:53:25.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:53:25.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get fsid 2024-09-16T04:53:25.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:53:25.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:53:25.478 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:53:25.478 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:53:25.478 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:53:25.478 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:53:25.478 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:53:25.478 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:53:25.478 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:53:25.478 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:53:25.478 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:53:25.478 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T04:53:25.478 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:53:25.478 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get mon_host 2024-09-16T04:53:25.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:281: TEST_backfill_down_out: run_mgr td/osd-backfill-stats x 2024-09-16T04:53:25.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-stats 2024-09-16T04:53:25.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:53:25.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:53:25.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:53:25.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-stats/x 2024-09-16T04:53:25.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:53:26.416 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:53:26.416 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:53:26.416 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:53:26.416 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:53:26.416 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:53:26.416 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:53:26.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:53:26.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:53:26.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:53:26.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:282: TEST_backfill_down_out: run_osd td/osd-backfill-stats 0 2024-09-16T04:53:26.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T04:53:26.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:53:26.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T04:53:26.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:53:26.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/0 2024-09-16T04:53:26.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T04:53:26.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:53:26.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:53:26.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:53:26.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-09-16T04:53:26.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-09-16T04:53:26.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:53:26.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:53:26.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T04:53:26.455 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:53:26.455 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:53:26.455 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:53:26.455 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:53:26.455 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:53:26.455 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:53:26.455 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:53:26.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:53:26.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:53:26.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:53:26.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:53:26.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T04:53:26.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T04:53:26.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:53:26.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:53:26.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:53:26.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:53:26.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:53:26.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:53:26.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/0 2024-09-16T04:53:26.457 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:53:26.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=414d0539-d5db-4e1a-b18a-a4ed2c68476b 2024-09-16T04:53:26.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 414d0539-d5db-4e1a-b18a-a4ed2c68476b' 2024-09-16T04:53:26.458 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 414d0539-d5db-4e1a-b18a-a4ed2c68476b 2024-09-16T04:53:26.459 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:53:26.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDGuedmAkcBHBAAGnXdwZ+CLXGBjMmgeA2WqA== 2024-09-16T04:53:26.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDGuedmAkcBHBAAGnXdwZ+CLXGBjMmgeA2WqA=="}' 2024-09-16T04:53:26.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 414d0539-d5db-4e1a-b18a-a4ed2c68476b -i td/osd-backfill-stats/0/new.json 2024-09-16T04:53:26.769 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:53:26.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/0/new.json 2024-09-16T04:53:26.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDGuedmAkcBHBAAGnXdwZ+CLXGBjMmgeA2WqA== --osd-uuid 414d0539-d5db-4e1a-b18a-a4ed2c68476b 2024-09-16T04:53:26.809 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:53:26.807+0000 7f2070c2f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:53:26.835 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:53:26.834+0000 7f2070c2f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:53:26.836 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:53:26.835+0000 7f2070c2f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:53:26.836 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:53:26.835+0000 7f2070c2f640 -1 bdev(0x55f94cab3c00 td/osd-backfill-stats/0/block) open stat got: (1) Operation not permitted 2024-09-16T04:53:26.836 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:53:26.836+0000 7f2070c2f640 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-09-16T04:53:32.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-09-16T04:53:32.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:53:32.521 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T04:53:32.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T04:53:32.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:53:33.095 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T04:53:33.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T04:53:33.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:53:33.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:53:33.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:53:33.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:53:33.124 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:53:33.123+0000 7face7a17640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:53:33.126 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:53:33.125+0000 7face7a17640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:53:33.127 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:53:33.126+0000 7face7a17640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:53:33.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T04:53:33.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:53:33.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:53:33.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:53:33.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:53:33.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:33.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:53:33.553 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:53:33.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:33.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:33.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:34.727 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:53:34.726+0000 7face7a17640 -1 Falling back to public interface 2024-09-16T04:53:34.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:34.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:34.987 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:53:34.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:53:34.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:34.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:35.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:36.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:36.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:36.431 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:53:36.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:53:36.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:36.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:36.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:37.400 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:53:37.399+0000 7face7a17640 -1 osd.0 0 log_to_monitors true 2024-09-16T04:53:37.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:37.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:37.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:53:37.890 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:53:37.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:37.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:38.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:39.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:39.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:39.353 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:53:39.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:53:39.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:39.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:39.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:40.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:40.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:40.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:53:40.794 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:53:40.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:40.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:41.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:42.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:42.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:42.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:53:42.325 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:53:42.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:42.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:42.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:43.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:43.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:43.750 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:53:43.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:53:43.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:43.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:44.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:45.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:45.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:45.190 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:53:45.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:53:45.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:45.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:45.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:46.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:46.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:53:46.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:53:46.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:46.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:47.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:48.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:48.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:48.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:53:48.182 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:53:48.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:48.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:48.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:49.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:49.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:49.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:53:49.597 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:53:49.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:49.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:50.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:51.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:51.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:51.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:53:51.532 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:53:51.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:51.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:52.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:53.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:53.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:53.376 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:53:53.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:53:53.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:53.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:54.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:55.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:55.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:55.532 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:53:55.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:53:55.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:55.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:55.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:56.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:56.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:56.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:53:56.982 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:53:56.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:56.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:57.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:53:58.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:53:58.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:53:58.663 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:53:58.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:53:58.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:53:58.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:53:59.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:00.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:00.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:00.344 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:54:00.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:54:00.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:00.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:54:00.824 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1995488495,v1:127.0.0.1:6803/1995488495] [v2:127.0.0.1:6804/1995488495,v1:127.0.0.1:6805/1995488495] exists,up 414d0539-d5db-4e1a-b18a-a4ed2c68476b 2024-09-16T04:54:00.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:54:00.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:54:00.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:54:00.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:283: TEST_backfill_down_out: run_osd td/osd-backfill-stats 1 2024-09-16T04:54:00.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T04:54:00.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:54:00.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T04:54:00.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:54:00.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/1 2024-09-16T04:54:00.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T04:54:00.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:54:00.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:54:00.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:54:00.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-09-16T04:54:00.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-09-16T04:54:00.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:54:00.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:54:00.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T04:54:00.830 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:54:00.830 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:54:00.830 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:54:00.830 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:54:00.830 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:54:00.830 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:54:00.830 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:54:00.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:54:00.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:54:00.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:54:00.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:54:00.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T04:54:00.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T04:54:00.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:54:00.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:54:00.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:54:00.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:54:00.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:54:00.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:54:00.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/1 2024-09-16T04:54:00.831 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:54:00.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ce4aa3cf-379d-4327-a471-cf45bb8b88f2 2024-09-16T04:54:00.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ce4aa3cf-379d-4327-a471-cf45bb8b88f2' 2024-09-16T04:54:00.832 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 ce4aa3cf-379d-4327-a471-cf45bb8b88f2 2024-09-16T04:54:00.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:54:00.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDouedm/eh7MhAAdjsrXNFKcF9SdjUYg00Q4A== 2024-09-16T04:54:00.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDouedm/eh7MhAAdjsrXNFKcF9SdjUYg00Q4A=="}' 2024-09-16T04:54:00.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ce4aa3cf-379d-4327-a471-cf45bb8b88f2 -i td/osd-backfill-stats/1/new.json 2024-09-16T04:54:01.342 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:54:01.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/1/new.json 2024-09-16T04:54:01.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDouedm/eh7MhAAdjsrXNFKcF9SdjUYg00Q4A== --osd-uuid ce4aa3cf-379d-4327-a471-cf45bb8b88f2 2024-09-16T04:54:01.386 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:01.385+0000 7f6d0e016640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:54:01.398 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:01.397+0000 7f6d0e016640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:54:01.399 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:01.399+0000 7f6d0e016640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:54:01.400 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:01.399+0000 7f6d0e016640 -1 bdev(0x557861ca1c00 td/osd-backfill-stats/1/block) open stat got: (1) Operation not permitted 2024-09-16T04:54:01.400 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:01.399+0000 7f6d0e016640 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-09-16T04:54:07.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-09-16T04:54:07.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:54:07.385 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T04:54:07.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T04:54:07.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:54:07.622 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T04:54:07.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T04:54:07.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:54:07.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:54:07.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:54:07.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:54:07.652 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:07.651+0000 7f8af7c17640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:54:07.654 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:07.653+0000 7f8af7c17640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:54:07.655 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:07.654+0000 7f8af7c17640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:54:08.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T04:54:08.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:54:08.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:54:08.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:54:08.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:54:08.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:08.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:54:08.027 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:54:08.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:08.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:08.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:08.509 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:08.508+0000 7f8af7c17640 -1 Falling back to public interface 2024-09-16T04:54:09.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:09.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:09.458 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:54:09.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:54:09.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:09.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:09.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:10.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:10.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:10.919 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:54:10.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:54:10.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:10.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:11.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:11.595 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:11.594+0000 7f8af7c17640 -1 osd.1 0 log_to_monitors true 2024-09-16T04:54:12.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:12.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:12.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:54:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:54:12.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:12.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:12.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:13.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:13.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:13.818 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:54:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:54:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:14.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:15.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:15.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:15.235 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:54:15.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:54:15.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:15.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:15.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:16.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:16.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:16.652 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:54:16.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:54:16.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:16.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:17.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:18.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:18.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:18.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:54:18.067 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:54:18.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:18.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:18.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:19.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:19.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:19.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:54:19.642 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:54:19.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:19.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:20.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:21.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:21.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:21.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:54:21.084 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:54:21.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:21.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:21.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:22.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:22.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:22.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:54:22.585 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:54:22.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:22.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:23.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:24.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:24.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:24.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:54:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:54:24.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:24.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:24.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:25.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:25.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:25.704 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:54:25.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:54:25.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:25.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:26.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:27.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:27.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:27.676 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:54:27.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:54:27.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:27.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:28.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:29.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:29.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:29.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:54:29.661 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:54:29.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:29.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:30.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:31.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:31.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:31.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:54:31.700 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:54:31.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:31.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:32.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:33.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:33.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:33.492 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:54:33.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:54:33.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:33.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:34.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:35.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:35.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:35.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:54:35.254 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:54:35.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:35.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:54:35.679 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2868363163,v1:127.0.0.1:6811/2868363163] [v2:127.0.0.1:6812/2868363163,v1:127.0.0.1:6813/2868363163] exists,up ce4aa3cf-379d-4327-a471-cf45bb8b88f2 2024-09-16T04:54:35.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:54:35.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:54:35.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:54:35.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:284: TEST_backfill_down_out: run_osd td/osd-backfill-stats 2 2024-09-16T04:54:35.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T04:54:35.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:54:35.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T04:54:35.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:54:35.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/2 2024-09-16T04:54:35.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T04:54:35.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:54:35.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:54:35.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:54:35.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-09-16T04:54:35.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-09-16T04:54:35.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:54:35.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:54:35.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T04:54:35.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:54:35.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:54:35.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:54:35.689 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:54:35.689 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:54:35.689 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:54:35.689 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:54:35.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:54:35.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:54:35.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:54:35.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:54:35.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T04:54:35.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T04:54:35.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:54:35.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:54:35.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:54:35.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:54:35.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:54:35.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:54:35.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/2 2024-09-16T04:54:35.691 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:54:35.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=579b4c89-6ae1-4e1a-9a50-ef7887346b2c 2024-09-16T04:54:35.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 579b4c89-6ae1-4e1a-9a50-ef7887346b2c' 2024-09-16T04:54:35.691 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 579b4c89-6ae1-4e1a-9a50-ef7887346b2c 2024-09-16T04:54:35.691 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:54:35.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQALuudmryn2KRAAyBXjWa3WjxtdCGt+9aiegQ== 2024-09-16T04:54:35.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQALuudmryn2KRAAyBXjWa3WjxtdCGt+9aiegQ=="}' 2024-09-16T04:54:35.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 579b4c89-6ae1-4e1a-9a50-ef7887346b2c -i td/osd-backfill-stats/2/new.json 2024-09-16T04:54:36.199 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:54:36.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/2/new.json 2024-09-16T04:54:36.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQALuudmryn2KRAAyBXjWa3WjxtdCGt+9aiegQ== --osd-uuid 579b4c89-6ae1-4e1a-9a50-ef7887346b2c 2024-09-16T04:54:36.243 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:36.242+0000 7f4722d3e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:54:36.246 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:36.244+0000 7f4722d3e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:54:36.246 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:36.245+0000 7f4722d3e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:54:36.247 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:36.246+0000 7f4722d3e640 -1 bdev(0x56467ae8dc00 td/osd-backfill-stats/2/block) open stat got: (1) Operation not permitted 2024-09-16T04:54:36.247 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:36.246+0000 7f4722d3e640 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-09-16T04:54:42.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-09-16T04:54:42.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:54:42.247 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T04:54:42.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T04:54:42.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:54:42.810 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T04:54:42.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T04:54:42.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:54:42.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:54:42.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:54:42.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:54:42.841 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:42.840+0000 7fe811e11640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:54:42.843 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:42.842+0000 7fe811e11640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:54:42.844 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:42.843+0000 7fe811e11640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:54:43.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T04:54:43.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:54:43.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:54:43.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:54:43.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:54:43.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:43.236 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:54:43.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:54:43.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:43.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:54:43.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:44.202 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:44.201+0000 7fe811e11640 -1 Falling back to public interface 2024-09-16T04:54:44.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:44.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:44.667 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:54:44.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:54:44.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:44.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:54:45.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:46.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:46.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:46.105 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:54:46.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:54:46.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:46.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:54:46.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:47.080 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:54:47.076+0000 7fe811e11640 -1 osd.2 0 log_to_monitors true 2024-09-16T04:54:47.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:47.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:47.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:54:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:54:47.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:47.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:54:48.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:49.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:49.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:49.099 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:54:49.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:54:49.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:49.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:54:49.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:50.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:50.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:50.539 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:54:50.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:54:50.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:50.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:54:51.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:52.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:52.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:52.114 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:54:52.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:54:52.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:52.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:54:52.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:53.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:53.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:53.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:54:53.541 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:54:53.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:53.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:54:54.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:55.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:55.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:55.147 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:54:55.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:54:55.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:55.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:54:55.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:56.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:56.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:56.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:54:56.581 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:54:56.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:56.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:54:57.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:58.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:58.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:58.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:54:58.092 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:54:58.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:58.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:54:58.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:54:59.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:54:59.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:54:59.506 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:54:59.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:54:59.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:54:59.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:54:59.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:00.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:00.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:00.986 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:55:00.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:55:00.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:00.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:55:01.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:02.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:02.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:02.911 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:55:02.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:55:02.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:02.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:55:04.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:05.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:05.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:05.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:55:05.212 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:55:05.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:05.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:55:05.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:06.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:06.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:06.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:55:06.878 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:55:06.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:06.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:55:07.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:08.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:08.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:08.924 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:55:08.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:55:08.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:08.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:55:09.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:10.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:10.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:10.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:55:10.759 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:55:10.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:10.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:55:11.203 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4100801232,v1:127.0.0.1:6819/4100801232] [v2:127.0.0.1:6820/4100801232,v1:127.0.0.1:6821/4100801232] exists,up 579b4c89-6ae1-4e1a-9a50-ef7887346b2c 2024-09-16T04:55:11.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:55:11.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:55:11.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:55:11.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:285: TEST_backfill_down_out: run_osd td/osd-backfill-stats 3 2024-09-16T04:55:11.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T04:55:11.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:55:11.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T04:55:11.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:55:11.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/3 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:55:11.209 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:55:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:55:11.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/3 2024-09-16T04:55:11.211 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:55:11.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bf5bfd4e-5aa8-4fa2-bc28-9f6e5099d46f 2024-09-16T04:55:11.211 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 bf5bfd4e-5aa8-4fa2-bc28-9f6e5099d46f 2024-09-16T04:55:11.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 bf5bfd4e-5aa8-4fa2-bc28-9f6e5099d46f' 2024-09-16T04:55:11.211 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:55:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAvuudmq2yHDRAAzRMXlq8Qxl2Q1lsFPgx1YQ== 2024-09-16T04:55:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAvuudmq2yHDRAAzRMXlq8Qxl2Q1lsFPgx1YQ=="}' 2024-09-16T04:55:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bf5bfd4e-5aa8-4fa2-bc28-9f6e5099d46f -i td/osd-backfill-stats/3/new.json 2024-09-16T04:55:11.783 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:55:11.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/3/new.json 2024-09-16T04:55:11.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAvuudmq2yHDRAAzRMXlq8Qxl2Q1lsFPgx1YQ== --osd-uuid bf5bfd4e-5aa8-4fa2-bc28-9f6e5099d46f 2024-09-16T04:55:11.827 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:11.826+0000 7f3f1c541640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:55:11.829 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:11.828+0000 7f3f1c541640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:55:11.830 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:11.829+0000 7f3f1c541640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:55:11.830 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:11.829+0000 7f3f1c541640 -1 bdev(0x55e9cb02fc00 td/osd-backfill-stats/3/block) open stat got: (1) Operation not permitted 2024-09-16T04:55:11.830 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:11.830+0000 7f3f1c541640 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-09-16T04:55:17.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-09-16T04:55:17.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:55:17.973 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T04:55:17.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T04:55:17.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:55:18.548 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T04:55:18.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T04:55:18.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:55:18.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:55:18.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:55:18.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:55:18.578 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:18.577+0000 7fc633c0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:55:18.582 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:18.581+0000 7fc633c0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:55:18.583 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:18.582+0000 7fc633c0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:55:19.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T04:55:19.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:55:19.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T04:55:19.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:55:19.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:55:19.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:19.030 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:55:19.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:55:19.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:19.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:19.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:19.701 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:19.700+0000 7fc633c0d640 -1 Falling back to public interface 2024-09-16T04:55:20.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:20.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:20.474 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:55:20.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:55:20.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:20.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:20.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:21.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:21.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:21.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:55:21.917 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:55:21.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:21.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:22.119 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:22.118+0000 7fc633c0d640 -1 osd.3 0 log_to_monitors true 2024-09-16T04:55:22.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:23.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:23.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:23.336 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:55:23.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:55:23.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:23.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:23.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:24.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:24.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:24.762 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:55:24.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:55:24.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:24.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:25.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:26.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:26.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:26.209 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:55:26.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:55:26.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:26.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:26.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:27.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:27.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:27.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:55:27.649 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:55:27.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:27.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:28.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:29.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:29.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:29.270 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:55:29.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:55:29.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:29.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:29.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:30.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:30.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:30.826 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:55:30.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:55:30.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:30.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:31.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:32.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:32.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:32.243 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:55:32.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:55:32.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:32.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:32.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:33.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:33.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:33.678 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:55:33.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:55:33.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:33.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:34.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:35.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:35.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:35.797 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:55:35.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:55:35.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:35.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:36.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:37.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:37.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:37.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:55:37.800 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:55:37.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:37.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:38.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:39.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:39.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:39.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:55:39.586 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:55:39.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:39.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:40.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:41.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:41.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:41.034 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:55:41.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:55:41.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:41.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:41.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:42.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:42.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:42.756 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:55:42.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:55:42.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:42.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:43.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:44.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:44.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:44.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:55:44.523 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:55:44.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:44.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:55:45.016 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3066556551,v1:127.0.0.1:6827/3066556551] [v2:127.0.0.1:6828/3066556551,v1:127.0.0.1:6829/3066556551] exists,up bf5bfd4e-5aa8-4fa2-bc28-9f6e5099d46f 2024-09-16T04:55:45.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:55:45.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:55:45.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:55:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:286: TEST_backfill_down_out: run_osd td/osd-backfill-stats 4 2024-09-16T04:55:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T04:55:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:55:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T04:55:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:55:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/4 2024-09-16T04:55:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T04:55:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:55:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:55:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:55:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-09-16T04:55:45.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:55:45.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/4 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6811259e-daae-4f5f-9e1d-dd9f709781ff 2024-09-16T04:55:45.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 6811259e-daae-4f5f-9e1d-dd9f709781ff' 2024-09-16T04:55:45.024 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 6811259e-daae-4f5f-9e1d-dd9f709781ff 2024-09-16T04:55:45.024 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:55:45.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBRuudmaAgtAhAA/yi/RJ48xrTgtYVX2TGuEQ== 2024-09-16T04:55:45.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBRuudmaAgtAhAA/yi/RJ48xrTgtYVX2TGuEQ=="}' 2024-09-16T04:55:45.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6811259e-daae-4f5f-9e1d-dd9f709781ff -i td/osd-backfill-stats/4/new.json 2024-09-16T04:55:45.605 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:55:45.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/4/new.json 2024-09-16T04:55:45.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBRuudmaAgtAhAA/yi/RJ48xrTgtYVX2TGuEQ== --osd-uuid 6811259e-daae-4f5f-9e1d-dd9f709781ff 2024-09-16T04:55:45.649 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:45.649+0000 7fdd96a83640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:55:45.651 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:45.651+0000 7fdd96a83640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:55:45.652 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:45.652+0000 7fdd96a83640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:55:45.653 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:45.652+0000 7fdd96a83640 -1 bdev(0x558833b35c00 td/osd-backfill-stats/4/block) open stat got: (1) Operation not permitted 2024-09-16T04:55:45.653 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:45.652+0000 7fdd96a83640 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-09-16T04:55:51.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-09-16T04:55:51.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:55:51.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T04:55:51.594 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T04:55:51.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:55:52.160 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T04:55:52.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T04:55:52.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:55:52.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:55:52.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:55:52.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:55:52.191 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:52.190+0000 7f75ed725640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:55:52.203 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:52.202+0000 7f75ed725640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:55:52.204 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:52.204+0000 7f75ed725640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:55:52.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T04:55:52.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:55:52.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T04:55:52.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:55:52.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:55:52.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:52.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:55:52.635 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:55:52.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:52.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:55:53.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:53.792 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:53.791+0000 7f75ed725640 -1 Falling back to public interface 2024-09-16T04:55:54.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:54.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:54.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:55:54.070 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:55:54.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:54.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:55:54.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:55.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:55.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:55.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:55:55.522 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:55:55.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:55.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:55:55.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:56.551 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:55:56.549+0000 7f75ed725640 -1 osd.4 0 log_to_monitors true 2024-09-16T04:55:56.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:56.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:56.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:55:56.973 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:55:56.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:56.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:55:57.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:58.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:58.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:58.471 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:55:58.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:55:58.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:58.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:55:58.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:55:59.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:55:59.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:55:59.911 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:55:59.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:55:59.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:55:59.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:00.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:01.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:01.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:01.401 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:56:01.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:56:01.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:01.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:01.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:02.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:02.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:02.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:56:02.951 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:56:02.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:02.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:03.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:04.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:04.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:04.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:56:04.406 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:56:04.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:04.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:04.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:05.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:05.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:05.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:56:05.870 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:56:05.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:05.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:06.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:07.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:07.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:07.436 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:56:07.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:56:07.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:07.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:07.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:08.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:08.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:08.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:56:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:56:08.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:08.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:09.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:10.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:10.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:10.499 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:56:10.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:56:10.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:10.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:11.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:12.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:12.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:12.182 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:56:12.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:56:12.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:12.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:12.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:13.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:13.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:13.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:56:13.967 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:56:13.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:13.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:14.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:15.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:15.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:15.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:56:15.696 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:56:15.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:15.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:16.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:17.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:17.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:17.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:56:17.532 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:56:17.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:17.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:18.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:19.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:19.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:19.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:56:19.104 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:56:19.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:19.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:19.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:20.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:20.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:20.596 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T04:56:20.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T04:56:20.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:20.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T04:56:21.042 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1434808821,v1:127.0.0.1:6835/1434808821] [v2:127.0.0.1:6836/1434808821,v1:127.0.0.1:6837/1434808821] exists,up 6811259e-daae-4f5f-9e1d-dd9f709781ff 2024-09-16T04:56:21.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:56:21.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:56:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:56:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:287: TEST_backfill_down_out: run_osd td/osd-backfill-stats 5 2024-09-16T04:56:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T04:56:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:56:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T04:56:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:56:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/5 2024-09-16T04:56:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T04:56:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:56:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:56:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:56:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:56:21.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:56:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:56:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:56:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T04:56:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T04:56:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:56:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:56:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:56:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:56:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:56:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:56:21.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/5 2024-09-16T04:56:21.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:56:21.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=52eebc2f-5def-489d-b2d2-80f949f38b72 2024-09-16T04:56:21.049 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 52eebc2f-5def-489d-b2d2-80f949f38b72 2024-09-16T04:56:21.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 52eebc2f-5def-489d-b2d2-80f949f38b72' 2024-09-16T04:56:21.049 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:56:21.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB1uudmJ/XlAxAAEHraxnO02GejbNUNXWImjA== 2024-09-16T04:56:21.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB1uudmJ/XlAxAAEHraxnO02GejbNUNXWImjA=="}' 2024-09-16T04:56:21.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 52eebc2f-5def-489d-b2d2-80f949f38b72 -i td/osd-backfill-stats/5/new.json 2024-09-16T04:56:21.570 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:56:21.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/5/new.json 2024-09-16T04:56:21.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB1uudmJ/XlAxAAEHraxnO02GejbNUNXWImjA== --osd-uuid 52eebc2f-5def-489d-b2d2-80f949f38b72 2024-09-16T04:56:21.613 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:56:21.612+0000 7fcdba81d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:56:21.650 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:56:21.649+0000 7fcdba81d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:56:21.651 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:56:21.650+0000 7fcdba81d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:56:21.651 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:56:21.650+0000 7fcdba81d640 -1 bdev(0x55d94828bc00 td/osd-backfill-stats/5/block) open stat got: (1) Operation not permitted 2024-09-16T04:56:21.651 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:56:21.651+0000 7fcdba81d640 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-09-16T04:56:27.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-09-16T04:56:27.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:56:27.821 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T04:56:27.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T04:56:27.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:56:28.394 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T04:56:28.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T04:56:28.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:56:28.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:56:28.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:56:28.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:56:28.424 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:56:28.423+0000 7f3baf21e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:56:28.426 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:56:28.425+0000 7f3baf21e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:56:28.427 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:56:28.426+0000 7f3baf21e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:56:28.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T04:56:28.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:56:28.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T04:56:28.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:56:28.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:56:28.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:28.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:56:28.845 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:56:28.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:28.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:29.278 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:56:29.278+0000 7f3baf21e640 -1 Falling back to public interface 2024-09-16T04:56:29.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:30.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:30.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:30.289 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:56:30.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:56:30.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:30.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:30.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:31.710 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:56:31.709+0000 7f3baf21e640 -1 osd.5 0 log_to_monitors true 2024-09-16T04:56:31.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:31.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:31.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:56:31.756 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:56:31.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:31.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:32.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:33.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:33.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:33.408 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:56:33.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:56:33.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:33.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:33.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:34.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:34.963 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:56:34.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:34.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:56:34.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:34.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:35.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:36.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:36.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:36.578 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:56:36.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:56:36.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:36.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:37.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:38.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:38.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:38.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:56:38.075 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:56:38.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:38.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:38.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:39.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:39.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:39.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:56:39.571 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:56:39.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:39.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:40.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:41.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:41.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:41.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:56:41.082 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:56:41.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:41.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:41.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:42.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:42.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:42.574 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:56:42.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:56:42.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:42.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:43.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:44.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:44.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:44.026 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:56:44.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:56:44.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:44.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:44.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:45.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:45.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:45.615 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:56:45.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:56:45.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:45.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:46.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:47.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:47.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:47.081 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:56:47.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:56:47.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:47.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:48.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:49.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:49.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:49.067 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:56:49.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:56:49.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:49.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:49.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:50.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:50.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:50.965 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:56:50.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:56:50.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:50.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:51.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:52.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:52.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:52.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:56:52.887 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:56:52.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:52.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:53.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:56:54.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:56:54.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:56:54.935 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:56:54.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:56:54.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:56:54.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T04:56:55.522 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/4285178589,v1:127.0.0.1:6843/4285178589] [v2:127.0.0.1:6844/4285178589,v1:127.0.0.1:6845/4285178589] exists,up 52eebc2f-5def-489d-b2d2-80f949f38b72 2024-09-16T04:56:55.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:56:55.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:56:55.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:56:55.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:289: TEST_backfill_down_out: create_pool test 1 1 2024-09-16T04:56:55.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2024-09-16T04:56:56.145 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T04:56:56.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T04:56:57.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:290: TEST_backfill_down_out: ceph osd pool set test size 2 2024-09-16T04:56:58.325 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 2 2024-09-16T04:56:58.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:291: TEST_backfill_down_out: sleep 5 2024-09-16T04:57:03.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:293: TEST_backfill_down_out: wait_for_clean 2024-09-16T04:57:03.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T04:57:03.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T04:57:03.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T04:57:03.341 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T04:57:03.342 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:57:03.342 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:57:03.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:57:03.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:57:03.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:57:03.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T04:57:03.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T04:57:03.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T04:57:03.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T04:57:03.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:57:03.443 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:57:03.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:57:03.889 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:57:03.889 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:57:03.889 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:57:03.889 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T04:57:03.889 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T04:57:03.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:57:03.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:57:03.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:57:04.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836522 2024-09-16T04:57:04.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836522 2024-09-16T04:57:04.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836522' 2024-09-16T04:57:04.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:57:04.008 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:57:04.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672995 2024-09-16T04:57:04.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672995 2024-09-16T04:57:04.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836522 1-42949672995' 2024-09-16T04:57:04.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:57:04.126 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:57:04.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509471 2024-09-16T04:57:04.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509471 2024-09-16T04:57:04.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836522 1-42949672995 2-64424509471' 2024-09-16T04:57:04.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:57:04.244 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:57:04.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345942 2024-09-16T04:57:04.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345942 2024-09-16T04:57:04.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836522 1-42949672995 2-64424509471 3-85899345942' 2024-09-16T04:57:04.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:57:04.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:57:04.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182416 2024-09-16T04:57:04.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182416 2024-09-16T04:57:04.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836522 1-42949672995 2-64424509471 3-85899345942 4-107374182416' 2024-09-16T04:57:04.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:57:04.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T04:57:04.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018888 2024-09-16T04:57:04.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018888 2024-09-16T04:57:04.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836522 1-42949672995 2-64424509471 3-85899345942 4-107374182416 5-128849018888' 2024-09-16T04:57:04.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:57:04.599 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836522 2024-09-16T04:57:04.599 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:57:04.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T04:57:04.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836522 2024-09-16T04:57:04.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:57:04.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836522 2024-09-16T04:57:04.601 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836522 2024-09-16T04:57:04.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836522' 2024-09-16T04:57:04.602 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T04:57:05.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836522 -lt 21474836522 2024-09-16T04:57:05.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:57:05.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672995 2024-09-16T04:57:05.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:57:05.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:57:05.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672995 2024-09-16T04:57:05.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:57:05.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672995 2024-09-16T04:57:05.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672995' 2024-09-16T04:57:05.060 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672995 2024-09-16T04:57:05.060 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:57:05.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672995 -lt 42949672995 2024-09-16T04:57:05.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:57:05.499 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509471 2024-09-16T04:57:05.499 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:57:05.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:57:05.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509471 2024-09-16T04:57:05.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:57:05.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509471 2024-09-16T04:57:05.502 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509471 2024-09-16T04:57:05.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509471' 2024-09-16T04:57:05.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:57:05.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509471 -lt 64424509471 2024-09-16T04:57:05.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:57:05.951 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345942 2024-09-16T04:57:05.951 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:57:05.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:57:05.953 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345942 2024-09-16T04:57:05.953 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:57:05.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345942 2024-09-16T04:57:05.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345942' 2024-09-16T04:57:05.954 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345942 2024-09-16T04:57:05.954 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:57:06.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345942 -lt 85899345942 2024-09-16T04:57:06.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:57:06.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182416 2024-09-16T04:57:06.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:57:06.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:57:06.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182416 2024-09-16T04:57:06.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:57:06.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182416 2024-09-16T04:57:06.396 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182416 2024-09-16T04:57:06.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182416' 2024-09-16T04:57:06.397 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:57:06.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182417 -lt 107374182416 2024-09-16T04:57:06.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:57:06.845 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018888 2024-09-16T04:57:06.845 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:57:06.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T04:57:06.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018888 2024-09-16T04:57:06.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:57:06.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018888 2024-09-16T04:57:06.848 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018888 2024-09-16T04:57:06.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018888' 2024-09-16T04:57:06.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T04:57:07.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018889 -lt 128849018888 2024-09-16T04:57:07.279 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T04:57:07.280 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:07.280 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:07.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T04:57:07.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:07.839 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:07.839 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:07.839 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:07.839 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:07.839 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:07.839 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:08.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T04:57:08.263 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:08.263 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:08.263 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:08.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T04:57:08.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T04:57:08.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T04:57:08.843 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: seq 1 200 2024-09-16T04:57:08.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:08.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj1 /dev/null 2024-09-16T04:57:08.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:08.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj2 /dev/null 2024-09-16T04:57:09.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:09.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj3 /dev/null 2024-09-16T04:57:09.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:09.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj4 /dev/null 2024-09-16T04:57:09.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:09.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj5 /dev/null 2024-09-16T04:57:09.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:09.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj6 /dev/null 2024-09-16T04:57:09.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:09.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj7 /dev/null 2024-09-16T04:57:09.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:09.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj8 /dev/null 2024-09-16T04:57:09.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:09.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj9 /dev/null 2024-09-16T04:57:09.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:09.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj10 /dev/null 2024-09-16T04:57:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj11 /dev/null 2024-09-16T04:57:10.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:10.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj12 /dev/null 2024-09-16T04:57:10.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:10.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj13 /dev/null 2024-09-16T04:57:10.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:10.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj14 /dev/null 2024-09-16T04:57:10.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:10.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj15 /dev/null 2024-09-16T04:57:10.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:10.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj16 /dev/null 2024-09-16T04:57:10.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:10.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj17 /dev/null 2024-09-16T04:57:10.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:10.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj18 /dev/null 2024-09-16T04:57:10.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:10.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj19 /dev/null 2024-09-16T04:57:10.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:10.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj20 /dev/null 2024-09-16T04:57:10.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:10.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj21 /dev/null 2024-09-16T04:57:11.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:11.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj22 /dev/null 2024-09-16T04:57:11.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:11.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj23 /dev/null 2024-09-16T04:57:11.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:11.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj24 /dev/null 2024-09-16T04:57:11.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:11.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj25 /dev/null 2024-09-16T04:57:11.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:11.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj26 /dev/null 2024-09-16T04:57:11.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:11.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj27 /dev/null 2024-09-16T04:57:11.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:11.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj28 /dev/null 2024-09-16T04:57:11.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:11.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj29 /dev/null 2024-09-16T04:57:11.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:11.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj30 /dev/null 2024-09-16T04:57:11.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:11.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj31 /dev/null 2024-09-16T04:57:12.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:12.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj32 /dev/null 2024-09-16T04:57:12.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:12.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj33 /dev/null 2024-09-16T04:57:12.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:12.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj34 /dev/null 2024-09-16T04:57:12.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:12.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj35 /dev/null 2024-09-16T04:57:12.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:12.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj36 /dev/null 2024-09-16T04:57:12.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:12.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj37 /dev/null 2024-09-16T04:57:12.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:12.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj38 /dev/null 2024-09-16T04:57:12.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:12.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj39 /dev/null 2024-09-16T04:57:13.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:13.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj40 /dev/null 2024-09-16T04:57:13.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:13.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj41 /dev/null 2024-09-16T04:57:13.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:13.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj42 /dev/null 2024-09-16T04:57:13.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:13.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj43 /dev/null 2024-09-16T04:57:13.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:13.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj44 /dev/null 2024-09-16T04:57:13.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:13.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj45 /dev/null 2024-09-16T04:57:13.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:13.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj46 /dev/null 2024-09-16T04:57:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:13.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj47 /dev/null 2024-09-16T04:57:13.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:13.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj48 /dev/null 2024-09-16T04:57:14.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:14.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj49 /dev/null 2024-09-16T04:57:14.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:14.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj50 /dev/null 2024-09-16T04:57:14.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:14.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj51 /dev/null 2024-09-16T04:57:14.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:14.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj52 /dev/null 2024-09-16T04:57:14.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:14.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj53 /dev/null 2024-09-16T04:57:14.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:14.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj54 /dev/null 2024-09-16T04:57:14.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:14.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj55 /dev/null 2024-09-16T04:57:14.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:14.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj56 /dev/null 2024-09-16T04:57:14.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:14.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj57 /dev/null 2024-09-16T04:57:14.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:14.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj58 /dev/null 2024-09-16T04:57:15.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:15.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj59 /dev/null 2024-09-16T04:57:15.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:15.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj60 /dev/null 2024-09-16T04:57:15.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:15.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj61 /dev/null 2024-09-16T04:57:15.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:15.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj62 /dev/null 2024-09-16T04:57:15.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:15.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj63 /dev/null 2024-09-16T04:57:15.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:15.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj64 /dev/null 2024-09-16T04:57:15.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:15.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj65 /dev/null 2024-09-16T04:57:15.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:15.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj66 /dev/null 2024-09-16T04:57:15.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:15.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj67 /dev/null 2024-09-16T04:57:15.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:15.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj68 /dev/null 2024-09-16T04:57:16.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:16.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj69 /dev/null 2024-09-16T04:57:16.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:16.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj70 /dev/null 2024-09-16T04:57:16.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:16.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj71 /dev/null 2024-09-16T04:57:16.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:16.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj72 /dev/null 2024-09-16T04:57:16.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:16.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj73 /dev/null 2024-09-16T04:57:16.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:16.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj74 /dev/null 2024-09-16T04:57:16.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:16.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj75 /dev/null 2024-09-16T04:57:16.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:16.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj76 /dev/null 2024-09-16T04:57:16.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:16.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj77 /dev/null 2024-09-16T04:57:16.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:16.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj78 /dev/null 2024-09-16T04:57:17.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:17.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj79 /dev/null 2024-09-16T04:57:17.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:17.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj80 /dev/null 2024-09-16T04:57:17.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:17.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj81 /dev/null 2024-09-16T04:57:17.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:17.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj82 /dev/null 2024-09-16T04:57:17.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:17.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj83 /dev/null 2024-09-16T04:57:17.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj84 /dev/null 2024-09-16T04:57:17.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:17.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj85 /dev/null 2024-09-16T04:57:17.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:17.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj86 /dev/null 2024-09-16T04:57:17.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:17.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj87 /dev/null 2024-09-16T04:57:17.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:17.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj88 /dev/null 2024-09-16T04:57:18.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:18.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj89 /dev/null 2024-09-16T04:57:18.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:18.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj90 /dev/null 2024-09-16T04:57:18.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:18.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj91 /dev/null 2024-09-16T04:57:18.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:18.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj92 /dev/null 2024-09-16T04:57:18.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:18.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj93 /dev/null 2024-09-16T04:57:18.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:18.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj94 /dev/null 2024-09-16T04:57:18.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:18.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj95 /dev/null 2024-09-16T04:57:18.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:18.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj96 /dev/null 2024-09-16T04:57:18.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:18.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj97 /dev/null 2024-09-16T04:57:18.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:18.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj98 /dev/null 2024-09-16T04:57:18.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:18.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj99 /dev/null 2024-09-16T04:57:19.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:19.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj100 /dev/null 2024-09-16T04:57:19.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:19.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj101 /dev/null 2024-09-16T04:57:19.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:19.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj102 /dev/null 2024-09-16T04:57:19.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:19.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj103 /dev/null 2024-09-16T04:57:19.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:19.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj104 /dev/null 2024-09-16T04:57:19.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:19.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj105 /dev/null 2024-09-16T04:57:19.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:19.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj106 /dev/null 2024-09-16T04:57:19.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:19.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj107 /dev/null 2024-09-16T04:57:19.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:19.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj108 /dev/null 2024-09-16T04:57:19.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:19.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj109 /dev/null 2024-09-16T04:57:20.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:20.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj110 /dev/null 2024-09-16T04:57:20.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:20.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj111 /dev/null 2024-09-16T04:57:20.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:20.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj112 /dev/null 2024-09-16T04:57:20.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:20.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj113 /dev/null 2024-09-16T04:57:20.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:20.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj114 /dev/null 2024-09-16T04:57:20.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:20.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj115 /dev/null 2024-09-16T04:57:20.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:20.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj116 /dev/null 2024-09-16T04:57:20.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:20.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj117 /dev/null 2024-09-16T04:57:20.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:20.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj118 /dev/null 2024-09-16T04:57:21.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:21.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj119 /dev/null 2024-09-16T04:57:21.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:21.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj120 /dev/null 2024-09-16T04:57:21.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:21.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj121 /dev/null 2024-09-16T04:57:21.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:21.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj122 /dev/null 2024-09-16T04:57:21.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:21.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj123 /dev/null 2024-09-16T04:57:21.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:21.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj124 /dev/null 2024-09-16T04:57:21.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:21.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj125 /dev/null 2024-09-16T04:57:21.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:21.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj126 /dev/null 2024-09-16T04:57:21.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:21.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj127 /dev/null 2024-09-16T04:57:21.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:21.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj128 /dev/null 2024-09-16T04:57:22.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:22.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj129 /dev/null 2024-09-16T04:57:22.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:22.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj130 /dev/null 2024-09-16T04:57:22.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:22.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj131 /dev/null 2024-09-16T04:57:22.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:22.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj132 /dev/null 2024-09-16T04:57:22.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:22.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj133 /dev/null 2024-09-16T04:57:22.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:22.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj134 /dev/null 2024-09-16T04:57:22.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:22.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj135 /dev/null 2024-09-16T04:57:22.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:22.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj136 /dev/null 2024-09-16T04:57:22.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:22.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj137 /dev/null 2024-09-16T04:57:22.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:22.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj138 /dev/null 2024-09-16T04:57:23.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:23.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj139 /dev/null 2024-09-16T04:57:23.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:23.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj140 /dev/null 2024-09-16T04:57:23.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:23.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj141 /dev/null 2024-09-16T04:57:23.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:23.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj142 /dev/null 2024-09-16T04:57:23.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:23.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj143 /dev/null 2024-09-16T04:57:23.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:23.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj144 /dev/null 2024-09-16T04:57:23.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:23.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj145 /dev/null 2024-09-16T04:57:23.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:23.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj146 /dev/null 2024-09-16T04:57:23.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:23.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj147 /dev/null 2024-09-16T04:57:23.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:23.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj148 /dev/null 2024-09-16T04:57:24.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:24.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj149 /dev/null 2024-09-16T04:57:24.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:24.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj150 /dev/null 2024-09-16T04:57:24.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:24.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj151 /dev/null 2024-09-16T04:57:24.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:24.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj152 /dev/null 2024-09-16T04:57:24.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:24.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj153 /dev/null 2024-09-16T04:57:24.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:24.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj154 /dev/null 2024-09-16T04:57:24.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:24.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj155 /dev/null 2024-09-16T04:57:24.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:24.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj156 /dev/null 2024-09-16T04:57:24.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:24.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj157 /dev/null 2024-09-16T04:57:24.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:24.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj158 /dev/null 2024-09-16T04:57:24.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:24.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj159 /dev/null 2024-09-16T04:57:25.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:25.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj160 /dev/null 2024-09-16T04:57:25.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:25.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj161 /dev/null 2024-09-16T04:57:25.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:25.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj162 /dev/null 2024-09-16T04:57:25.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:25.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj163 /dev/null 2024-09-16T04:57:25.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:25.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj164 /dev/null 2024-09-16T04:57:25.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:25.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj165 /dev/null 2024-09-16T04:57:25.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:25.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj166 /dev/null 2024-09-16T04:57:25.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:25.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj167 /dev/null 2024-09-16T04:57:25.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:25.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj168 /dev/null 2024-09-16T04:57:25.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:25.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj169 /dev/null 2024-09-16T04:57:26.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:26.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj170 /dev/null 2024-09-16T04:57:26.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:26.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj171 /dev/null 2024-09-16T04:57:26.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:26.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj172 /dev/null 2024-09-16T04:57:26.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:26.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj173 /dev/null 2024-09-16T04:57:26.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:26.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj174 /dev/null 2024-09-16T04:57:26.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:26.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj175 /dev/null 2024-09-16T04:57:26.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:26.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj176 /dev/null 2024-09-16T04:57:26.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:26.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj177 /dev/null 2024-09-16T04:57:26.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:26.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj178 /dev/null 2024-09-16T04:57:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:26.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj179 /dev/null 2024-09-16T04:57:27.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:27.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj180 /dev/null 2024-09-16T04:57:27.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:27.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj181 /dev/null 2024-09-16T04:57:27.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:27.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj182 /dev/null 2024-09-16T04:57:27.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:27.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj183 /dev/null 2024-09-16T04:57:27.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:27.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj184 /dev/null 2024-09-16T04:57:27.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:27.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj185 /dev/null 2024-09-16T04:57:27.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:27.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj186 /dev/null 2024-09-16T04:57:27.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:27.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj187 /dev/null 2024-09-16T04:57:27.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:27.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj188 /dev/null 2024-09-16T04:57:27.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:27.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj189 /dev/null 2024-09-16T04:57:28.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:28.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj190 /dev/null 2024-09-16T04:57:28.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:28.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj191 /dev/null 2024-09-16T04:57:28.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:28.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj192 /dev/null 2024-09-16T04:57:28.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:28.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj193 /dev/null 2024-09-16T04:57:28.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:28.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj194 /dev/null 2024-09-16T04:57:28.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:28.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj195 /dev/null 2024-09-16T04:57:28.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:28.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj196 /dev/null 2024-09-16T04:57:28.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:28.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj197 /dev/null 2024-09-16T04:57:28.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:28.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj198 /dev/null 2024-09-16T04:57:28.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:28.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj199 /dev/null 2024-09-16T04:57:29.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:295: TEST_backfill_down_out: for i in $(seq 1 $objects) 2024-09-16T04:57:29.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:297: TEST_backfill_down_out: rados -p test put obj200 /dev/null 2024-09-16T04:57:29.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:300: TEST_backfill_down_out: get_pg test obj1 2024-09-16T04:57:29.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T04:57:29.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T04:57:29.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T04:57:29.100 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T04:57:29.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:300: TEST_backfill_down_out: local PG=1.0 2024-09-16T04:57:29.544 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:302: TEST_backfill_down_out: get_primary test obj1 2024-09-16T04:57:29.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T04:57:29.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T04:57:29.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T04:57:29.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T04:57:29.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:302: TEST_backfill_down_out: local primary=1 2024-09-16T04:57:29.996 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:303: TEST_backfill_down_out: get_not_primary test obj1 2024-09-16T04:57:29.996 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2024-09-16T04:57:29.996 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2024-09-16T04:57:29.997 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2024-09-16T04:57:29.997 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T04:57:29.997 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T04:57:29.997 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T04:57:29.997 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T04:57:30.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2024-09-16T04:57:30.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2024-09-16T04:57:30.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-09-16T04:57:30.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:303: TEST_backfill_down_out: local otherosd=0 2024-09-16T04:57:30.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:305: TEST_backfill_down_out: ceph osd set nobackfill 2024-09-16T04:57:31.545 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is set 2024-09-16T04:57:31.557 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:306: TEST_backfill_down_out: cat td/osd-backfill-stats/osd.0.pid 2024-09-16T04:57:31.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:306: TEST_backfill_down_out: kill 479409 2024-09-16T04:57:31.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:307: TEST_backfill_down_out: ceph osd down osd.0 2024-09-16T04:57:32.080 INFO:tasks.workunit.client.0.smithi026.stderr:osd.0 is already down. 2024-09-16T04:57:32.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:308: TEST_backfill_down_out: ceph osd out osd.0 2024-09-16T04:57:32.766 INFO:tasks.workunit.client.0.smithi026.stderr:osd.0 is already out. 2024-09-16T04:57:32.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:309: TEST_backfill_down_out: sleep 2 2024-09-16T04:57:34.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:310: TEST_backfill_down_out: ceph osd unset nobackfill 2024-09-16T04:57:35.488 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is unset 2024-09-16T04:57:35.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:312: TEST_backfill_down_out: wait_for_clean 2024-09-16T04:57:35.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T04:57:35.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T04:57:35.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T04:57:35.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T04:57:35.501 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T04:57:35.501 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T04:57:35.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T04:57:35.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T04:57:35.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T04:57:35.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T04:57:35.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T04:57:35.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T04:57:35.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T04:57:35.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T04:57:35.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T04:57:36.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T04:57:36.020 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T04:57:36.020 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T04:57:36.020 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T04:57:36.021 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T04:57:36.021 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T04:57:36.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T04:57:36.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:57:36.021 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T04:57:36.113 INFO:tasks.workunit.client.0.smithi026.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T04:57:36.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq= 2024-09-16T04:57:36.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z '' 2024-09-16T04:57:36.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: continue 2024-09-16T04:57:36.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:57:36.116 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T04:57:36.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673004 2024-09-16T04:57:36.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673004 2024-09-16T04:57:36.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673004' 2024-09-16T04:57:36.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:57:36.234 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T04:57:36.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509480 2024-09-16T04:57:36.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509480 2024-09-16T04:57:36.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673004 2-64424509480' 2024-09-16T04:57:36.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:57:36.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T04:57:36.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345951 2024-09-16T04:57:36.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345951 2024-09-16T04:57:36.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673004 2-64424509480 3-85899345951' 2024-09-16T04:57:36.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:57:36.474 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T04:57:36.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182425 2024-09-16T04:57:36.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182425 2024-09-16T04:57:36.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673004 2-64424509480 3-85899345951 4-107374182425' 2024-09-16T04:57:36.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T04:57:36.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T04:57:36.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018897 2024-09-16T04:57:36.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018897 2024-09-16T04:57:36.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673004 2-64424509480 3-85899345951 4-107374182425 5-128849018897' 2024-09-16T04:57:36.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:57:36.750 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673004 2024-09-16T04:57:36.750 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:57:36.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T04:57:36.751 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673004 2024-09-16T04:57:36.751 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:57:36.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673004 2024-09-16T04:57:36.753 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673004 2024-09-16T04:57:36.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673004' 2024-09-16T04:57:36.753 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T04:57:37.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673004 -lt 42949673004 2024-09-16T04:57:37.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:57:37.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509480 2024-09-16T04:57:37.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:57:37.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T04:57:37.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509480 2024-09-16T04:57:37.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:57:37.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509480 2024-09-16T04:57:37.227 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509480 2024-09-16T04:57:37.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509480' 2024-09-16T04:57:37.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T04:57:37.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509480 -lt 64424509480 2024-09-16T04:57:37.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:57:37.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345951 2024-09-16T04:57:37.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:57:37.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T04:57:37.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345951 2024-09-16T04:57:37.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:57:37.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345951 2024-09-16T04:57:37.634 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345951 2024-09-16T04:57:37.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345951' 2024-09-16T04:57:37.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T04:57:38.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345951 -lt 85899345951 2024-09-16T04:57:38.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:57:38.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182425 2024-09-16T04:57:38.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:57:38.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T04:57:38.039 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182425 2024-09-16T04:57:38.039 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:57:38.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182425 2024-09-16T04:57:38.040 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182425 2024-09-16T04:57:38.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182425' 2024-09-16T04:57:38.041 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T04:57:38.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182425 -lt 107374182425 2024-09-16T04:57:38.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T04:57:38.517 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018897 2024-09-16T04:57:38.517 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T04:57:38.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T04:57:38.518 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018897 2024-09-16T04:57:38.518 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T04:57:38.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018897 2024-09-16T04:57:38.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018897' 2024-09-16T04:57:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018897 2024-09-16T04:57:38.520 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T04:57:38.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018897 -lt 128849018897 2024-09-16T04:57:38.960 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T04:57:38.960 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:38.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:39.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T04:57:39.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:39.551 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:39.552 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:39.552 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:39.552 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:39.552 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:39.552 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:39.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:57:39.948 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:39.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:39.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:40.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:57:40.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T04:57:40.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T04:57:40.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T04:57:40.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:57:40.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:57:40.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:57:40.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:40.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:40.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:40.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:40.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:40.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:40.642 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:41.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:57:41.078 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:41.078 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:41.078 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:41.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:57:41.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:57:41.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:57:41.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:57:41.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:57:41.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:57:41.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:57:41.681 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:57:41.681 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:57:42.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T04:57:42.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T04:57:42.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:57:42.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:57:42.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:57:42.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:57:42.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:42.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:42.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:42.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:42.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:42.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:42.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:42.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:57:42.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:42.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:42.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:43.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:57:43.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:57:43.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:57:43.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:57:43.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:57:43.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:57:43.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:57:43.407 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:57:43.407 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:57:44.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T04:57:44.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T04:57:44.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:57:44.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:57:44.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:57:44.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:57:44.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:44.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:44.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:44.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:44.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:44.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:44.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:44.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:57:44.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:44.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:44.564 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:45.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:57:45.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:57:45.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:57:45.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:57:45.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:57:45.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:57:45.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:57:45.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:57:45.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:57:45.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4 2024-09-16T04:57:45.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4 '!=' null 2024-09-16T04:57:45.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:57:45.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:57:45.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:57:45.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:57:45.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:45.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:45.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:45.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:45.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:45.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:45.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:46.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:57:46.288 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:46.289 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:46.289 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:46.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:57:46.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:57:46.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:57:46.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:57:46.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:57:46.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:57:46.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:57:46.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:57:46.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:57:47.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=9 2024-09-16T04:57:47.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 9 '!=' null 2024-09-16T04:57:47.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:57:47.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:57:47.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:57:47.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:57:47.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:47.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:47.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:47.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:47.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:47.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:47.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:48.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:57:48.017 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:48.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:48.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:48.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:57:48.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:57:48.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:57:48.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:57:48.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:57:48.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:57:48.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:57:48.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:57:48.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:57:49.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=8 2024-09-16T04:57:49.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 8 '!=' null 2024-09-16T04:57:49.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:57:49.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:57:49.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:57:49.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:57:49.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:49.340 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:49.340 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:49.340 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:49.341 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:49.341 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:49.341 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:49.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:57:49.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:49.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:49.739 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:50.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:57:50.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:57:50.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:57:50.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:57:50.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:57:50.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:57:50.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:57:50.320 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:57:50.321 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:57:50.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=13 2024-09-16T04:57:50.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 13 '!=' null 2024-09-16T04:57:50.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:57:50.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:57:50.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:57:51.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:57:51.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:51.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:51.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:51.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:51.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:51.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:51.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:51.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:57:51.484 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:51.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:51.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:52.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:57:52.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:57:52.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:57:52.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:57:52.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:57:52.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:57:52.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:57:52.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:57:52.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:57:52.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=13 2024-09-16T04:57:52.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 13 '!=' null 2024-09-16T04:57:52.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:57:52.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:57:52.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:57:52.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:57:52.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:52.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:52.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:52.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:52.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:52.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:52.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:53.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:57:53.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:53.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:53.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:53.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:57:53.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:57:53.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:57:53.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:57:53.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:57:53.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:57:53.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:57:53.899 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:57:53.899 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:57:54.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=9 2024-09-16T04:57:54.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 9 '!=' null 2024-09-16T04:57:54.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:57:54.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:57:54.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:57:54.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:57:54.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:54.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:54.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:54.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:54.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:54.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:54.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:54.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:57:54.971 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:54.971 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:54.971 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:55.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:57:55.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:57:55.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:57:55.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:57:55.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:57:55.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:57:55.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:57:55.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:57:55.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:57:56.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T04:57:56.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T04:57:56.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:57:56.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:57:56.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:57:56.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:57:56.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:56.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:56.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:56.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:56.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:56.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:56.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:56.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T04:57:56.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:56.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:56.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:57.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T04:57:57.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T04:57:57.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T04:57:57.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T04:57:57.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T04:57:57.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T04:57:57.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T04:57:57.150 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T04:57:57.150 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T04:57:57.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=11 2024-09-16T04:57:57.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 11 '!=' null 2024-09-16T04:57:57.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T04:57:57.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T04:57:57.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T04:57:57.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T04:57:57.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T04:57:57.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T04:57:57.823 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T04:57:57.823 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T04:57:57.823 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T04:57:57.823 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T04:57:57.823 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T04:57:58.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T04:57:58.224 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T04:57:58.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T04:57:58.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T04:57:58.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T04:57:58.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T04:57:58.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T04:57:58.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:314: TEST_backfill_down_out: check td/osd-backfill-stats 1.0 1 replicated 200 0 0 0 2024-09-16T04:57:58.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-09-16T04:57:58.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-09-16T04:57:58.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-09-16T04:57:58.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-09-16T04:57:58.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=200 2024-09-16T04:57:58.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-09-16T04:57:58.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=0 2024-09-16T04:57:58.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-09-16T04:57:58.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-09-16T04:57:58.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-09-16T04:57:58.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-09-16T04:57:58.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-09-16T04:57:58.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-09-16T04:57:58.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-09-16T04:57:58.790 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-09-16T04:57:58.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-09-16T04:57:58.801 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-09-16T04:57:58.801 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-09-16T04:57:58.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-09-16T04:57:58.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-09-16T04:57:58.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-09-16T04:57:58.802 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-09-16T04:57:58.803 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-09-16T04:57:58.803 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-09-16T04:57:58.803 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-09-16T04:57:58.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[1,2]/[1]' 2024-09-16T04:57:58.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[1,2]/[1]' ']' 2024-09-16T04:57:58.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-09-16T04:57:58.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T04:57:58.815 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T04:57:58.815 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [1,2]/[1] ' 2024-09-16T04:57:58.815 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-09-16T04:57:58.816 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-09-16T04:57:58.816 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T04:57:58.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=200 2024-09-16T04:57:58.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 200 ']' 2024-09-16T04:57:58.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 200 200 2024-09-16T04:57:58.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-09-16T04:57:58.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T04:57:58.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-09-16T04:57:58.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T04:57:58.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T04:57:58.822 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T04:57:58.822 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-09-16T04:57:58.822 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T04:57:58.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=1 2024-09-16T04:57:58.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 1 ']' 2024-09-16T04:57:58.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 1 0 2024-09-16T04:57:58.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-09-16T04:57:58.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T04:57:58.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T04:57:58.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T04:57:58.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-09-16T04:57:58.830 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T04:57:58.830 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T04:57:58.830 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [1,2]/[1] ' 2024-09-16T04:57:58.830 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-09-16T04:57:58.830 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-09-16T04:57:58.831 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T04:57:58.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=0 2024-09-16T04:57:58.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 0 ']' 2024-09-16T04:57:58.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 0 0 2024-09-16T04:57:58.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-09-16T04:57:58.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T04:57:58.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-09-16T04:57:58.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T04:57:58.835 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T04:57:58.836 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T04:57:58.836 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-09-16T04:57:58.836 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T04:57:58.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=0 2024-09-16T04:57:58.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 0 ']' 2024-09-16T04:57:58.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 0 0 2024-09-16T04:57:58.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-09-16T04:57:58.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T04:57:58.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T04:57:58.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T04:57:58.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-09-16T04:57:58.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:316: TEST_backfill_down_out: delete_pool test 2024-09-16T04:57:58.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T04:57:58.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T04:57:59.337 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T04:57:59.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:317: TEST_backfill_down_out: kill_daemons td/osd-backfill-stats 2024-09-16T04:57:59.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:57:59.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:57:59.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:57:59.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:57:59.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:58:04.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:58:04.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-09-16T04:58:04.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T04:58:04.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:58:04.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T04:58:04.667 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:58:04.667 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:58:04.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:58:04.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:58:04.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:58:04.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:58:04.676 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:58:04.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:58:04.677 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:58:04.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:58:04.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:58:04.679 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:58:04.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:58:04.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:58:04.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:58:04.680 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:58:04.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:58:04.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:58:04.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T04:58:04.721 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:58:04.721 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:58:04.721 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:58:04.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T04:58:04.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:58:04.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:58:04.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-09-16T04:58:04.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-09-16T04:58:04.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-stats 2024-09-16T04:58:04.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-stats 2024-09-16T04:58:04.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T04:58:04.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T04:58:04.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T04:58:04.723 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T04:58:04.723 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T04:58:04.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T04:58:04.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T04:58:04.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T04:58:04.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T04:58:04.725 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T04:58:04.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T04:58:04.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T04:58:04.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T04:58:04.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T04:58:04.727 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T04:58:04.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:58:04.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T04:58:04.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T04:58:04.729 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T04:58:04.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T04:58:04.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T04:58:04.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T04:58:04.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T04:58:04.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:58:04.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:58:04.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T04:58:04.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T04:58:04.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T04:58:04.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-stats 2024-09-16T04:58:04.735 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T04:58:04.735 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:58:04.735 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:58:04.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.478321 2024-09-16T04:58:04.737 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T04:58:04.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T04:58:04.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T04:58:04.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-09-16T04:58:04.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_ec_all_out td/osd-backfill-stats 2024-09-16T04:58:04.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:515: TEST_backfill_ec_all_out: local dir=td/osd-backfill-stats 2024-09-16T04:58:04.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:517: TEST_backfill_ec_all_out: run_mon td/osd-backfill-stats a 2024-09-16T04:58:04.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-stats 2024-09-16T04:58:04.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T04:58:04.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T04:58:04.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T04:58:04.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-stats/a 2024-09-16T04:58:04.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-09-16T04:58:05.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T04:58:05.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:58:05.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:58:05.188 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:58:05.188 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:58:05.188 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:58:05.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:58:05.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T04:58:05.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T04:58:05.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T04:58:05.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:58:05.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:58:05.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T04:58:05.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T04:58:05.391 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:58:05.391 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:58:05.391 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:58:05.391 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:58:05.391 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:58:05.391 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:58:05.391 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T04:58:05.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:58:05.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get fsid 2024-09-16T04:58:05.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T04:58:05.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T04:58:05.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T04:58:05.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T04:58:05.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T04:58:05.481 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T04:58:05.481 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T04:58:05.481 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T04:58:05.481 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T04:58:05.481 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:58:05.482 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:58:05.482 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T04:58:05.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T04:58:05.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get mon_host 2024-09-16T04:58:05.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:518: TEST_backfill_ec_all_out: run_mgr td/osd-backfill-stats x 2024-09-16T04:58:05.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-stats 2024-09-16T04:58:05.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T04:58:05.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T04:58:05.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T04:58:05.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-stats/x 2024-09-16T04:58:05.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T04:58:06.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T04:58:06.421 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:58:06.421 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:58:06.421 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:58:06.421 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:58:06.421 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:58:06.421 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:58:06.421 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:58:06.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T04:58:06.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:519: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 0 2024-09-16T04:58:06.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T04:58:06.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:58:06.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T04:58:06.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:58:06.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/0 2024-09-16T04:58:06.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T04:58:06.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:58:06.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:58:06.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:58:06.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-09-16T04:58:06.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-09-16T04:58:06.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:58:06.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:58:06.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T04:58:06.457 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:58:06.457 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:58:06.457 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:58:06.457 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:58:06.457 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:58:06.457 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:58:06.458 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:58:06.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:58:06.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:58:06.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:58:06.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:58:06.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T04:58:06.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T04:58:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:58:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:58:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:58:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:58:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:58:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:58:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/0 2024-09-16T04:58:06.459 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:58:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=549cfa4e-a473-445f-8f21-d4ee530154ed 2024-09-16T04:58:06.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 549cfa4e-a473-445f-8f21-d4ee530154ed' 2024-09-16T04:58:06.460 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 549cfa4e-a473-445f-8f21-d4ee530154ed 2024-09-16T04:58:06.460 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:58:06.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDeuudmwQ1KHBAArsRISIbjGCGy5PMfrWTYPw== 2024-09-16T04:58:06.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDeuudmwQ1KHBAArsRISIbjGCGy5PMfrWTYPw=="}' 2024-09-16T04:58:06.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 549cfa4e-a473-445f-8f21-d4ee530154ed -i td/osd-backfill-stats/0/new.json 2024-09-16T04:58:06.739 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:58:06.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/0/new.json 2024-09-16T04:58:06.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDeuudmwQ1KHBAArsRISIbjGCGy5PMfrWTYPw== --osd-uuid 549cfa4e-a473-445f-8f21-d4ee530154ed 2024-09-16T04:58:06.781 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:06.780+0000 7fdfcbad6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:58:06.807 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:06.806+0000 7fdfcbad6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:58:06.808 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:06.807+0000 7fdfcbad6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:58:06.808 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:06.807+0000 7fdfcbad6640 -1 bdev(0x55cfa01d3c00 td/osd-backfill-stats/0/block) open stat got: (1) Operation not permitted 2024-09-16T04:58:06.808 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:06.808+0000 7fdfcbad6640 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-09-16T04:58:12.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-09-16T04:58:12.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:58:12.815 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T04:58:12.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T04:58:12.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:58:13.383 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T04:58:13.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T04:58:13.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:58:13.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:58:13.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:58:13.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:58:13.413 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:13.411+0000 7f2d67325640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:58:13.415 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:13.413+0000 7f2d67325640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:58:13.416 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:13.414+0000 7f2d67325640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:58:13.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T04:58:13.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:58:13.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T04:58:13.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:58:13.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:58:13.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:13.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:58:13.832 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:58:13.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:13.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:14.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:14.518 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:14.516+0000 7f2d67325640 -1 Falling back to public interface 2024-09-16T04:58:15.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:15.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:15.268 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:58:15.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:58:15.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:15.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:15.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:16.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:16.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:16.718 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:58:16.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:58:16.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:16.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:17.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:17.295 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:17.293+0000 7f2d67325640 -1 osd.0 0 log_to_monitors true 2024-09-16T04:58:18.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:18.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:18.140 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:58:18.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:58:18.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:18.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:18.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:19.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:19.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:19.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:58:19.578 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:58:19.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:19.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:20.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:21.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:21.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:21.075 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:58:21.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:58:21.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:21.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:21.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:22.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:22.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:22.503 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:58:22.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:58:22.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:22.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:22.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:23.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:23.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:23.922 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:58:23.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:58:23.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:23.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:24.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:25.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:25.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:25.407 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:58:25.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:58:25.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:25.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:25.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:26.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:26.821 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:58:26.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:26.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:58:26.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:26.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:27.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:28.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:28.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:28.296 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:58:28.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:58:28.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:28.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:28.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:29.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:29.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:29.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:58:29.867 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:58:29.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:29.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:30.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:31.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:31.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:31.384 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:58:31.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:58:31.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:31.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:32.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:33.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:33.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:33.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:58:33.213 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:58:33.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:33.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:34.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:35.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:35.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:35.138 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:58:35.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:58:35.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:35.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:35.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:36.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:36.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:36.665 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:58:36.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:58:36.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:36.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:37.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:38.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:38.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:38.086 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:58:38.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:58:38.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:38.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:38.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:39.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:39.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:39.801 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:58:39.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:58:39.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:39.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T04:58:40.279 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/876370938,v1:127.0.0.1:6803/876370938] [v2:127.0.0.1:6804/876370938,v1:127.0.0.1:6805/876370938] exists,up 549cfa4e-a473-445f-8f21-d4ee530154ed 2024-09-16T04:58:40.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:58:40.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:58:40.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:58:40.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:520: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 1 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/1 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:58:40.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:58:40.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T04:58:40.285 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:58:40.285 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:58:40.285 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:58:40.285 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:58:40.285 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:58:40.285 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:58:40.286 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:58:40.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:58:40.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:58:40.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:58:40.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:58:40.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T04:58:40.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T04:58:40.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:58:40.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:58:40.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:58:40.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:58:40.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:58:40.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:58:40.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/1 2024-09-16T04:58:40.287 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:58:40.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=096fb1d3-5619-432b-8112-dffba3523f3a 2024-09-16T04:58:40.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 096fb1d3-5619-432b-8112-dffba3523f3a' 2024-09-16T04:58:40.287 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 096fb1d3-5619-432b-8112-dffba3523f3a 2024-09-16T04:58:40.288 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:58:40.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAAu+dma4EJEhAAHADi82KaxCqtm1CdYNoAPg== 2024-09-16T04:58:40.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAAu+dma4EJEhAAHADi82KaxCqtm1CdYNoAPg=="}' 2024-09-16T04:58:40.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 096fb1d3-5619-432b-8112-dffba3523f3a -i td/osd-backfill-stats/1/new.json 2024-09-16T04:58:40.823 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:58:40.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/1/new.json 2024-09-16T04:58:40.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAAu+dma4EJEhAAHADi82KaxCqtm1CdYNoAPg== --osd-uuid 096fb1d3-5619-432b-8112-dffba3523f3a 2024-09-16T04:58:40.867 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:40.866+0000 7f79ff20b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:58:40.869 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:40.868+0000 7f79ff20b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:58:40.870 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:40.869+0000 7f79ff20b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:58:40.870 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:40.870+0000 7f79ff20b640 -1 bdev(0x55fd9e3fdc00 td/osd-backfill-stats/1/block) open stat got: (1) Operation not permitted 2024-09-16T04:58:40.870 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:40.870+0000 7f79ff20b640 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-09-16T04:58:47.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-09-16T04:58:47.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:58:47.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T04:58:47.282 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T04:58:47.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:58:47.852 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T04:58:47.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T04:58:47.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:58:47.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:58:47.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:58:47.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:58:47.882 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:47.881+0000 7ff9085fd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:58:47.884 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:47.883+0000 7ff9085fd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:58:47.885 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:47.884+0000 7ff9085fd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:58:48.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T04:58:48.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:58:48.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T04:58:48.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:58:48.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:58:48.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:48.296 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:58:48.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:58:48.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:48.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:58:48.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:48.970 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:48.969+0000 7ff9085fd640 -1 Falling back to public interface 2024-09-16T04:58:49.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:49.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:49.763 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:58:49.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:58:49.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:49.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:58:50.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:51.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:51.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:51.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:58:51.208 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:58:51.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:51.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:58:51.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:52.161 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:58:52.160+0000 7ff9085fd640 -1 osd.1 0 log_to_monitors true 2024-09-16T04:58:52.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:52.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:52.632 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:58:52.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:58:52.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:52.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:58:53.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:54.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:54.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:54.386 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:58:54.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:58:54.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:54.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:58:54.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:55.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:55.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:55.892 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:58:55.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:58:55.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:55.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:58:56.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:57.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:57.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:57.382 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:58:57.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:58:57.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:57.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:58:57.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:58:58.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:58:58.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:58:58.917 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:58:58.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:58:58.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:58:58.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:58:59.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:00.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:00.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:00.376 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:59:00.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:59:00.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:00.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:59:00.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:01.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:01.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:01.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:59:01.838 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:59:01.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:01.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:59:02.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:03.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:03.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:03.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:59:03.336 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:59:03.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:03.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:59:03.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:04.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:04.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:04.771 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:59:04.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:59:04.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:04.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:59:05.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:06.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:06.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:06.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:59:06.274 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:59:06.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:06.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:59:06.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:07.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:07.831 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:59:07.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:07.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:59:07.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:07.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:59:08.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:09.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:09.687 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:59:09.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:09.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:59:09.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:09.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:59:10.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:11.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:11.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:11.380 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:59:11.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:59:11.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:11.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:59:12.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:13.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:13.279 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:59:13.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:13.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:59:13.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:13.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:59:14.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:15.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:15.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:15.178 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:59:15.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:59:15.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:15.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T04:59:15.611 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1807430577,v1:127.0.0.1:6811/1807430577] [v2:127.0.0.1:6812/1807430577,v1:127.0.0.1:6813/1807430577] exists,up 096fb1d3-5619-432b-8112-dffba3523f3a 2024-09-16T04:59:15.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:59:15.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:59:15.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:59:15.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:521: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 2 2024-09-16T04:59:15.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T04:59:15.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:59:15.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T04:59:15.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:59:15.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/2 2024-09-16T04:59:15.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T04:59:15.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:59:15.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:59:15.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:59:15.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-09-16T04:59:15.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-09-16T04:59:15.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:59:15.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:59:15.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T04:59:15.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:59:15.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:59:15.616 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:59:15.616 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:59:15.616 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:59:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:59:15.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/2 2024-09-16T04:59:15.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:59:15.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c94ef06d-8d28-43f8-a1a5-2aeeecb53a7b 2024-09-16T04:59:15.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 c94ef06d-8d28-43f8-a1a5-2aeeecb53a7b' 2024-09-16T04:59:15.618 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 c94ef06d-8d28-43f8-a1a5-2aeeecb53a7b 2024-09-16T04:59:15.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:59:15.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAju+dm1sPPJRAAhQCHH8g91vryJsRMh4Q4jg== 2024-09-16T04:59:15.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAju+dm1sPPJRAAhQCHH8g91vryJsRMh4Q4jg=="}' 2024-09-16T04:59:15.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c94ef06d-8d28-43f8-a1a5-2aeeecb53a7b -i td/osd-backfill-stats/2/new.json 2024-09-16T04:59:16.133 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:59:16.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/2/new.json 2024-09-16T04:59:16.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAju+dm1sPPJRAAhQCHH8g91vryJsRMh4Q4jg== --osd-uuid c94ef06d-8d28-43f8-a1a5-2aeeecb53a7b 2024-09-16T04:59:16.177 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:16.176+0000 7fb372302640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:59:16.202 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:16.201+0000 7fb372302640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:59:16.203 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:16.202+0000 7fb372302640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:59:16.204 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:16.203+0000 7fb372302640 -1 bdev(0x56476888dc00 td/osd-backfill-stats/2/block) open stat got: (1) Operation not permitted 2024-09-16T04:59:16.204 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:16.203+0000 7fb372302640 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-09-16T04:59:22.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-09-16T04:59:22.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:59:22.262 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T04:59:22.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T04:59:22.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:59:22.826 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T04:59:22.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T04:59:22.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:59:22.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:59:22.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:59:22.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:59:22.855 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:22.853+0000 7f9831214640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:59:22.873 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:22.871+0000 7f9831214640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:59:22.874 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:22.873+0000 7f9831214640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:59:23.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T04:59:23.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:59:23.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T04:59:23.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:59:23.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:59:23.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:23.296 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:59:23.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:59:23.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:23.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:23.701 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:23.700+0000 7f9831214640 -1 Falling back to public interface 2024-09-16T04:59:23.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:24.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:24.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:24.744 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:59:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:59:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:25.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:26.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:26.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:26.192 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T04:59:26.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T04:59:26.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:26.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:26.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:26.634 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:26.632+0000 7f9831214640 -1 osd.2 0 log_to_monitors true 2024-09-16T04:59:27.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:27.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:27.602 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:59:27.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T04:59:27.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:27.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:28.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:29.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:29.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:29.193 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T04:59:29.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T04:59:29.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:29.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:29.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:30.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:30.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:30.724 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T04:59:30.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T04:59:30.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:30.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:31.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:32.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:32.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:32.146 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T04:59:32.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T04:59:32.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:32.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:32.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:33.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:33.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:33.690 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T04:59:33.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T04:59:33.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:33.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:34.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:35.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:35.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:35.107 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T04:59:35.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T04:59:35.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:35.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:35.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:36.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:36.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:36.610 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T04:59:36.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T04:59:36.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:36.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:37.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:38.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:38.071 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T04:59:38.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:38.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T04:59:38.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:38.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:38.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:39.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:39.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:39.556 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T04:59:39.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T04:59:39.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:39.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:40.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:41.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:41.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:41.314 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T04:59:41.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T04:59:41.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:41.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:41.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:42.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:42.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:42.986 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T04:59:42.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T04:59:42.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:42.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:43.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:44.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:44.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:44.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T04:59:44.693 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T04:59:44.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:44.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:45.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:46.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:46.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:46.202 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T04:59:46.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T04:59:46.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:46.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:46.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:47.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:47.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:47.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T04:59:47.939 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T04:59:47.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:47.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:48.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:49.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:49.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:49.863 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T04:59:49.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T04:59:49.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:49.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T04:59:50.282 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2360071407,v1:127.0.0.1:6819/2360071407] [v2:127.0.0.1:6820/2360071407,v1:127.0.0.1:6821/2360071407] exists,up c94ef06d-8d28-43f8-a1a5-2aeeecb53a7b 2024-09-16T04:59:50.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T04:59:50.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T04:59:50.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T04:59:50.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:522: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 3 2024-09-16T04:59:50.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T04:59:50.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T04:59:50.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T04:59:50.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T04:59:50.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/3 2024-09-16T04:59:50.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T04:59:50.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T04:59:50.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T04:59:50.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T04:59:50.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-09-16T04:59:50.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T04:59:50.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T04:59:50.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T04:59:50.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T04:59:50.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T04:59:50.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T04:59:50.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T04:59:50.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T04:59:50.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T04:59:50.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T04:59:50.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T04:59:50.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/3 2024-09-16T04:59:50.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T04:59:50.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=84970841-f5bb-45dd-8cb6-4d9e8cd891f5 2024-09-16T04:59:50.293 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 84970841-f5bb-45dd-8cb6-4d9e8cd891f5 2024-09-16T04:59:50.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 84970841-f5bb-45dd-8cb6-4d9e8cd891f5' 2024-09-16T04:59:50.293 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T04:59:50.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBGu+dmj0Q0EhAAh6QgwEIpt7oN2ZVqJuV/GQ== 2024-09-16T04:59:50.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBGu+dmj0Q0EhAAh6QgwEIpt7oN2ZVqJuV/GQ=="}' 2024-09-16T04:59:50.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 84970841-f5bb-45dd-8cb6-4d9e8cd891f5 -i td/osd-backfill-stats/3/new.json 2024-09-16T04:59:50.777 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T04:59:50.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/3/new.json 2024-09-16T04:59:50.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBGu+dmj0Q0EhAAh6QgwEIpt7oN2ZVqJuV/GQ== --osd-uuid 84970841-f5bb-45dd-8cb6-4d9e8cd891f5 2024-09-16T04:59:50.821 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:50.820+0000 7f8688d56640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:59:50.825 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:50.822+0000 7f8688d56640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:59:50.825 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:50.823+0000 7f8688d56640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:59:50.826 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:50.824+0000 7f8688d56640 -1 bdev(0x562c9d64bc00 td/osd-backfill-stats/3/block) open stat got: (1) Operation not permitted 2024-09-16T04:59:50.826 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:50.824+0000 7f8688d56640 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-09-16T04:59:56.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-09-16T04:59:56.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T04:59:56.532 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T04:59:56.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T04:59:56.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T04:59:57.114 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T04:59:57.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T04:59:57.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T04:59:57.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T04:59:57.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T04:59:57.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T04:59:57.144 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:57.143+0000 7f0e2361e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:59:57.146 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:57.145+0000 7f0e2361e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:59:57.147 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:57.146+0000 7f0e2361e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T04:59:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T04:59:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T04:59:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T04:59:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T04:59:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T04:59:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:57.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T04:59:57.562 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T04:59:57.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:57.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:59:57.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T04:59:58.512 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T04:59:58.511+0000 7f0e2361e640 -1 Falling back to public interface 2024-09-16T04:59:58.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T04:59:58.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T04:59:58.996 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T04:59:58.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T04:59:58.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T04:59:58.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T04:59:59.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:00.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:00.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:00.439 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:00:00.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:00:00.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:00.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:00.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:01.359 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:00:01.358+0000 7f0e2361e640 -1 osd.3 0 log_to_monitors true 2024-09-16T05:00:01.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:01.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:01.881 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:00:01.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:00:01.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:01.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:02.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:03.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:03.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:03.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:00:03.441 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:00:03.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:03.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:03.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:04.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:04.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:04.923 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:00:04.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:00:04.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:04.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:05.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:06.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:06.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:06.455 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:00:06.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:00:06.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:06.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:06.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:07.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:07.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:07.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:00:07.872 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:00:07.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:07.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:08.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:09.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:09.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:09.292 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:00:09.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:00:09.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:09.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:09.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:10.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:10.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:10.799 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:00:10.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:00:10.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:10.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:11.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:12.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:12.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:12.320 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:00:12.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:00:12.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:12.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:12.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:13.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:13.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:13.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:00:13.742 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:00:13.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:13.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:14.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:15.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:15.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:15.514 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:00:15.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:00:15.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:15.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:16.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:17.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:17.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:17.290 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:00:17.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:00:17.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:17.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:18.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:19.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:19.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:19.298 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:00:19.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:00:19.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:19.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:19.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:20.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:20.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:20.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:00:20.967 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:00:20.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:20.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:21.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:22.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:22.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:22.821 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:00:22.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:00:22.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:22.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:23.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:24.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:24.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:24.675 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:00:24.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:00:24.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:24.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:00:25.118 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1877666022,v1:127.0.0.1:6827/1877666022] [v2:127.0.0.1:6828/1877666022,v1:127.0.0.1:6829/1877666022] exists,up 84970841-f5bb-45dd-8cb6-4d9e8cd891f5 2024-09-16T05:00:25.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:00:25.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:00:25.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:00:25.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:523: TEST_backfill_ec_all_out: run_osd td/osd-backfill-stats 4 2024-09-16T05:00:25.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:00:25.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:00:25.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/4 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:00:25.123 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:00:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:00:25.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:00:25.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:00:25.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:00:25.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/4 2024-09-16T05:00:25.125 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:00:25.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a8684e4c-6746-4d5f-940d-0e3d69e20d0e 2024-09-16T05:00:25.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 a8684e4c-6746-4d5f-940d-0e3d69e20d0e' 2024-09-16T05:00:25.125 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 a8684e4c-6746-4d5f-940d-0e3d69e20d0e 2024-09-16T05:00:25.126 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:00:25.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBpu+dm2DFpCBAA/6XWnhB4EdhDnNEeNVmuww== 2024-09-16T05:00:25.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBpu+dm2DFpCBAA/6XWnhB4EdhDnNEeNVmuww=="}' 2024-09-16T05:00:25.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a8684e4c-6746-4d5f-940d-0e3d69e20d0e -i td/osd-backfill-stats/4/new.json 2024-09-16T05:00:25.702 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:00:25.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/4/new.json 2024-09-16T05:00:25.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBpu+dm2DFpCBAA/6XWnhB4EdhDnNEeNVmuww== --osd-uuid a8684e4c-6746-4d5f-940d-0e3d69e20d0e 2024-09-16T05:00:25.746 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:00:25.745+0000 7f39e47cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:00:25.748 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:00:25.747+0000 7f39e47cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:00:25.749 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:00:25.748+0000 7f39e47cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:00:25.749 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:00:25.748+0000 7f39e47cc640 -1 bdev(0x559c20f97c00 td/osd-backfill-stats/4/block) open stat got: (1) Operation not permitted 2024-09-16T05:00:25.749 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:00:25.749+0000 7f39e47cc640 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-09-16T05:00:31.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-09-16T05:00:31.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:00:31.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T05:00:31.732 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T05:00:31.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:00:32.304 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T05:00:32.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T05:00:32.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:00:32.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:00:32.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:00:32.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:00:32.333 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:00:32.331+0000 7feeb9102640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:00:32.335 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:00:32.333+0000 7feeb9102640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:00:32.336 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:00:32.335+0000 7feeb9102640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:00:32.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T05:00:32.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:00:32.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T05:00:32.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:00:32.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:00:32.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:32.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:00:32.770 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:00:32.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:32.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:33.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:33.437 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:00:33.435+0000 7feeb9102640 -1 Falling back to public interface 2024-09-16T05:00:34.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:34.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:34.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:00:34.223 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:00:34.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:34.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:34.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:35.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:35.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:35.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:00:35.698 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:00:35.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:35.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:36.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:36.512 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:00:36.510+0000 7feeb9102640 -1 osd.4 0 log_to_monitors true 2024-09-16T05:00:37.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:37.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:37.111 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:00:37.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:00:37.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:37.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:37.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:38.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:38.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:38.675 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:00:38.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:00:38.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:38.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:39.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:40.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:40.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:40.126 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:00:40.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:00:40.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:40.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:40.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:41.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:41.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:41.547 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:00:41.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:00:41.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:41.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:41.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:42.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:42.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:42.994 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:00:42.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:00:42.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:42.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:43.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:44.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:44.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:44.458 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:00:44.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:00:44.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:44.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:44.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:45.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:45.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:45.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:00:45.879 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:00:45.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:45.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:46.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:47.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:47.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:47.320 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:00:47.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:00:47.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:47.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:47.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:48.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:48.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:48.775 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:00:48.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:00:48.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:48.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:49.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:50.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:50.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:50.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:00:50.287 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:00:50.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:50.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:50.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:51.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:51.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:51.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:00:51.707 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:00:51.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:51.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:52.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:53.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:53.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:53.414 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:00:53.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:00:53.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:53.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:54.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:55.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:55.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:55.361 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:00:55.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:00:55.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:55.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:55.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:56.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:56.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:56.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:00:56.844 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:00:56.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:56.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:57.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:00:58.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:00:58.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:00:58.595 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:00:58.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:00:58.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:00:58.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:00:59.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:01:00.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:01:00.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:01:00.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T05:01:00.414 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T05:01:00.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:01:00.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:01:00.843 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3670213638,v1:127.0.0.1:6835/3670213638] [v2:127.0.0.1:6836/3670213638,v1:127.0.0.1:6837/3670213638] exists,up a8684e4c-6746-4d5f-940d-0e3d69e20d0e 2024-09-16T05:01:00.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:01:00.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:01:00.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:01:00.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:525: TEST_backfill_ec_all_out: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T05:01:01.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:526: TEST_backfill_ec_all_out: create_pool test 1 1 erasure myprofile 2024-09-16T05:01:01.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2024-09-16T05:01:02.231 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T05:01:02.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T05:01:03.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:528: TEST_backfill_ec_all_out: wait_for_clean 2024-09-16T05:01:03.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:01:03.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:01:03.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:01:03.245 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:01:03.246 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:01:03.246 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:01:03.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:01:03.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:01:03.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:01:03.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:01:03.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:01:03.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:01:03.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:01:03.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:01:03.348 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:01:03.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:01:03.821 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:01:03.821 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:01:03.821 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:01:03.821 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T05:01:03.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:01:03.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:01:03.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:01:03.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836515 2024-09-16T05:01:03.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836515 2024-09-16T05:01:03.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836515' 2024-09-16T05:01:03.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:01:03.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:01:04.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672989 2024-09-16T05:01:04.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672989 2024-09-16T05:01:04.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836515 1-42949672989' 2024-09-16T05:01:04.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:01:04.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:01:04.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509461 2024-09-16T05:01:04.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509461 2024-09-16T05:01:04.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836515 1-42949672989 2-64424509461' 2024-09-16T05:01:04.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:01:04.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:01:04.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345932 2024-09-16T05:01:04.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345932 2024-09-16T05:01:04.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836515 1-42949672989 2-64424509461 3-85899345932' 2024-09-16T05:01:04.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:01:04.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:01:04.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182406 2024-09-16T05:01:04.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182406 2024-09-16T05:01:04.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836515 1-42949672989 2-64424509461 3-85899345932 4-107374182406' 2024-09-16T05:01:04.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:01:04.412 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836515 2024-09-16T05:01:04.412 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:01:04.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:01:04.413 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836515 2024-09-16T05:01:04.413 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:01:04.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836515 2024-09-16T05:01:04.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836515' 2024-09-16T05:01:04.414 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836515 2024-09-16T05:01:04.415 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:01:04.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836515 -lt 21474836515 2024-09-16T05:01:04.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:01:04.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672989 2024-09-16T05:01:04.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:01:04.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:01:04.850 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672989 2024-09-16T05:01:04.850 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:01:04.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672989 2024-09-16T05:01:04.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672989' 2024-09-16T05:01:04.852 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672989 2024-09-16T05:01:04.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:01:05.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672989 -lt 42949672989 2024-09-16T05:01:05.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:01:05.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509461 2024-09-16T05:01:05.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:01:05.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:01:05.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509461 2024-09-16T05:01:05.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:01:05.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509461 2024-09-16T05:01:05.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509461' 2024-09-16T05:01:05.311 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509461 2024-09-16T05:01:05.312 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:01:05.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509461 -lt 64424509461 2024-09-16T05:01:05.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:01:05.769 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345932 2024-09-16T05:01:05.770 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:01:05.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:01:05.771 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345932 2024-09-16T05:01:05.771 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:01:05.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345932 2024-09-16T05:01:05.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345932' 2024-09-16T05:01:05.772 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345932 2024-09-16T05:01:05.772 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:01:06.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345932 -lt 85899345932 2024-09-16T05:01:06.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:01:06.176 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182406 2024-09-16T05:01:06.176 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:01:06.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:01:06.177 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182406 2024-09-16T05:01:06.177 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:01:06.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182406 2024-09-16T05:01:06.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182406' 2024-09-16T05:01:06.178 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182406 2024-09-16T05:01:06.179 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:01:06.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182406 -lt 107374182406 2024-09-16T05:01:06.617 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:01:06.617 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:01:06.617 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:01:07.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:01:07.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:01:07.162 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:01:07.162 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:01:07.162 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:01:07.163 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:01:07.163 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:01:07.163 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:01:07.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:01:07.568 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:01:07.568 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:01:07.568 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:01:08.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:01:08.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:01:08.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:01:08.127 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: seq 1 200 2024-09-16T05:01:08.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:08.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj1 /dev/null 2024-09-16T05:01:08.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:08.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj2 /dev/null 2024-09-16T05:01:08.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:08.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj3 /dev/null 2024-09-16T05:01:08.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:08.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj4 /dev/null 2024-09-16T05:01:08.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:08.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj5 /dev/null 2024-09-16T05:01:09.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:09.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj6 /dev/null 2024-09-16T05:01:09.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:09.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj7 /dev/null 2024-09-16T05:01:09.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:09.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj8 /dev/null 2024-09-16T05:01:09.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:09.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj9 /dev/null 2024-09-16T05:01:09.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:09.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj10 /dev/null 2024-09-16T05:01:09.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:09.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj11 /dev/null 2024-09-16T05:01:10.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:10.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj12 /dev/null 2024-09-16T05:01:10.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:10.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj13 /dev/null 2024-09-16T05:01:10.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:10.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj14 /dev/null 2024-09-16T05:01:10.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:10.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj15 /dev/null 2024-09-16T05:01:10.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:10.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj16 /dev/null 2024-09-16T05:01:11.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:11.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj17 /dev/null 2024-09-16T05:01:11.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:11.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj18 /dev/null 2024-09-16T05:01:11.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:11.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj19 /dev/null 2024-09-16T05:01:11.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:11.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj20 /dev/null 2024-09-16T05:01:11.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:11.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj21 /dev/null 2024-09-16T05:01:11.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:11.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj22 /dev/null 2024-09-16T05:01:12.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:12.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj23 /dev/null 2024-09-16T05:01:12.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:12.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj24 /dev/null 2024-09-16T05:01:12.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:12.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj25 /dev/null 2024-09-16T05:01:12.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:12.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj26 /dev/null 2024-09-16T05:01:12.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:12.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj27 /dev/null 2024-09-16T05:01:12.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:12.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj28 /dev/null 2024-09-16T05:01:13.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:13.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj29 /dev/null 2024-09-16T05:01:13.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:13.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj30 /dev/null 2024-09-16T05:01:13.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:13.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj31 /dev/null 2024-09-16T05:01:13.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:13.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj32 /dev/null 2024-09-16T05:01:13.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:13.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj33 /dev/null 2024-09-16T05:01:14.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:14.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj34 /dev/null 2024-09-16T05:01:14.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:14.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj35 /dev/null 2024-09-16T05:01:14.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:14.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj36 /dev/null 2024-09-16T05:01:14.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:14.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj37 /dev/null 2024-09-16T05:01:14.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:14.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj38 /dev/null 2024-09-16T05:01:14.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:14.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj39 /dev/null 2024-09-16T05:01:15.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:15.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj40 /dev/null 2024-09-16T05:01:15.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:15.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj41 /dev/null 2024-09-16T05:01:15.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:15.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj42 /dev/null 2024-09-16T05:01:15.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:15.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj43 /dev/null 2024-09-16T05:01:15.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:15.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj44 /dev/null 2024-09-16T05:01:16.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:16.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj45 /dev/null 2024-09-16T05:01:16.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:16.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj46 /dev/null 2024-09-16T05:01:16.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:16.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj47 /dev/null 2024-09-16T05:01:16.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:16.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj48 /dev/null 2024-09-16T05:01:16.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:16.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj49 /dev/null 2024-09-16T05:01:16.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:16.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj50 /dev/null 2024-09-16T05:01:17.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:17.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj51 /dev/null 2024-09-16T05:01:17.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:17.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj52 /dev/null 2024-09-16T05:01:17.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:17.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj53 /dev/null 2024-09-16T05:01:17.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:17.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj54 /dev/null 2024-09-16T05:01:17.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:17.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj55 /dev/null 2024-09-16T05:01:18.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:18.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj56 /dev/null 2024-09-16T05:01:18.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:18.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj57 /dev/null 2024-09-16T05:01:18.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:18.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj58 /dev/null 2024-09-16T05:01:18.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:18.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj59 /dev/null 2024-09-16T05:01:18.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:18.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj60 /dev/null 2024-09-16T05:01:18.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:18.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj61 /dev/null 2024-09-16T05:01:19.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:19.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj62 /dev/null 2024-09-16T05:01:19.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:19.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj63 /dev/null 2024-09-16T05:01:19.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:19.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj64 /dev/null 2024-09-16T05:01:19.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:19.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj65 /dev/null 2024-09-16T05:01:19.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:19.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj66 /dev/null 2024-09-16T05:01:20.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:20.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj67 /dev/null 2024-09-16T05:01:20.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:20.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj68 /dev/null 2024-09-16T05:01:20.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:20.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj69 /dev/null 2024-09-16T05:01:20.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:20.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj70 /dev/null 2024-09-16T05:01:20.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:20.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj71 /dev/null 2024-09-16T05:01:20.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:20.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj72 /dev/null 2024-09-16T05:01:21.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:21.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj73 /dev/null 2024-09-16T05:01:21.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:21.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj74 /dev/null 2024-09-16T05:01:21.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:21.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj75 /dev/null 2024-09-16T05:01:21.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:21.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj76 /dev/null 2024-09-16T05:01:21.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:21.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj77 /dev/null 2024-09-16T05:01:21.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:21.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj78 /dev/null 2024-09-16T05:01:22.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:22.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj79 /dev/null 2024-09-16T05:01:22.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:22.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj80 /dev/null 2024-09-16T05:01:22.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:22.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj81 /dev/null 2024-09-16T05:01:22.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:22.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj82 /dev/null 2024-09-16T05:01:22.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:22.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj83 /dev/null 2024-09-16T05:01:22.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:22.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj84 /dev/null 2024-09-16T05:01:23.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:23.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj85 /dev/null 2024-09-16T05:01:23.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:23.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj86 /dev/null 2024-09-16T05:01:23.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:23.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj87 /dev/null 2024-09-16T05:01:23.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:23.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj88 /dev/null 2024-09-16T05:01:23.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:23.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj89 /dev/null 2024-09-16T05:01:24.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:24.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj90 /dev/null 2024-09-16T05:01:24.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:24.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj91 /dev/null 2024-09-16T05:01:24.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:24.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj92 /dev/null 2024-09-16T05:01:24.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:24.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj93 /dev/null 2024-09-16T05:01:24.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:24.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj94 /dev/null 2024-09-16T05:01:24.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:24.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj95 /dev/null 2024-09-16T05:01:25.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:25.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj96 /dev/null 2024-09-16T05:01:25.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:25.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj97 /dev/null 2024-09-16T05:01:25.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:25.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj98 /dev/null 2024-09-16T05:01:25.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:25.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj99 /dev/null 2024-09-16T05:01:26.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:26.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj100 /dev/null 2024-09-16T05:01:26.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:26.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj101 /dev/null 2024-09-16T05:01:26.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:26.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj102 /dev/null 2024-09-16T05:01:26.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:26.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj103 /dev/null 2024-09-16T05:01:26.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:26.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj104 /dev/null 2024-09-16T05:01:26.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:26.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj105 /dev/null 2024-09-16T05:01:27.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:27.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj106 /dev/null 2024-09-16T05:01:27.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:27.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj107 /dev/null 2024-09-16T05:01:27.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:27.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj108 /dev/null 2024-09-16T05:01:27.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:27.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj109 /dev/null 2024-09-16T05:01:27.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:27.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj110 /dev/null 2024-09-16T05:01:28.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:28.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj111 /dev/null 2024-09-16T05:01:28.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:28.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj112 /dev/null 2024-09-16T05:01:28.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:28.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj113 /dev/null 2024-09-16T05:01:28.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:28.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj114 /dev/null 2024-09-16T05:01:28.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:28.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj115 /dev/null 2024-09-16T05:01:28.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:28.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj116 /dev/null 2024-09-16T05:01:29.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:29.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj117 /dev/null 2024-09-16T05:01:29.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:29.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj118 /dev/null 2024-09-16T05:01:29.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:29.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj119 /dev/null 2024-09-16T05:01:29.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:29.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj120 /dev/null 2024-09-16T05:01:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:29.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj121 /dev/null 2024-09-16T05:01:29.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:29.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj122 /dev/null 2024-09-16T05:01:30.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:30.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj123 /dev/null 2024-09-16T05:01:30.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:30.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj124 /dev/null 2024-09-16T05:01:30.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:30.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj125 /dev/null 2024-09-16T05:01:30.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:30.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj126 /dev/null 2024-09-16T05:01:30.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:30.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj127 /dev/null 2024-09-16T05:01:31.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:31.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj128 /dev/null 2024-09-16T05:01:31.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:31.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj129 /dev/null 2024-09-16T05:01:31.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:31.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj130 /dev/null 2024-09-16T05:01:31.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:31.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj131 /dev/null 2024-09-16T05:01:31.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:31.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj132 /dev/null 2024-09-16T05:01:31.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:31.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj133 /dev/null 2024-09-16T05:01:32.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:32.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj134 /dev/null 2024-09-16T05:01:32.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:32.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj135 /dev/null 2024-09-16T05:01:32.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:32.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj136 /dev/null 2024-09-16T05:01:32.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:32.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj137 /dev/null 2024-09-16T05:01:32.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:32.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj138 /dev/null 2024-09-16T05:01:32.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:32.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj139 /dev/null 2024-09-16T05:01:33.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:33.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj140 /dev/null 2024-09-16T05:01:33.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:33.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj141 /dev/null 2024-09-16T05:01:33.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:33.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj142 /dev/null 2024-09-16T05:01:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj143 /dev/null 2024-09-16T05:01:33.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:33.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj144 /dev/null 2024-09-16T05:01:34.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:34.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj145 /dev/null 2024-09-16T05:01:34.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:34.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj146 /dev/null 2024-09-16T05:01:34.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:34.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj147 /dev/null 2024-09-16T05:01:34.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:34.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj148 /dev/null 2024-09-16T05:01:34.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:34.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj149 /dev/null 2024-09-16T05:01:35.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:35.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj150 /dev/null 2024-09-16T05:01:35.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:35.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj151 /dev/null 2024-09-16T05:01:35.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:35.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj152 /dev/null 2024-09-16T05:01:35.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:35.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj153 /dev/null 2024-09-16T05:01:35.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:35.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj154 /dev/null 2024-09-16T05:01:35.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:35.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj155 /dev/null 2024-09-16T05:01:36.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:36.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj156 /dev/null 2024-09-16T05:01:36.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:36.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj157 /dev/null 2024-09-16T05:01:36.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:36.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj158 /dev/null 2024-09-16T05:01:36.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:36.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj159 /dev/null 2024-09-16T05:01:36.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:36.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj160 /dev/null 2024-09-16T05:01:36.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:36.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj161 /dev/null 2024-09-16T05:01:37.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:37.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj162 /dev/null 2024-09-16T05:01:37.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:37.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj163 /dev/null 2024-09-16T05:01:37.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:37.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj164 /dev/null 2024-09-16T05:01:37.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:37.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj165 /dev/null 2024-09-16T05:01:37.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:37.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj166 /dev/null 2024-09-16T05:01:38.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:38.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj167 /dev/null 2024-09-16T05:01:38.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:38.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj168 /dev/null 2024-09-16T05:01:38.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:38.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj169 /dev/null 2024-09-16T05:01:38.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:38.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj170 /dev/null 2024-09-16T05:01:38.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:38.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj171 /dev/null 2024-09-16T05:01:38.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:38.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj172 /dev/null 2024-09-16T05:01:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:39.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj173 /dev/null 2024-09-16T05:01:39.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:39.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj174 /dev/null 2024-09-16T05:01:39.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:39.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj175 /dev/null 2024-09-16T05:01:39.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:39.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj176 /dev/null 2024-09-16T05:01:39.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:39.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj177 /dev/null 2024-09-16T05:01:39.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:39.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj178 /dev/null 2024-09-16T05:01:40.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:40.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj179 /dev/null 2024-09-16T05:01:40.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:40.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj180 /dev/null 2024-09-16T05:01:40.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:40.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj181 /dev/null 2024-09-16T05:01:40.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:40.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj182 /dev/null 2024-09-16T05:01:40.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:40.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj183 /dev/null 2024-09-16T05:01:41.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:41.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj184 /dev/null 2024-09-16T05:01:41.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:41.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj185 /dev/null 2024-09-16T05:01:41.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:41.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj186 /dev/null 2024-09-16T05:01:41.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:41.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj187 /dev/null 2024-09-16T05:01:41.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:41.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj188 /dev/null 2024-09-16T05:01:41.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:41.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj189 /dev/null 2024-09-16T05:01:42.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:42.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj190 /dev/null 2024-09-16T05:01:42.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:42.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj191 /dev/null 2024-09-16T05:01:42.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:42.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj192 /dev/null 2024-09-16T05:01:42.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:42.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj193 /dev/null 2024-09-16T05:01:42.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:42.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj194 /dev/null 2024-09-16T05:01:42.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:42.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj195 /dev/null 2024-09-16T05:01:43.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:43.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj196 /dev/null 2024-09-16T05:01:43.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:43.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj197 /dev/null 2024-09-16T05:01:43.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:43.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj198 /dev/null 2024-09-16T05:01:43.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:43.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj199 /dev/null 2024-09-16T05:01:43.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:530: TEST_backfill_ec_all_out: for i in $(seq 1 $objects) 2024-09-16T05:01:43.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:532: TEST_backfill_ec_all_out: rados -p test put obj200 /dev/null 2024-09-16T05:01:44.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:535: TEST_backfill_ec_all_out: get_pg test obj1 2024-09-16T05:01:44.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T05:01:44.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T05:01:44.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T05:01:44.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T05:01:44.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:535: TEST_backfill_ec_all_out: local PG=1.0 2024-09-16T05:01:44.490 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:537: TEST_backfill_ec_all_out: get_primary test obj1 2024-09-16T05:01:44.490 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:01:44.490 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:01:44.491 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:01:44.491 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:01:44.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:537: TEST_backfill_ec_all_out: local primary=1 2024-09-16T05:01:44.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:539: TEST_backfill_ec_all_out: ceph osd set nobackfill 2024-09-16T05:01:45.555 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is set 2024-09-16T05:01:45.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:540: TEST_backfill_ec_all_out: get_osds test obj1 2024-09-16T05:01:45.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2024-09-16T05:01:45.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj1 2024-09-16T05:01:45.568 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test obj1 2024-09-16T05:01:45.568 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2024-09-16T05:01:46.029 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2024-09-16T05:01:46.029 INFO:tasks.workunit.client.0.smithi026.stderr:0 2024-09-16T05:01:46.029 INFO:tasks.workunit.client.0.smithi026.stderr:2' 2024-09-16T05:01:46.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 2024-09-16T05:01:46.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:540: TEST_backfill_ec_all_out: for o in $(get_osds $poolname obj1) 2024-09-16T05:01:46.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:542: TEST_backfill_ec_all_out: ceph osd out osd.1 2024-09-16T05:01:46.656 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. 2024-09-16T05:01:46.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:540: TEST_backfill_ec_all_out: for o in $(get_osds $poolname obj1) 2024-09-16T05:01:46.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:542: TEST_backfill_ec_all_out: ceph osd out osd.0 2024-09-16T05:01:47.423 INFO:tasks.workunit.client.0.smithi026.stderr:osd.0 is already out. 2024-09-16T05:01:47.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:540: TEST_backfill_ec_all_out: for o in $(get_osds $poolname obj1) 2024-09-16T05:01:47.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:542: TEST_backfill_ec_all_out: ceph osd out osd.2 2024-09-16T05:01:48.293 INFO:tasks.workunit.client.0.smithi026.stderr:osd.2 is already out. 2024-09-16T05:01:48.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:545: TEST_backfill_ec_all_out: sleep 2 2024-09-16T05:01:50.306 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:546: TEST_backfill_ec_all_out: get_primary test obj1 2024-09-16T05:01:50.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:01:50.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:01:50.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:01:50.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:01:50.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:546: TEST_backfill_ec_all_out: primary=1 2024-09-16T05:01:50.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:547: TEST_backfill_ec_all_out: ceph osd unset nobackfill 2024-09-16T05:01:51.522 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is unset 2024-09-16T05:01:51.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:548: TEST_backfill_ec_all_out: ceph tell osd.1 get_latest_osdmap 2024-09-16T05:01:51.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:549: TEST_backfill_ec_all_out: ceph tell osd.1 debug kick_recovery_wq 0 2024-09-16T05:01:51.793 INFO:tasks.workunit.client.0.smithi026.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-09-16T05:01:51.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:550: TEST_backfill_ec_all_out: sleep 2 2024-09-16T05:01:53.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:552: TEST_backfill_ec_all_out: wait_for_clean 2024-09-16T05:01:53.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:01:53.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:01:53.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:01:53.804 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:01:53.805 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:01:53.805 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:01:53.805 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:01:53.805 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:01:53.805 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:01:53.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:01:53.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:01:53.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:01:53.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:01:53.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:01:53.907 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:01:54.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:01:54.319 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:01:54.319 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:01:54.319 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:01:54.319 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T05:01:54.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:01:54.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:01:54.319 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:01:54.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836527 2024-09-16T05:01:54.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836527 2024-09-16T05:01:54.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527' 2024-09-16T05:01:54.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:01:54.472 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:01:54.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673001 2024-09-16T05:01:54.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673001 2024-09-16T05:01:54.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949673001' 2024-09-16T05:01:54.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:01:54.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:01:54.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509473 2024-09-16T05:01:54.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509473 2024-09-16T05:01:54.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949673001 2-64424509473' 2024-09-16T05:01:54.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:01:54.725 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:01:54.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345944 2024-09-16T05:01:54.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345944 2024-09-16T05:01:54.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949673001 2-64424509473 3-85899345944' 2024-09-16T05:01:54.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:01:54.843 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:01:54.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182418 2024-09-16T05:01:54.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182418 2024-09-16T05:01:54.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949673001 2-64424509473 3-85899345944 4-107374182418' 2024-09-16T05:01:54.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:01:54.963 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836527 2024-09-16T05:01:54.963 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:01:54.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:01:54.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836527 2024-09-16T05:01:54.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:01:54.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836527 2024-09-16T05:01:54.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836527' 2024-09-16T05:01:54.966 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836527 2024-09-16T05:01:54.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:01:55.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836527 -lt 21474836527 2024-09-16T05:01:55.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:01:55.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673001 2024-09-16T05:01:55.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:01:55.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:01:55.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673001 2024-09-16T05:01:55.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:01:55.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673001 2024-09-16T05:01:55.483 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673001 2024-09-16T05:01:55.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673001' 2024-09-16T05:01:55.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:01:55.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673001 -lt 42949673001 2024-09-16T05:01:55.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:01:55.890 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509473 2024-09-16T05:01:55.890 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:01:55.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:01:55.891 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509473 2024-09-16T05:01:55.891 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:01:55.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509473 2024-09-16T05:01:55.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509473' 2024-09-16T05:01:55.893 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509473 2024-09-16T05:01:55.893 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:01:56.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509471 -lt 64424509473 2024-09-16T05:01:56.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T05:01:57.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T05:01:57.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:01:57.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509474 -lt 64424509473 2024-09-16T05:01:57.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:01:57.925 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345944 2024-09-16T05:01:57.925 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:01:57.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:01:57.926 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345944 2024-09-16T05:01:57.926 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:01:57.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345944 2024-09-16T05:01:57.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345944' 2024-09-16T05:01:57.927 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345944 2024-09-16T05:01:57.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:01:58.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345945 -lt 85899345944 2024-09-16T05:01:58.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:01:58.403 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182418 2024-09-16T05:01:58.403 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:01:58.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:01:58.405 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182418 2024-09-16T05:01:58.405 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:01:58.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182418 2024-09-16T05:01:58.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182418' 2024-09-16T05:01:58.406 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182418 2024-09-16T05:01:58.406 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:01:58.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182419 -lt 107374182418 2024-09-16T05:01:58.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:01:58.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:01:58.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:01:59.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:01:59.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:01:59.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:01:59.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:01:59.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:01:59.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:01:59.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:01:59.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:01:59.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:01:59.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:01:59.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:01:59.938 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:00.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:00.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T05:02:00.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T05:02:00.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T05:02:00.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:00.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:00.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:00.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:00.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:00.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:00.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:00.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:00.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:00.618 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:01.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:01.049 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:01.049 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:01.050 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:01.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:01.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:01.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:01.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:01.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:01.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:01.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:01.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:01.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:02.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=2 2024-09-16T05:02:02.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 2 '!=' null 2024-09-16T05:02:02.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:02.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:02.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:02.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:02.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:02.431 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:02.432 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:02.432 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:02.432 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:02.432 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:02.432 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:02.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:02.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:02.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:02.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:03.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:03.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:03.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:03.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:03.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:03.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:03.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:03.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:03.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:04.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4 2024-09-16T05:02:04.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4 '!=' null 2024-09-16T05:02:04.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:04.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:04.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:04.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:04.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:04.107 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:04.108 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:04.108 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:04.108 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:04.108 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:04.108 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:04.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:04.554 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:04.554 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:04.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:05.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:05.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:05.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:05.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:05.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:05.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:05.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:05.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:05.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:05.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4 2024-09-16T05:02:05.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4 '!=' null 2024-09-16T05:02:05.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:05.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:05.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:05.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:05.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:05.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:05.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:05.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:05.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:05.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:05.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:06.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:06.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:06.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:06.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:06.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:06.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:06.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:06.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:06.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:06.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:06.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:06.803 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:06.803 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:07.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:02:07.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:02:07.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:07.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:07.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:07.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:07.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:07.627 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:07.627 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:07.627 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:07.627 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:07.627 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:07.627 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:08.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:08.073 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:08.074 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:08.074 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:08.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:08.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:08.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:08.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:08.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:08.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:08.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:08.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:08.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:09.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:02:09.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:02:09.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:09.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:09.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:09.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:09.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:09.412 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:09.412 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:09.412 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:09.412 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:09.412 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:09.412 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:09.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:09.816 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:09.817 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:09.817 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:10.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:10.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:10.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:10.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:10.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:10.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:10.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:10.429 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:10.429 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:11.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:02:11.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:02:11.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:11.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:11.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:11.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:11.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:11.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:11.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:11.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:11.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:11.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:11.239 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:11.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:11.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:11.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:11.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:12.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:12.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:12.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:12.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:12.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:12.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:12.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:12.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:12.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:12.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:02:12.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:02:12.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:12.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:12.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:12.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:12.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:12.958 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:12.958 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:12.958 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:12.958 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:12.958 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:12.958 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:13.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:13.365 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:13.366 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:13.366 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:14.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:14.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:14.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:14.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:14.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:14.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:14.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:14.011 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:14.011 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:14.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:02:14.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:02:14.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:14.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:14.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:14.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:14.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:14.705 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:14.705 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:14.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:14.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:14.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:14.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:15.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:15.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:15.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:15.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:15.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:15.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:15.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:15.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:15.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:15.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:15.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:15.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:15.738 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:16.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:02:16.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:02:16.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:16.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:16.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:16.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:16.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:16.462 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:16.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:16.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:16.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:16.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:16.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:16.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:16.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:16.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:16.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:17.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:17.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:17.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:17.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:17.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:17.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:17.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:17.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:17.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:18.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:02:18.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:02:18.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:18.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:18.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:18.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:18.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:18.197 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:18.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:18.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:18.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:18.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:18.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:18.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:18.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:18.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:18.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:19.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:19.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:19.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:19.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:19.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:19.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:19.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:19.298 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:19.298 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:19.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:02:19.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:02:19.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:19.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:19.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:19.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:19.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:19.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:19.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:19.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:19.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:19.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:19.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:20.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:20.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:20.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:20.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:20.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:20.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:20.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:20.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:20.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:20.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:20.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:20.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:20.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:21.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:02:21.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:02:21.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:21.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:21.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:21.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:21.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:21.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:21.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:21.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:21.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:21.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:21.707 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:22.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:22.105 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:22.105 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:22.105 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:22.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:22.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:22.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:22.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:22.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:22.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:22.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:22.704 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:22.704 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:23.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:02:23.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:02:23.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:23.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:23.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:23.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:23.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:23.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:23.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:23.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:23.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:23.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:23.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:23.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:23.800 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:23.801 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:23.801 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:24.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:24.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:24.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:24.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:24.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:24.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:24.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:24.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:24.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:25.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:02:25.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:02:25.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:02:25.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:25.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:02:25.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:25.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:25.267 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:25.267 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:25.267 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:25.267 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:25.267 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:25.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:25.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:25.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:25.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:25.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:26.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:26.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:26.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:26.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:26.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:26.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:26.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:26.356 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:26.356 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:26.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2024-09-16T05:02:26.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2024-09-16T05:02:26.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1655: wait_for_clean: (( 1 >= 13 )) 2024-09-16T05:02:26.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:26.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.2 2024-09-16T05:02:27.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:27.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:27.118 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:27.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:27.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:27.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:27.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:27.119 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:27.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:27.513 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:27.514 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:27.514 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:28.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:28.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:28.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:28.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:28.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:28.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:28.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:28.108 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:28.108 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:28.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2024-09-16T05:02:28.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2024-09-16T05:02:28.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1655: wait_for_clean: (( 2 >= 13 )) 2024-09-16T05:02:28.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:28.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.4 2024-09-16T05:02:29.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:29.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:29.059 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:29.059 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:29.059 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:29.059 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:29.059 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:29.059 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:29.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:02:29.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:29.457 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:29.457 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:30.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:02:30.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:02:30.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:02:30.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:02:30.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:02:30.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:02:30.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:02:30.008 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:02:30.008 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:02:30.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2024-09-16T05:02:30.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2024-09-16T05:02:30.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1655: wait_for_clean: (( 3 >= 13 )) 2024-09-16T05:02:30.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:02:30.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.8 2024-09-16T05:02:31.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:02:31.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:02:31.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:02:31.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:02:31.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:02:31.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:02:31.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:02:31.387 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:02:31.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:02:31.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:02:31.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:02:31.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:02:32.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:02:32.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:02:32.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:02:32.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:554: TEST_backfill_ec_all_out: expr 200 '*' 3 2024-09-16T05:02:32.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:554: TEST_backfill_ec_all_out: local misplaced=600 2024-09-16T05:02:32.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:555: TEST_backfill_ec_all_out: check td/osd-backfill-stats 1.0 1 erasure 0 0 600 200 2024-09-16T05:02:32.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-09-16T05:02:32.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-09-16T05:02:32.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-09-16T05:02:32.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=erasure 2024-09-16T05:02:32.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=0 2024-09-16T05:02:32.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-09-16T05:02:32.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=600 2024-09-16T05:02:32.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=200 2024-09-16T05:02:32.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-09-16T05:02:32.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-09-16T05:02:32.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-09-16T05:02:32.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-09-16T05:02:32.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-09-16T05:02:32.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-09-16T05:02:32.354 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log 2024-09-16T05:02:32.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-09-16T05:02:32.369 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-09-16T05:02:32.369 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-09-16T05:02:32.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-09-16T05:02:32.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-09-16T05:02:32.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' erasure = erasure ']' 2024-09-16T05:02:32.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:89: check: addp=p 2024-09-16T05:02:32.371 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-09-16T05:02:32.371 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:02:32.371 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-09-16T05:02:32.371 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-09-16T05:02:32.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[4,3,NONE]/[1,0,2]' 2024-09-16T05:02:32.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[4,3,NONE]/[1,0,2]' ']' 2024-09-16T05:02:32.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-09-16T05:02:32.396 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:02:32.397 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:02:32.397 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [4,3,NONE]/[1,0,2]p' 2024-09-16T05:02:32.397 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-09-16T05:02:32.397 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-09-16T05:02:32.397 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:02:32.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=0 2024-09-16T05:02:32.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 0 ']' 2024-09-16T05:02:32.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 0 0 2024-09-16T05:02:32.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-09-16T05:02:32.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:02:32.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-09-16T05:02:32.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:02:32.404 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:02:32.404 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:02:32.404 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-09-16T05:02:32.404 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:02:32.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=0 2024-09-16T05:02:32.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 0 ']' 2024-09-16T05:02:32.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 0 0 2024-09-16T05:02:32.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-09-16T05:02:32.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:02:32.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:02:32.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:02:32.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-09-16T05:02:32.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:02:32.417 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:02:32.417 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [4,3,NONE]/[1,0,2]p' 2024-09-16T05:02:32.417 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-09-16T05:02:32.417 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-09-16T05:02:32.418 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:02:32.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=600 2024-09-16T05:02:32.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 600 ']' 2024-09-16T05:02:32.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 600 600 2024-09-16T05:02:32.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=600 2024-09-16T05:02:32.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:02:32.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=600 2024-09-16T05:02:32.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:02:32.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:02:32.425 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:02:32.425 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-09-16T05:02:32.425 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:02:32.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=202 2024-09-16T05:02:32.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 202 ']' 2024-09-16T05:02:32.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 202 200 2024-09-16T05:02:32.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=202 2024-09-16T05:02:32.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:02:32.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=200 2024-09-16T05:02:32.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:02:32.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-09-16T05:02:32.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:557: TEST_backfill_ec_all_out: delete_pool test 2024-09-16T05:02:32.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T05:02:32.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T05:02:33.105 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T05:02:33.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:558: TEST_backfill_ec_all_out: kill_daemons td/osd-backfill-stats 2024-09-16T05:02:33.117 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:02:33.117 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:02:33.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:02:33.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:02:33.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:02:38.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:02:38.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-09-16T05:02:38.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:02:38.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:02:38.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:02:38.433 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:02:38.433 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:02:38.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:02:38.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:02:38.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:02:38.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:02:38.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:02:38.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:02:38.443 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:02:38.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:02:38.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:02:38.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:02:38.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:02:38.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:02:38.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:02:38.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:02:38.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:02:38.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:02:38.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:02:38.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:02:38.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:02:38.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:02:38.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:02:38.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:02:38.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:02:38.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-09-16T05:02:38.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-09-16T05:02:38.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-stats 2024-09-16T05:02:38.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-stats 2024-09-16T05:02:38.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:02:38.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:02:38.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:02:38.491 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:02:38.491 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:02:38.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:02:38.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:02:38.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:02:38.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:02:38.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:02:38.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:02:38.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:02:38.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:02:38.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:02:38.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:02:38.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:02:38.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:02:38.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:02:38.496 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:02:38.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:02:38.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:02:38.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:02:38.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:02:38.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:02:38.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:02:38.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:02:38.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:02:38.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:02:38.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-stats 2024-09-16T05:02:38.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T05:02:38.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:02:38.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:02:38.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.478321 2024-09-16T05:02:38.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T05:02:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T05:02:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T05:02:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-09-16T05:02:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_ec_down_all_out td/osd-backfill-stats 2024-09-16T05:02:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:619: TEST_backfill_ec_down_all_out: local dir=td/osd-backfill-stats 2024-09-16T05:02:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:621: TEST_backfill_ec_down_all_out: run_mon td/osd-backfill-stats a 2024-09-16T05:02:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-stats 2024-09-16T05:02:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T05:02:38.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T05:02:38.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T05:02:38.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-stats/a 2024-09-16T05:02:38.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-09-16T05:02:38.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T05:02:38.970 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:02:38.970 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:02:38.970 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:02:38.970 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:02:38.970 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:02:38.970 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:02:38.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T05:02:39.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T05:02:39.165 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T05:02:39.165 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:02:39.165 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:02:39.165 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T05:02:39.165 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T05:02:39.166 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:02:39.166 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:02:39.167 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:02:39.167 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:02:39.167 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:02:39.167 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:02:39.167 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:02:39.167 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:02:39.167 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get fsid 2024-09-16T05:02:39.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T05:02:39.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:02:39.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:02:39.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T05:02:39.256 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T05:02:39.256 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:02:39.256 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:02:39.256 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:02:39.256 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:02:39.256 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:02:39.256 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:02:39.256 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:02:39.256 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:02:39.257 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get mon_host 2024-09-16T05:02:39.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:622: TEST_backfill_ec_down_all_out: run_mgr td/osd-backfill-stats x 2024-09-16T05:02:39.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-stats 2024-09-16T05:02:39.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T05:02:39.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T05:02:39.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T05:02:39.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-stats/x 2024-09-16T05:02:39.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T05:02:40.200 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T05:02:40.200 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:02:40.200 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:02:40.200 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:02:40.201 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:02:40.201 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:02:40.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:02:40.201 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:02:40.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:02:40.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:623: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 0 2024-09-16T05:02:40.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:02:40.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:02:40.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T05:02:40.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:02:40.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/0 2024-09-16T05:02:40.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:02:40.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:02:40.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:02:40.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:02:40.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-09-16T05:02:40.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-09-16T05:02:40.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:02:40.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:02:40.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:02:40.239 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:02:40.239 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:02:40.239 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:02:40.239 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:02:40.239 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:02:40.239 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:02:40.239 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:02:40.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:02:40.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/0 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:02:40.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d08a0058-dcc7-4352-ac72-b2b25a5748ad 2024-09-16T05:02:40.241 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 d08a0058-dcc7-4352-ac72-b2b25a5748ad 2024-09-16T05:02:40.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d08a0058-dcc7-4352-ac72-b2b25a5748ad' 2024-09-16T05:02:40.241 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:02:40.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDwu+dmasAHDxAAbbShI4rQUqpnihMFcmb9Yw== 2024-09-16T05:02:40.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDwu+dmasAHDxAAbbShI4rQUqpnihMFcmb9Yw=="}' 2024-09-16T05:02:40.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d08a0058-dcc7-4352-ac72-b2b25a5748ad -i td/osd-backfill-stats/0/new.json 2024-09-16T05:02:40.524 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:02:40.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/0/new.json 2024-09-16T05:02:40.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDwu+dmasAHDxAAbbShI4rQUqpnihMFcmb9Yw== --osd-uuid d08a0058-dcc7-4352-ac72-b2b25a5748ad 2024-09-16T05:02:40.568 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:02:40.567+0000 7ff2f1415640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:02:40.587 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:02:40.587+0000 7ff2f1415640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:02:40.588 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:02:40.588+0000 7ff2f1415640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:02:40.589 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:02:40.588+0000 7ff2f1415640 -1 bdev(0x55fa7993fc00 td/osd-backfill-stats/0/block) open stat got: (1) Operation not permitted 2024-09-16T05:02:40.589 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:02:40.588+0000 7ff2f1415640 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-09-16T05:02:46.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-09-16T05:02:46.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:02:46.061 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T05:02:46.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T05:02:46.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:02:46.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T05:02:46.633 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T05:02:46.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:02:46.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:02:46.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:02:46.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:02:46.662 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:02:46.660+0000 7fe5218b0640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:02:46.677 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:02:46.675+0000 7fe5218b0640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:02:46.677 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:02:46.676+0000 7fe5218b0640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:02:47.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T05:02:47.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:02:47.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T05:02:47.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:02:47.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:02:47.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:02:47.107 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:02:47.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:02:47.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:02:47.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:02:47.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:02:48.034 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:02:48.032+0000 7fe5218b0640 -1 Falling back to public interface 2024-09-16T05:02:48.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:02:48.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:02:48.526 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:02:48.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:02:48.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:02:48.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:02:48.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:02:49.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:02:49.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:02:49.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:02:49.960 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:02:49.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:02:49.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:02:50.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:02:50.822 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:02:50.820+0000 7fe5218b0640 -1 osd.0 0 log_to_monitors true 2024-09-16T05:02:51.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:02:51.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:02:51.375 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:02:51.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:02:51.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:02:51.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:02:51.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:02:52.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:02:52.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:02:52.882 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:02:52.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:02:52.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:02:52.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:02:53.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:02:54.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:02:54.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:02:54.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:02:54.326 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:02:54.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:02:54.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:02:54.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:02:55.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:02:55.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:02:55.775 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:02:55.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:02:55.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:02:55.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:02:56.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:02:57.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:02:57.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:02:57.217 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:02:57.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:02:57.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:02:57.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:02:57.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:02:58.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:02:58.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:02:58.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:02:58.713 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:02:58.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:02:58.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:02:59.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:00.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:00.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:00.124 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:03:00.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:03:00.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:00.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:03:00.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:01.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:01.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:01.577 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:03:01.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:03:01.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:01.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:03:02.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:03.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:03.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:03.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:03:03.180 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:03:03.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:03.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:03:03.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:04.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:04.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:04.736 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:03:04.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:03:04.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:04.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:03:05.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:06.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:06.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:06.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:03:06.680 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:03:06.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:06.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:03:07.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:08.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:08.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:08.613 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:03:08.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:03:08.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:08.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:03:09.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:10.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:10.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:10.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:03:10.762 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:03:10.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:10.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:03:11.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:12.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:12.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:12.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:03:12.689 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:03:12.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:12.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:03:13.129 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/272348960,v1:127.0.0.1:6803/272348960] [v2:127.0.0.1:6804/272348960,v1:127.0.0.1:6805/272348960] exists,up d08a0058-dcc7-4352-ac72-b2b25a5748ad 2024-09-16T05:03:13.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:03:13.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:03:13.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:03:13.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:624: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 1 2024-09-16T05:03:13.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:03:13.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:03:13.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T05:03:13.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:03:13.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/1 2024-09-16T05:03:13.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:03:13.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:03:13.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:03:13.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:03:13.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-09-16T05:03:13.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-09-16T05:03:13.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:03:13.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:03:13.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:03:13.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:03:13.136 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:03:13.137 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:03:13.137 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:03:13.137 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:03:13.137 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:03:13.137 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:03:13.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:03:13.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:03:13.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:03:13.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:03:13.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:03:13.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:03:13.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:03:13.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:03:13.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:03:13.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:03:13.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:03:13.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:03:13.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/1 2024-09-16T05:03:13.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:03:13.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=af69e3ff-cfdf-4557-b978-505666883a95 2024-09-16T05:03:13.139 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 af69e3ff-cfdf-4557-b978-505666883a95 2024-09-16T05:03:13.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 af69e3ff-cfdf-4557-b978-505666883a95' 2024-09-16T05:03:13.139 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:03:13.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQARvOdmww4VCRAAvjg45YIOUGGLJveaDCEZng== 2024-09-16T05:03:13.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQARvOdmww4VCRAAvjg45YIOUGGLJveaDCEZng=="}' 2024-09-16T05:03:13.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new af69e3ff-cfdf-4557-b978-505666883a95 -i td/osd-backfill-stats/1/new.json 2024-09-16T05:03:13.672 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:03:13.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/1/new.json 2024-09-16T05:03:13.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQARvOdmww4VCRAAvjg45YIOUGGLJveaDCEZng== --osd-uuid af69e3ff-cfdf-4557-b978-505666883a95 2024-09-16T05:03:13.716 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:13.715+0000 7fa823fa8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:03:13.718 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:13.717+0000 7fa823fa8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:03:13.719 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:13.718+0000 7fa823fa8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:03:13.720 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:13.719+0000 7fa823fa8640 -1 bdev(0x556892a97c00 td/osd-backfill-stats/1/block) open stat got: (1) Operation not permitted 2024-09-16T05:03:13.720 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:13.719+0000 7fa823fa8640 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-09-16T05:03:19.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-09-16T05:03:19.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:03:19.401 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T05:03:19.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T05:03:19.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:03:19.979 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T05:03:19.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T05:03:19.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:03:19.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:03:19.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:03:19.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:03:20.009 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:20.008+0000 7fa7e160c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:03:20.010 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:20.010+0000 7fa7e160c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:03:20.011 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:20.011+0000 7fa7e160c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:03:20.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T05:03:20.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:03:20.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T05:03:20.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:03:20.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:03:20.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:20.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:03:20.457 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:03:20.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:20.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:20.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:21.611 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:21.610+0000 7fa7e160c640 -1 Falling back to public interface 2024-09-16T05:03:21.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:21.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:21.960 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:03:21.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:03:21.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:21.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:22.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:23.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:23.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:23.411 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:03:23.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:03:23.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:23.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:23.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:24.592 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:24.591+0000 7fa7e160c640 -1 osd.1 0 log_to_monitors true 2024-09-16T05:03:24.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:24.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:24.855 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:03:24.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:03:24.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:24.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:25.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:26.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:26.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:26.303 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:03:26.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:03:26.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:26.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:26.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:27.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:27.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:27.749 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:03:27.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:03:27.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:27.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:28.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:29.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:29.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:29.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:03:29.191 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:03:29.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:29.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:29.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:30.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:30.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:30.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:03:30.974 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:03:30.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:30.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:31.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:32.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:32.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:32.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:03:32.430 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:03:32.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:32.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:32.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:33.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:33.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:33.880 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:03:33.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:03:33.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:33.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:34.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:35.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:35.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:35.429 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:03:35.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:03:35.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:35.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:35.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:36.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:36.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:36.851 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:03:36.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:03:36.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:36.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:37.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:38.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:38.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:38.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:03:38.962 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:03:38.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:38.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:40.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:41.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:41.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:41.107 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:03:41.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:03:41.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:41.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:41.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:42.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:42.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:42.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:03:42.769 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:03:42.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:42.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:43.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:44.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:44.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:44.607 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:03:44.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:03:44.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:44.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:45.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:46.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:46.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:46.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:03:46.370 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:03:46.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:46.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:46.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:47.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:47.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:47.844 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:03:47.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:03:47.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:47.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:03:48.304 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/470902188,v1:127.0.0.1:6811/470902188] [v2:127.0.0.1:6812/470902188,v1:127.0.0.1:6813/470902188] exists,up af69e3ff-cfdf-4557-b978-505666883a95 2024-09-16T05:03:48.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:03:48.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:03:48.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:03:48.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:625: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 2 2024-09-16T05:03:48.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/2 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:03:48.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:03:48.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:03:48.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:03:48.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:03:48.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:03:48.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:03:48.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:03:48.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/2 2024-09-16T05:03:48.311 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:03:48.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4e8afe59-4f13-41e1-b475-6df9f96ec102 2024-09-16T05:03:48.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 4e8afe59-4f13-41e1-b475-6df9f96ec102' 2024-09-16T05:03:48.311 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 4e8afe59-4f13-41e1-b475-6df9f96ec102 2024-09-16T05:03:48.312 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:03:48.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA0vOdm6IqFExAATVpzocx/b+G7eRRW6SpdZw== 2024-09-16T05:03:48.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA0vOdm6IqFExAATVpzocx/b+G7eRRW6SpdZw=="}' 2024-09-16T05:03:48.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4e8afe59-4f13-41e1-b475-6df9f96ec102 -i td/osd-backfill-stats/2/new.json 2024-09-16T05:03:48.886 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:03:48.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/2/new.json 2024-09-16T05:03:48.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA0vOdm6IqFExAATVpzocx/b+G7eRRW6SpdZw== --osd-uuid 4e8afe59-4f13-41e1-b475-6df9f96ec102 2024-09-16T05:03:48.930 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:48.928+0000 7f72a001d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:03:48.932 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:48.930+0000 7f72a001d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:03:48.933 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:48.931+0000 7f72a001d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:03:48.933 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:48.932+0000 7f72a001d640 -1 bdev(0x5597694e5c00 td/osd-backfill-stats/2/block) open stat got: (1) Operation not permitted 2024-09-16T05:03:48.934 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:48.932+0000 7f72a001d640 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-09-16T05:03:54.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-09-16T05:03:54.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:03:54.622 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T05:03:54.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T05:03:54.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:03:55.186 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T05:03:55.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T05:03:55.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:03:55.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:03:55.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:03:55.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:03:55.215 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:55.214+0000 7f17d69b2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:03:55.222 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:55.220+0000 7f17d69b2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:03:55.223 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:55.221+0000 7f17d69b2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:03:55.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T05:03:55.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:03:55.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T05:03:55.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:03:55.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:03:55.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:55.623 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:03:55.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:03:55.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:55.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:03:56.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:56.816 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:56.814+0000 7f17d69b2640 -1 Falling back to public interface 2024-09-16T05:03:57.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:57.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:57.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:03:57.106 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:03:57.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:57.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:03:57.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:58.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:03:58.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:03:58.558 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:03:58.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:03:58.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:03:58.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:03:59.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:03:59.737 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:03:59.735+0000 7f17d69b2640 -1 osd.2 0 log_to_monitors true 2024-09-16T05:04:00.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:00.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:00.001 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:04:00.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:04:00.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:00.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:00.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:01.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:01.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:01.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:04:01.646 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:04:01.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:01.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:02.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:03.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:03.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:03.080 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:04:03.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:04:03.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:03.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:03.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:04.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:04.593 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:04:04.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:04.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:04:04.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:04.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:05.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:06.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:06.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:06.011 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:04:06.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:04:06.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:06.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:06.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:07.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:07.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:07.633 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:04:07.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:04:07.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:07.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:08.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:09.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:09.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:09.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:04:09.060 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:04:09.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:09.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:09.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:10.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:10.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:10.536 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:04:10.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:04:10.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:10.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:10.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:11.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:11.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:11.986 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:04:11.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:04:11.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:11.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:12.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:13.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:13.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:13.700 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:04:13.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:04:13.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:13.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:14.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:15.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:04:15.618 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:04:15.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:15.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:16.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:17.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:17.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:17.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:04:17.364 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:04:17.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:17.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:17.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:18.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:18.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:18.870 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:04:18.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:04:18.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:18.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:19.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:20.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:20.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:20.620 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:04:20.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:04:20.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:20.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:21.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:22.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:22.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:22.264 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:04:22.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:04:22.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:22.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:04:22.703 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/820867113,v1:127.0.0.1:6819/820867113] [v2:127.0.0.1:6820/820867113,v1:127.0.0.1:6821/820867113] exists,up 4e8afe59-4f13-41e1-b475-6df9f96ec102 2024-09-16T05:04:22.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:04:22.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:04:22.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:04:22.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:626: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 3 2024-09-16T05:04:22.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:04:22.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:04:22.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T05:04:22.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:04:22.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/3 2024-09-16T05:04:22.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:04:22.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:04:22.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:04:22.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:04:22.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-09-16T05:04:22.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-09-16T05:04:22.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:04:22.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:04:22.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:04:22.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:04:22.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:04:22.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:04:22.714 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:04:22.714 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:04:22.714 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:04:22.715 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:04:22.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:04:22.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:04:22.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:04:22.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:04:22.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:04:22.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:04:22.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:04:22.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:04:22.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:04:22.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:04:22.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:04:22.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:04:22.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/3 2024-09-16T05:04:22.717 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:04:22.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=211f8e92-f8f5-4bcf-a8b8-4a3020a23eba 2024-09-16T05:04:22.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 211f8e92-f8f5-4bcf-a8b8-4a3020a23eba' 2024-09-16T05:04:22.718 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 211f8e92-f8f5-4bcf-a8b8-4a3020a23eba 2024-09-16T05:04:22.718 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:04:22.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBWvOdmQ2RGKxAAVxuCz2GlAlH9I8xak7FczA== 2024-09-16T05:04:22.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBWvOdmQ2RGKxAAVxuCz2GlAlH9I8xak7FczA=="}' 2024-09-16T05:04:22.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 211f8e92-f8f5-4bcf-a8b8-4a3020a23eba -i td/osd-backfill-stats/3/new.json 2024-09-16T05:04:23.227 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:04:23.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/3/new.json 2024-09-16T05:04:23.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBWvOdmQ2RGKxAAVxuCz2GlAlH9I8xak7FczA== --osd-uuid 211f8e92-f8f5-4bcf-a8b8-4a3020a23eba 2024-09-16T05:04:23.270 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:23.269+0000 7faf09814640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:04:23.272 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:23.271+0000 7faf09814640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:04:23.273 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:23.272+0000 7faf09814640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:04:23.273 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:23.273+0000 7faf09814640 -1 bdev(0x5615aad6dc00 td/osd-backfill-stats/3/block) open stat got: (1) Operation not permitted 2024-09-16T05:04:23.274 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:23.273+0000 7faf09814640 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-09-16T05:04:29.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-09-16T05:04:29.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:04:29.050 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T05:04:29.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T05:04:29.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:04:29.624 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T05:04:29.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T05:04:29.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:04:29.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:04:29.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:04:29.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:04:29.654 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:29.653+0000 7f542ba44640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:04:29.656 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:29.655+0000 7f542ba44640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:04:29.657 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:29.656+0000 7f542ba44640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:04:30.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T05:04:30.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:04:30.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T05:04:30.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:04:30.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:04:30.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:30.086 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:04:30.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:04:30.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:30.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:30.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:31.254 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:31.253+0000 7f542ba44640 -1 Falling back to public interface 2024-09-16T05:04:31.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:31.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:31.593 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:04:31.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:04:31.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:31.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:32.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:33.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:33.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:33.054 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:04:33.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:04:33.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:33.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:33.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:34.149 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:34.148+0000 7f542ba44640 -1 osd.3 0 log_to_monitors true 2024-09-16T05:04:34.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:34.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:34.539 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:04:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:04:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:34.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:35.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:36.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:36.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:36.050 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:04:36.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:04:36.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:36.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:36.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:37.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:37.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:37.476 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:04:37.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:04:37.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:37.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:37.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:38.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:38.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:38.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:04:38.999 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:04:39.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:39.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:39.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:40.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:40.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:40.419 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:04:40.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:04:40.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:40.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:40.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:41.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:41.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:41.835 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:04:41.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:04:41.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:41.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:42.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:43.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:43.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:43.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:04:43.351 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:04:43.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:43.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:43.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:44.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:44.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:44.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:04:44.763 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:04:44.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:44.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:45.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:46.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:46.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:46.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:04:46.215 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:04:46.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:46.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:46.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:47.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:47.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:47.696 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:04:47.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:04:47.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:47.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:48.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:49.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:49.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:49.341 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:04:49.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:04:49.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:49.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:50.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:51.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:51.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:04:51.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:04:51.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:51.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:51.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:52.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:52.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:52.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:04:52.892 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:04:52.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:52.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:53.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:54.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:54.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:54.713 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:04:54.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:04:54.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:54.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:55.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:56.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:56.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:56.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:04:56.358 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:04:56.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:56.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:56.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:04:57.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:04:57.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:04:57.822 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T05:04:57.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T05:04:57.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:04:57.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:04:58.312 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1944847688,v1:127.0.0.1:6827/1944847688] [v2:127.0.0.1:6828/1944847688,v1:127.0.0.1:6829/1944847688] exists,up 211f8e92-f8f5-4bcf-a8b8-4a3020a23eba 2024-09-16T05:04:58.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:04:58.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:04:58.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:04:58.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:627: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 4 2024-09-16T05:04:58.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:04:58.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:04:58.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T05:04:58.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:04:58.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/4 2024-09-16T05:04:58.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:04:58.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:04:58.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:04:58.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:04:58.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-09-16T05:04:58.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-09-16T05:04:58.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:04:58.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:04:58.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:04:58.318 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:04:58.318 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:04:58.318 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:04:58.318 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:04:58.318 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:04:58.318 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:04:58.318 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:04:58.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/4 2024-09-16T05:04:58.320 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:04:58.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a17402d8-b2aa-4de5-87f6-474b976e9b51 2024-09-16T05:04:58.320 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 a17402d8-b2aa-4de5-87f6-474b976e9b51 2024-09-16T05:04:58.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 a17402d8-b2aa-4de5-87f6-474b976e9b51' 2024-09-16T05:04:58.320 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:04:58.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB6vOdmhY0FFBAAdYs+GSJzEQ8wrQkNQRrcTA== 2024-09-16T05:04:58.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB6vOdmhY0FFBAAdYs+GSJzEQ8wrQkNQRrcTA=="}' 2024-09-16T05:04:58.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a17402d8-b2aa-4de5-87f6-474b976e9b51 -i td/osd-backfill-stats/4/new.json 2024-09-16T05:04:58.871 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:04:58.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/4/new.json 2024-09-16T05:04:58.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB6vOdmhY0FFBAAdYs+GSJzEQ8wrQkNQRrcTA== --osd-uuid a17402d8-b2aa-4de5-87f6-474b976e9b51 2024-09-16T05:04:58.915 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:58.913+0000 7f0342e0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:04:58.937 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:58.935+0000 7f0342e0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:04:58.940 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:58.937+0000 7f0342e0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:04:58.940 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:58.937+0000 7f0342e0f640 -1 bdev(0x55a0e901fc00 td/osd-backfill-stats/4/block) open stat got: (1) Operation not permitted 2024-09-16T05:04:58.940 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:04:58.937+0000 7f0342e0f640 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-09-16T05:05:05.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-09-16T05:05:05.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:05:05.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T05:05:05.119 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T05:05:05.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:05:05.679 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T05:05:05.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T05:05:05.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:05:05.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:05:05.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:05:05.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:05:05.709 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:05.707+0000 7ff6d9f51640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:05:05.726 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:05.724+0000 7ff6d9f51640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:05:05.727 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:05.726+0000 7ff6d9f51640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:05:06.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T05:05:06.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:05:06.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T05:05:06.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:05:06.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:05:06.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:06.133 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:05:06.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:05:06.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:06.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:06.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:06.824 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:06.822+0000 7ff6d9f51640 -1 Falling back to public interface 2024-09-16T05:05:07.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:07.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:07.568 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:05:07.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:05:07.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:07.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:08.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:09.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:09.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:09.011 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:05:09.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:05:09.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:09.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:09.221 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:09.220+0000 7ff6d9f51640 -1 osd.4 0 log_to_monitors true 2024-09-16T05:05:09.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:10.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:10.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:10.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:05:10.447 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:05:10.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:10.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:10.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:11.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:11.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:11.862 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:05:11.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:05:11.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:11.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:12.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:13.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:13.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:13.319 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:05:13.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:05:13.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:13.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:13.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:14.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:14.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:14.767 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:05:14.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:05:14.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:14.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:15.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:16.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:16.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:16.192 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:05:16.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:05:16.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:16.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:16.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:17.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:17.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:17.671 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:05:17.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:05:17.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:17.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:18.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:19.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:19.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:19.170 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:05:19.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:05:19.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:19.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:19.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:20.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:20.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:20.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:05:20.676 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:05:20.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:20.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:21.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:22.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:22.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:22.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:05:22.209 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:05:22.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:22.209 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:22.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:23.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:23.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:23.802 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:05:23.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:05:23.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:23.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:24.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:25.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:25.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:25.494 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:05:25.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:05:25.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:25.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:26.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:27.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:27.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:27.107 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:05:27.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:05:27.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:27.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:28.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:29.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:29.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:29.025 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:05:29.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:05:29.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:29.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:29.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:30.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:30.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:30.472 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:05:30.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:05:30.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:30.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:31.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:32.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:32.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:32.106 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:05:32.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:05:32.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:32.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:05:32.571 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/3543946760,v1:127.0.0.1:6835/3543946760] [v2:127.0.0.1:6836/3543946760,v1:127.0.0.1:6837/3543946760] exists,up a17402d8-b2aa-4de5-87f6-474b976e9b51 2024-09-16T05:05:32.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:628: TEST_backfill_ec_down_all_out: run_osd td/osd-backfill-stats 5 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/5 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:05:32.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-09-16T05:05:32.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-09-16T05:05:32.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:05:32.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:05:32.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:05:32.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:05:32.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:05:32.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:05:32.576 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:05:32.576 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:05:32.576 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:05:32.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:05:32.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/5 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:05:32.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7e1ac1b8-549a-4913-926f-10f134344dea 2024-09-16T05:05:32.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 7e1ac1b8-549a-4913-926f-10f134344dea' 2024-09-16T05:05:32.578 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 7e1ac1b8-549a-4913-926f-10f134344dea 2024-09-16T05:05:32.578 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:05:32.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCcvOdmbANnIxAAcGNZspiI3VUJF4n2MUfH7w== 2024-09-16T05:05:32.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCcvOdmbANnIxAAcGNZspiI3VUJF4n2MUfH7w=="}' 2024-09-16T05:05:32.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7e1ac1b8-549a-4913-926f-10f134344dea -i td/osd-backfill-stats/5/new.json 2024-09-16T05:05:33.102 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:05:33.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/5/new.json 2024-09-16T05:05:33.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCcvOdmbANnIxAAcGNZspiI3VUJF4n2MUfH7w== --osd-uuid 7e1ac1b8-549a-4913-926f-10f134344dea 2024-09-16T05:05:33.147 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:33.146+0000 7fb26da17640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:05:33.184 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:33.183+0000 7fb26da17640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:05:33.185 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:33.184+0000 7fb26da17640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:05:33.185 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:33.185+0000 7fb26da17640 -1 bdev(0x5636d70ffc00 td/osd-backfill-stats/5/block) open stat got: (1) Operation not permitted 2024-09-16T05:05:33.185 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:33.185+0000 7fb26da17640 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-09-16T05:05:39.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-09-16T05:05:39.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:05:39.607 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T05:05:39.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T05:05:39.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:05:40.175 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T05:05:40.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T05:05:40.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:05:40.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:05:40.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:05:40.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:05:40.205 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:40.205+0000 7fb4d1815640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:05:40.209 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:40.207+0000 7fb4d1815640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:05:40.209 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:40.208+0000 7fb4d1815640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:05:40.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T05:05:40.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:05:40.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T05:05:40.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:05:40.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:05:40.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:40.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:05:40.613 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:05:40.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:40.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:41.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:41.561 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:41.560+0000 7fb4d1815640 -1 Falling back to public interface 2024-09-16T05:05:42.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:42.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:42.050 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:05:42.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:05:42.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:42.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:42.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:43.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:43.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:43.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:05:43.517 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:05:43.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:43.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:43.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:44.415 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:05:44.414+0000 7fb4d1815640 -1 osd.5 0 log_to_monitors true 2024-09-16T05:05:44.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:44.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:44.941 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:05:44.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:05:44.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:44.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:45.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:46.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:46.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:46.478 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:05:46.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:05:46.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:46.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:46.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:47.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:47.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:47.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:05:47.897 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:05:47.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:47.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:48.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:49.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:49.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:49.397 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:05:49.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:05:49.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:49.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:49.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:50.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:50.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:50.831 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:05:50.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:05:50.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:50.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:51.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:52.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:52.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:52.301 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:05:52.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:05:52.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:52.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:52.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:53.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:53.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:53.741 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:05:53.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:05:53.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:53.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:54.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:55.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:55.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:55.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:05:55.217 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:05:55.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:55.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:55.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:56.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:56.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:56.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:05:56.712 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:05:56.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:56.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:57.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:58.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:58.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:58.182 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:05:58.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:05:58.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:58.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:05:58.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:05:59.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:05:59.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:05:59.702 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:05:59.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:05:59.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:05:59.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:06:00.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:06:01.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:06:01.458 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:06:01.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:06:01.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:06:01.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:06:01.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:06:02.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:06:03.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:06:03.362 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:06:03.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:06:03.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:06:03.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:06:03.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:06:04.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:06:05.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:06:05.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:06:05.266 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:06:05.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:06:05.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:06:05.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:06:06.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:06:07.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:06:07.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:06:07.151 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:06:07.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:06:07.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:06:07.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:06:08.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:06:09.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:06:09.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:06:09.129 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T05:06:09.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T05:06:09.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:06:09.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:06:09.611 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/2748016316,v1:127.0.0.1:6843/2748016316] [v2:127.0.0.1:6844/2748016316,v1:127.0.0.1:6845/2748016316] exists,up 7e1ac1b8-549a-4913-926f-10f134344dea 2024-09-16T05:06:09.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:06:09.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:06:09.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:06:09.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:630: TEST_backfill_ec_down_all_out: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T05:06:10.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:631: TEST_backfill_ec_down_all_out: create_pool test 1 1 erasure myprofile 2024-09-16T05:06:10.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2024-09-16T05:06:11.061 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T05:06:11.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T05:06:12.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:632: TEST_backfill_ec_down_all_out: ceph osd pool set test min_size 2 2024-09-16T05:06:12.714 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 min_size to 2 2024-09-16T05:06:12.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:634: TEST_backfill_ec_down_all_out: wait_for_clean 2024-09-16T05:06:12.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:06:12.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:06:12.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:06:12.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:06:12.728 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:06:12.728 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:06:12.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:06:12.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:06:12.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:06:12.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:06:12.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:06:12.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:06:12.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:06:12.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:06:12.819 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:06:13.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:06:13.219 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:06:13.219 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:06:13.219 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:06:13.219 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T05:06:13.219 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T05:06:13.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:06:13.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:06:13.220 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:06:13.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836522 2024-09-16T05:06:13.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836522 2024-09-16T05:06:13.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836522' 2024-09-16T05:06:13.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:06:13.398 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:06:13.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672994 2024-09-16T05:06:13.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672994 2024-09-16T05:06:13.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836522 1-42949672994' 2024-09-16T05:06:13.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:06:13.558 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:06:13.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509472 2024-09-16T05:06:13.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509472 2024-09-16T05:06:13.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836522 1-42949672994 2-64424509472' 2024-09-16T05:06:13.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:06:13.676 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:06:13.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345941 2024-09-16T05:06:13.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345941 2024-09-16T05:06:13.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836522 1-42949672994 2-64424509472 3-85899345941' 2024-09-16T05:06:13.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:06:13.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:06:13.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182413 2024-09-16T05:06:13.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182413 2024-09-16T05:06:13.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836522 1-42949672994 2-64424509472 3-85899345941 4-107374182413' 2024-09-16T05:06:13.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:06:13.913 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T05:06:14.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018885 2024-09-16T05:06:14.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018885 2024-09-16T05:06:14.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836522 1-42949672994 2-64424509472 3-85899345941 4-107374182413 5-128849018885' 2024-09-16T05:06:14.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:06:14.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836522 2024-09-16T05:06:14.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:06:14.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:06:14.032 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836522 2024-09-16T05:06:14.032 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:06:14.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836522 2024-09-16T05:06:14.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836522' 2024-09-16T05:06:14.033 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836522 2024-09-16T05:06:14.033 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:06:14.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836519 -lt 21474836522 2024-09-16T05:06:14.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T05:06:15.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T05:06:15.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:06:15.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836522 -lt 21474836522 2024-09-16T05:06:15.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:06:15.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672994 2024-09-16T05:06:15.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:06:15.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:06:15.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672994 2024-09-16T05:06:15.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:06:15.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672994 2024-09-16T05:06:15.930 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672994 2024-09-16T05:06:15.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672994' 2024-09-16T05:06:15.931 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:06:16.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672994 -lt 42949672994 2024-09-16T05:06:16.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:06:16.388 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509472 2024-09-16T05:06:16.388 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:06:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:06:16.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509472 2024-09-16T05:06:16.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:06:16.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509472 2024-09-16T05:06:16.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509472' 2024-09-16T05:06:16.391 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509472 2024-09-16T05:06:16.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:06:16.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509472 -lt 64424509472 2024-09-16T05:06:16.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:06:16.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345941 2024-09-16T05:06:16.873 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:06:16.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:06:16.874 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345941 2024-09-16T05:06:16.874 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:06:16.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345941 2024-09-16T05:06:16.875 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345941 2024-09-16T05:06:16.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345941' 2024-09-16T05:06:16.876 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:06:17.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345941 -lt 85899345941 2024-09-16T05:06:17.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:06:17.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182413 2024-09-16T05:06:17.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:06:17.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:06:17.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182413 2024-09-16T05:06:17.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:06:17.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182413 2024-09-16T05:06:17.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182413' 2024-09-16T05:06:17.566 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182413 2024-09-16T05:06:17.566 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:06:17.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182413 -lt 107374182413 2024-09-16T05:06:17.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:06:17.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018885 2024-09-16T05:06:17.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:06:17.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T05:06:17.785 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018885 2024-09-16T05:06:17.785 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:06:17.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018885 2024-09-16T05:06:17.787 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018885 2024-09-16T05:06:17.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018885' 2024-09-16T05:06:17.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T05:06:18.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018885 -lt 128849018885 2024-09-16T05:06:18.226 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:06:18.226 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:06:18.226 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:06:18.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:06:18.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:06:18.782 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:06:18.782 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:06:18.782 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:06:18.782 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:06:18.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:06:18.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:06:19.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:06:19.196 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:06:19.196 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:06:19.196 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:06:19.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:06:19.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:06:19.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:06:19.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: seq 1 200 2024-09-16T05:06:19.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:19.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj1 /dev/null 2024-09-16T05:06:19.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:19.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj2 /dev/null 2024-09-16T05:06:20.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:20.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj3 /dev/null 2024-09-16T05:06:20.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:20.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj4 /dev/null 2024-09-16T05:06:20.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:20.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj5 /dev/null 2024-09-16T05:06:20.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:20.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj6 /dev/null 2024-09-16T05:06:20.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:20.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj7 /dev/null 2024-09-16T05:06:20.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:20.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj8 /dev/null 2024-09-16T05:06:21.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:21.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj9 /dev/null 2024-09-16T05:06:21.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:21.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj10 /dev/null 2024-09-16T05:06:21.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:21.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj11 /dev/null 2024-09-16T05:06:21.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:21.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj12 /dev/null 2024-09-16T05:06:21.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:21.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj13 /dev/null 2024-09-16T05:06:21.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:21.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj14 /dev/null 2024-09-16T05:06:22.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:22.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj15 /dev/null 2024-09-16T05:06:22.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:22.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj16 /dev/null 2024-09-16T05:06:22.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:22.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj17 /dev/null 2024-09-16T05:06:22.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:22.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj18 /dev/null 2024-09-16T05:06:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj19 /dev/null 2024-09-16T05:06:23.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:23.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj20 /dev/null 2024-09-16T05:06:23.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:23.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj21 /dev/null 2024-09-16T05:06:23.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:23.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj22 /dev/null 2024-09-16T05:06:23.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:23.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj23 /dev/null 2024-09-16T05:06:23.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:23.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj24 /dev/null 2024-09-16T05:06:23.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:23.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj25 /dev/null 2024-09-16T05:06:24.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:24.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj26 /dev/null 2024-09-16T05:06:24.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:24.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj27 /dev/null 2024-09-16T05:06:24.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:24.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj28 /dev/null 2024-09-16T05:06:24.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:24.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj29 /dev/null 2024-09-16T05:06:24.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:24.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj30 /dev/null 2024-09-16T05:06:25.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:25.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj31 /dev/null 2024-09-16T05:06:25.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:25.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj32 /dev/null 2024-09-16T05:06:25.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:25.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj33 /dev/null 2024-09-16T05:06:25.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:25.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj34 /dev/null 2024-09-16T05:06:25.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:25.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj35 /dev/null 2024-09-16T05:06:25.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:25.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj36 /dev/null 2024-09-16T05:06:26.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:26.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj37 /dev/null 2024-09-16T05:06:26.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:26.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj38 /dev/null 2024-09-16T05:06:26.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:26.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj39 /dev/null 2024-09-16T05:06:26.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:26.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj40 /dev/null 2024-09-16T05:06:26.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:26.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj41 /dev/null 2024-09-16T05:06:26.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:26.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj42 /dev/null 2024-09-16T05:06:27.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:27.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj43 /dev/null 2024-09-16T05:06:27.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:27.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj44 /dev/null 2024-09-16T05:06:27.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:27.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj45 /dev/null 2024-09-16T05:06:27.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:27.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj46 /dev/null 2024-09-16T05:06:27.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:27.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj47 /dev/null 2024-09-16T05:06:27.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:27.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj48 /dev/null 2024-09-16T05:06:28.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:28.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj49 /dev/null 2024-09-16T05:06:28.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:28.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj50 /dev/null 2024-09-16T05:06:28.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:28.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj51 /dev/null 2024-09-16T05:06:28.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:28.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj52 /dev/null 2024-09-16T05:06:28.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:28.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj53 /dev/null 2024-09-16T05:06:28.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:28.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj54 /dev/null 2024-09-16T05:06:29.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:29.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj55 /dev/null 2024-09-16T05:06:29.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:29.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj56 /dev/null 2024-09-16T05:06:29.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:29.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj57 /dev/null 2024-09-16T05:06:29.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:29.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj58 /dev/null 2024-09-16T05:06:29.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:29.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj59 /dev/null 2024-09-16T05:06:30.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:30.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj60 /dev/null 2024-09-16T05:06:30.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:30.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj61 /dev/null 2024-09-16T05:06:30.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:30.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj62 /dev/null 2024-09-16T05:06:30.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:30.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj63 /dev/null 2024-09-16T05:06:30.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:30.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj64 /dev/null 2024-09-16T05:06:30.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:30.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj65 /dev/null 2024-09-16T05:06:31.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:31.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj66 /dev/null 2024-09-16T05:06:31.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:31.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj67 /dev/null 2024-09-16T05:06:31.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:31.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj68 /dev/null 2024-09-16T05:06:31.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:31.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj69 /dev/null 2024-09-16T05:06:31.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:31.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj70 /dev/null 2024-09-16T05:06:31.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:31.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj71 /dev/null 2024-09-16T05:06:32.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:32.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj72 /dev/null 2024-09-16T05:06:32.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:32.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj73 /dev/null 2024-09-16T05:06:32.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:32.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj74 /dev/null 2024-09-16T05:06:32.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:32.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj75 /dev/null 2024-09-16T05:06:32.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:32.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj76 /dev/null 2024-09-16T05:06:32.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:32.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj77 /dev/null 2024-09-16T05:06:33.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:33.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj78 /dev/null 2024-09-16T05:06:33.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:33.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj79 /dev/null 2024-09-16T05:06:33.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:33.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj80 /dev/null 2024-09-16T05:06:33.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:33.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj81 /dev/null 2024-09-16T05:06:33.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:33.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj82 /dev/null 2024-09-16T05:06:34.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:34.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj83 /dev/null 2024-09-16T05:06:34.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:34.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj84 /dev/null 2024-09-16T05:06:34.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:34.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj85 /dev/null 2024-09-16T05:06:34.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:34.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj86 /dev/null 2024-09-16T05:06:35.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:35.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj87 /dev/null 2024-09-16T05:06:35.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:35.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj88 /dev/null 2024-09-16T05:06:35.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:35.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj89 /dev/null 2024-09-16T05:06:35.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:35.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj90 /dev/null 2024-09-16T05:06:35.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:35.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj91 /dev/null 2024-09-16T05:06:35.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:35.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj92 /dev/null 2024-09-16T05:06:36.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:36.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj93 /dev/null 2024-09-16T05:06:36.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:36.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj94 /dev/null 2024-09-16T05:06:36.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:36.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj95 /dev/null 2024-09-16T05:06:36.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:36.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj96 /dev/null 2024-09-16T05:06:36.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:36.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj97 /dev/null 2024-09-16T05:06:36.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:36.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj98 /dev/null 2024-09-16T05:06:37.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:37.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj99 /dev/null 2024-09-16T05:06:37.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:37.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj100 /dev/null 2024-09-16T05:06:37.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:37.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj101 /dev/null 2024-09-16T05:06:37.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:37.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj102 /dev/null 2024-09-16T05:06:37.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:37.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj103 /dev/null 2024-09-16T05:06:37.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:37.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj104 /dev/null 2024-09-16T05:06:38.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:38.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj105 /dev/null 2024-09-16T05:06:38.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:38.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj106 /dev/null 2024-09-16T05:06:38.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:38.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj107 /dev/null 2024-09-16T05:06:38.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:38.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj108 /dev/null 2024-09-16T05:06:38.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:38.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj109 /dev/null 2024-09-16T05:06:39.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:39.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj110 /dev/null 2024-09-16T05:06:39.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:39.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj111 /dev/null 2024-09-16T05:06:39.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:39.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj112 /dev/null 2024-09-16T05:06:39.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:39.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj113 /dev/null 2024-09-16T05:06:39.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:39.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj114 /dev/null 2024-09-16T05:06:39.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:39.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj115 /dev/null 2024-09-16T05:06:40.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:40.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj116 /dev/null 2024-09-16T05:06:40.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:40.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj117 /dev/null 2024-09-16T05:06:40.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:40.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj118 /dev/null 2024-09-16T05:06:40.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:40.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj119 /dev/null 2024-09-16T05:06:40.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:40.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj120 /dev/null 2024-09-16T05:06:41.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:41.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj121 /dev/null 2024-09-16T05:06:41.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:41.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj122 /dev/null 2024-09-16T05:06:41.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:41.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj123 /dev/null 2024-09-16T05:06:41.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:41.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj124 /dev/null 2024-09-16T05:06:41.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:41.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj125 /dev/null 2024-09-16T05:06:41.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:41.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj126 /dev/null 2024-09-16T05:06:42.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:42.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj127 /dev/null 2024-09-16T05:06:42.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:42.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj128 /dev/null 2024-09-16T05:06:42.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:42.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj129 /dev/null 2024-09-16T05:06:42.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:42.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj130 /dev/null 2024-09-16T05:06:42.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:42.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj131 /dev/null 2024-09-16T05:06:42.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:42.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj132 /dev/null 2024-09-16T05:06:43.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:43.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj133 /dev/null 2024-09-16T05:06:43.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:43.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj134 /dev/null 2024-09-16T05:06:43.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:43.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj135 /dev/null 2024-09-16T05:06:43.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:43.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj136 /dev/null 2024-09-16T05:06:43.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:43.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj137 /dev/null 2024-09-16T05:06:44.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:44.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj138 /dev/null 2024-09-16T05:06:44.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:44.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj139 /dev/null 2024-09-16T05:06:44.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:44.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj140 /dev/null 2024-09-16T05:06:44.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:44.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj141 /dev/null 2024-09-16T05:06:44.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:44.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj142 /dev/null 2024-09-16T05:06:44.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:44.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj143 /dev/null 2024-09-16T05:06:45.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:45.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj144 /dev/null 2024-09-16T05:06:45.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:45.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj145 /dev/null 2024-09-16T05:06:45.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:45.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj146 /dev/null 2024-09-16T05:06:45.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:45.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj147 /dev/null 2024-09-16T05:06:45.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:45.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj148 /dev/null 2024-09-16T05:06:46.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:46.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj149 /dev/null 2024-09-16T05:06:46.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:46.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj150 /dev/null 2024-09-16T05:06:46.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:46.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj151 /dev/null 2024-09-16T05:06:46.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:46.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj152 /dev/null 2024-09-16T05:06:46.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:46.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj153 /dev/null 2024-09-16T05:06:46.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:46.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj154 /dev/null 2024-09-16T05:06:47.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:47.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj155 /dev/null 2024-09-16T05:06:47.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:47.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj156 /dev/null 2024-09-16T05:06:47.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:47.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj157 /dev/null 2024-09-16T05:06:47.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:47.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj158 /dev/null 2024-09-16T05:06:47.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:47.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj159 /dev/null 2024-09-16T05:06:48.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:48.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj160 /dev/null 2024-09-16T05:06:48.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:48.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj161 /dev/null 2024-09-16T05:06:48.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:48.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj162 /dev/null 2024-09-16T05:06:48.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:48.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj163 /dev/null 2024-09-16T05:06:48.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:48.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj164 /dev/null 2024-09-16T05:06:48.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:48.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj165 /dev/null 2024-09-16T05:06:49.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:49.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj166 /dev/null 2024-09-16T05:06:49.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:49.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj167 /dev/null 2024-09-16T05:06:49.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:49.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj168 /dev/null 2024-09-16T05:06:49.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:49.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj169 /dev/null 2024-09-16T05:06:49.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:49.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj170 /dev/null 2024-09-16T05:06:50.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:50.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj171 /dev/null 2024-09-16T05:06:50.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:50.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj172 /dev/null 2024-09-16T05:06:50.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:50.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj173 /dev/null 2024-09-16T05:06:50.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:50.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj174 /dev/null 2024-09-16T05:06:50.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:50.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj175 /dev/null 2024-09-16T05:06:50.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:50.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj176 /dev/null 2024-09-16T05:06:51.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:51.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj177 /dev/null 2024-09-16T05:06:51.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:51.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj178 /dev/null 2024-09-16T05:06:51.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:51.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj179 /dev/null 2024-09-16T05:06:51.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:51.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj180 /dev/null 2024-09-16T05:06:51.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:51.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj181 /dev/null 2024-09-16T05:06:52.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:52.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj182 /dev/null 2024-09-16T05:06:52.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:52.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj183 /dev/null 2024-09-16T05:06:52.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:52.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj184 /dev/null 2024-09-16T05:06:52.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:52.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj185 /dev/null 2024-09-16T05:06:52.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:52.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj186 /dev/null 2024-09-16T05:06:53.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:53.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj187 /dev/null 2024-09-16T05:06:53.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:53.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj188 /dev/null 2024-09-16T05:06:53.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:53.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj189 /dev/null 2024-09-16T05:06:53.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:53.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj190 /dev/null 2024-09-16T05:06:53.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:53.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj191 /dev/null 2024-09-16T05:06:54.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:54.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj192 /dev/null 2024-09-16T05:06:54.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:54.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj193 /dev/null 2024-09-16T05:06:54.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:54.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj194 /dev/null 2024-09-16T05:06:54.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:54.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj195 /dev/null 2024-09-16T05:06:54.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:54.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj196 /dev/null 2024-09-16T05:06:54.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:54.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj197 /dev/null 2024-09-16T05:06:55.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:55.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj198 /dev/null 2024-09-16T05:06:55.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:55.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj199 /dev/null 2024-09-16T05:06:55.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:636: TEST_backfill_ec_down_all_out: for i in $(seq 1 $objects) 2024-09-16T05:06:55.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:638: TEST_backfill_ec_down_all_out: rados -p test put obj200 /dev/null 2024-09-16T05:06:55.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:641: TEST_backfill_ec_down_all_out: get_pg test obj1 2024-09-16T05:06:55.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T05:06:55.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T05:06:55.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T05:06:55.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T05:06:56.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:641: TEST_backfill_ec_down_all_out: local PG=1.0 2024-09-16T05:06:56.206 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:643: TEST_backfill_ec_down_all_out: get_primary test obj1 2024-09-16T05:06:56.206 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:06:56.207 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:06:56.207 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:06:56.207 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:06:56.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:643: TEST_backfill_ec_down_all_out: local primary=1 2024-09-16T05:06:56.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:644: TEST_backfill_ec_down_all_out: get_not_primary test obj1 2024-09-16T05:06:56.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2024-09-16T05:06:56.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2024-09-16T05:06:56.650 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2024-09-16T05:06:56.650 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:06:56.650 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:06:56.650 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:06:56.651 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:06:57.092 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2024-09-16T05:06:57.092 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2024-09-16T05:06:57.092 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-09-16T05:06:57.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:644: TEST_backfill_ec_down_all_out: local otherosd=0 2024-09-16T05:06:57.499 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:645: TEST_backfill_ec_down_all_out: get_osds test obj1 2024-09-16T05:06:57.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2024-09-16T05:06:57.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj1 2024-09-16T05:06:57.500 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test obj1 2024-09-16T05:06:57.500 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2024-09-16T05:06:57.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2024-09-16T05:06:57.945 INFO:tasks.workunit.client.0.smithi026.stderr:0 2024-09-16T05:06:57.945 INFO:tasks.workunit.client.0.smithi026.stderr:2' 2024-09-16T05:06:57.945 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 2024-09-16T05:06:57.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:645: TEST_backfill_ec_down_all_out: local 'allosds=1 0 2' 2024-09-16T05:06:57.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:647: TEST_backfill_ec_down_all_out: ceph osd set nobackfill 2024-09-16T05:06:58.626 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is set 2024-09-16T05:06:58.638 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:648: TEST_backfill_ec_down_all_out: cat td/osd-backfill-stats/osd.0.pid 2024-09-16T05:06:58.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:648: TEST_backfill_ec_down_all_out: kill 511921 2024-09-16T05:06:58.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:649: TEST_backfill_ec_down_all_out: ceph osd down osd.0 2024-09-16T05:06:59.123 INFO:tasks.workunit.client.0.smithi026.stderr:osd.0 is already down. 2024-09-16T05:06:59.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:650: TEST_backfill_ec_down_all_out: for o in $allosds 2024-09-16T05:06:59.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:652: TEST_backfill_ec_down_all_out: ceph osd out osd.1 2024-09-16T05:06:59.874 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. 2024-09-16T05:06:59.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:650: TEST_backfill_ec_down_all_out: for o in $allosds 2024-09-16T05:06:59.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:652: TEST_backfill_ec_down_all_out: ceph osd out osd.0 2024-09-16T05:07:00.683 INFO:tasks.workunit.client.0.smithi026.stderr:osd.0 is already out. 2024-09-16T05:07:00.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:650: TEST_backfill_ec_down_all_out: for o in $allosds 2024-09-16T05:07:00.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:652: TEST_backfill_ec_down_all_out: ceph osd out osd.2 2024-09-16T05:07:01.520 INFO:tasks.workunit.client.0.smithi026.stderr:osd.2 is already out. 2024-09-16T05:07:01.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:655: TEST_backfill_ec_down_all_out: sleep 2 2024-09-16T05:07:03.533 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:656: TEST_backfill_ec_down_all_out: get_primary test obj1 2024-09-16T05:07:03.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:07:03.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:07:03.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:07:03.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:07:03.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:656: TEST_backfill_ec_down_all_out: primary=1 2024-09-16T05:07:03.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:657: TEST_backfill_ec_down_all_out: ceph osd unset nobackfill 2024-09-16T05:07:04.743 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is unset 2024-09-16T05:07:04.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:658: TEST_backfill_ec_down_all_out: ceph tell osd.1 get_latest_osdmap 2024-09-16T05:07:04.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:659: TEST_backfill_ec_down_all_out: ceph tell osd.1 debug kick_recovery_wq 0 2024-09-16T05:07:05.152 INFO:tasks.workunit.client.0.smithi026.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-09-16T05:07:05.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:660: TEST_backfill_ec_down_all_out: sleep 2 2024-09-16T05:07:07.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:661: TEST_backfill_ec_down_all_out: flush_pg_stats 2024-09-16T05:07:07.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:07:07.163 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:07:07.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:07:07.708 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:07:07.708 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:07:07.708 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:07:07.708 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T05:07:07.708 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T05:07:07.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:07:07.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:07:07.708 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:07:07.879 INFO:tasks.workunit.client.0.smithi026.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T05:07:07.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq= 2024-09-16T05:07:07.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z '' 2024-09-16T05:07:07.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: continue 2024-09-16T05:07:07.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:07:07.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:07:08.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673007 2024-09-16T05:07:08.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673007 2024-09-16T05:07:08.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673007' 2024-09-16T05:07:08.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:07:08.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:07:08.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509485 2024-09-16T05:07:08.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509485 2024-09-16T05:07:08.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673007 2-64424509485' 2024-09-16T05:07:08.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:07:08.245 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:07:08.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345954 2024-09-16T05:07:08.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345954 2024-09-16T05:07:08.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673007 2-64424509485 3-85899345954' 2024-09-16T05:07:08.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:07:08.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:07:08.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182426 2024-09-16T05:07:08.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182426 2024-09-16T05:07:08.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673007 2-64424509485 3-85899345954 4-107374182426' 2024-09-16T05:07:08.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:07:08.546 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T05:07:08.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018897 2024-09-16T05:07:08.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018897 2024-09-16T05:07:08.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673007 2-64424509485 3-85899345954 4-107374182426 5-128849018897' 2024-09-16T05:07:08.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:07:08.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673007 2024-09-16T05:07:08.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:07:08.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:07:08.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673007 2024-09-16T05:07:08.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:07:08.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673007 2024-09-16T05:07:08.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673007' 2024-09-16T05:07:08.670 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673007 2024-09-16T05:07:08.671 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:07:09.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673007 -lt 42949673007 2024-09-16T05:07:09.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:07:09.146 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509485 2024-09-16T05:07:09.146 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:07:09.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:07:09.147 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509485 2024-09-16T05:07:09.147 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:07:09.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509485 2024-09-16T05:07:09.148 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509485 2024-09-16T05:07:09.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509485' 2024-09-16T05:07:09.148 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:07:09.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509485 -lt 64424509485 2024-09-16T05:07:09.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:07:09.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345954 2024-09-16T05:07:09.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:07:09.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:07:09.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345954 2024-09-16T05:07:09.735 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:07:09.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345954 2024-09-16T05:07:09.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345954' 2024-09-16T05:07:09.736 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345954 2024-09-16T05:07:09.736 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:07:10.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345954 -lt 85899345954 2024-09-16T05:07:10.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:07:10.301 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182426 2024-09-16T05:07:10.301 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:07:10.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:07:10.302 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182426 2024-09-16T05:07:10.302 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:07:10.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182426 2024-09-16T05:07:10.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182426' 2024-09-16T05:07:10.304 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182426 2024-09-16T05:07:10.304 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:07:10.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182426 -lt 107374182426 2024-09-16T05:07:10.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:07:10.955 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018897 2024-09-16T05:07:10.955 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:07:10.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T05:07:10.956 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018897 2024-09-16T05:07:10.956 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:07:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018897 2024-09-16T05:07:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018897' 2024-09-16T05:07:10.958 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018897 2024-09-16T05:07:10.958 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T05:07:11.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018898 -lt 128849018897 2024-09-16T05:07:11.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:666: TEST_backfill_ec_down_all_out: true 2024-09-16T05:07:11.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:669: TEST_backfill_ec_down_all_out: ceph --format json pg dump pgs 2024-09-16T05:07:11.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:670: TEST_backfill_ec_down_all_out: jq '.pg_stats | [.[] | .state | select(. == "incomplete")] | length' 2024-09-16T05:07:12.037 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:12.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:669: TEST_backfill_ec_down_all_out: test 0 -ne 0 2024-09-16T05:07:12.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:674: TEST_backfill_ec_down_all_out: break 2024-09-16T05:07:12.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:676: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:12.438 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T05:07:12.439 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 200 0 170 340 0 0 0 0 100 100 100 active+undersized+degraded+remapped+backfilling 2024-09-16T05:07:02.505898+0000 38'200 50:377 [4,3,5] 4 [1,NONE,2] 1 0'0 2024-09-16T05:06:10.828002+0000 0'0 2024-09-16T05:06:10.828002+0000 0 0 no scrub is scheduled 0 0 2024-09-16T05:07:12.439 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T05:07:12.439 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T05:07:12.439 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:12.450 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: seq 1 240 2024-09-16T05:07:12.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:12.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:12.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:12.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:12.916 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:12.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 1 = 240 ']' 2024-09-16T05:07:12.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:13.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:13.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:13.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:13.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:14.326 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:14.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 2 = 240 ']' 2024-09-16T05:07:14.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:15.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:15.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:15.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:15.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:15.854 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:15.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 3 = 240 ']' 2024-09-16T05:07:15.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:16.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:16.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:16.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:16.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:17.268 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:17.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 4 = 240 ']' 2024-09-16T05:07:17.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:18.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:18.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:18.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:18.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:18.686 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:18.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 5 = 240 ']' 2024-09-16T05:07:18.698 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:19.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:19.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:19.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:19.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:20.098 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:20.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 6 = 240 ']' 2024-09-16T05:07:20.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:21.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:21.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:21.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:21.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:21.512 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:21.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 7 = 240 ']' 2024-09-16T05:07:21.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:22.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:22.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:22.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:22.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:22.950 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:22.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 8 = 240 ']' 2024-09-16T05:07:22.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:23.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:23.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:23.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:23.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:24.361 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:24.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 9 = 240 ']' 2024-09-16T05:07:24.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:25.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:25.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:25.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:25.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:25.861 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:25.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 10 = 240 ']' 2024-09-16T05:07:25.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:26.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:26.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:26.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:26.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:27.270 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:27.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 11 = 240 ']' 2024-09-16T05:07:27.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:28.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:28.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:28.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:28.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:28.680 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:28.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 12 = 240 ']' 2024-09-16T05:07:28.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:29.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:29.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:29.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:29.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:30.089 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:30.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 13 = 240 ']' 2024-09-16T05:07:30.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:31.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:31.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:31.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:31.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:31.502 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:31.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 14 = 240 ']' 2024-09-16T05:07:31.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:32.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:32.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:32.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:32.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:32.913 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:32.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 15 = 240 ']' 2024-09-16T05:07:32.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:33.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:33.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:33.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:33.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:34.324 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:34.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 16 = 240 ']' 2024-09-16T05:07:34.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:35.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:35.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:35.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:35.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:35.838 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:35.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 17 = 240 ']' 2024-09-16T05:07:35.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:36.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:36.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:36.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:36.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:37.400 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:37.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 18 = 240 ']' 2024-09-16T05:07:37.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:38.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:38.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:38.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:38.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:38.935 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:38.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 19 = 240 ']' 2024-09-16T05:07:38.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:39.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:39.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:39.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:39.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:40.347 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:40.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 20 = 240 ']' 2024-09-16T05:07:40.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:41.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:41.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:41.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:41.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:41.761 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:41.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 21 = 240 ']' 2024-09-16T05:07:41.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:42.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:42.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:42.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:42.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:43.174 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:43.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 22 = 240 ']' 2024-09-16T05:07:43.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:44.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:44.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:44.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:44.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:44.583 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:44.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 23 = 240 ']' 2024-09-16T05:07:44.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:45.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:45.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:45.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:45.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:45.993 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:46.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 24 = 240 ']' 2024-09-16T05:07:46.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:47.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:47.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:47.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:47.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:47.403 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:47.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 25 = 240 ']' 2024-09-16T05:07:47.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:48.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:48.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:48.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:48.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:48.877 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:48.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 26 = 240 ']' 2024-09-16T05:07:48.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:49.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:49.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:49.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:49.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:50.284 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:50.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 27 = 240 ']' 2024-09-16T05:07:50.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:51.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:51.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:51.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:51.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:51.731 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:51.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 28 = 240 ']' 2024-09-16T05:07:51.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:52.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:52.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:52.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:52.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:53.144 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:53.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:683: TEST_backfill_ec_down_all_out: '[' 29 = 240 ']' 2024-09-16T05:07:53.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:688: TEST_backfill_ec_down_all_out: sleep 1 2024-09-16T05:07:54.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:677: TEST_backfill_ec_down_all_out: for i in $(seq 1 240) 2024-09-16T05:07:54.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:54.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep '^1.0' 2024-09-16T05:07:54.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:679: TEST_backfill_ec_down_all_out: grep -qv backfilling 2024-09-16T05:07:54.557 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:54.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:681: TEST_backfill_ec_down_all_out: break 2024-09-16T05:07:54.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:691: TEST_backfill_ec_down_all_out: ceph pg dump pgs 2024-09-16T05:07:54.957 INFO:tasks.workunit.client.0.smithi026.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2024-09-16T05:07:54.957 INFO:tasks.workunit.client.0.smithi026.stdout:1.0 200 0 0 0 0 0 0 0 10 190 10 active+clean 2024-09-16T05:07:48.610823+0000 38'200 52:1066 [4,3,5] 4 [4,3,5] 4 0'0 2024-09-16T05:06:10.828002+0000 0'0 2024-09-16T05:06:10.828002+0000 0 0 periodic scrub scheduled @ 2024-09-17T13:47:30.508827+0000 0 0 2024-09-16T05:07:54.957 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-09-16T05:07:54.957 INFO:tasks.workunit.client.0.smithi026.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2024-09-16T05:07:54.958 INFO:tasks.workunit.client.0.smithi026.stderr:dumped pgs 2024-09-16T05:07:54.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:693: TEST_backfill_ec_down_all_out: expr 200 '*' 2 2024-09-16T05:07:54.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:693: TEST_backfill_ec_down_all_out: local misplaced=400 2024-09-16T05:07:54.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:694: TEST_backfill_ec_down_all_out: check td/osd-backfill-stats 1.0 1 erasure 200 0 400 0 2024-09-16T05:07:54.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-09-16T05:07:54.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-09-16T05:07:54.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-09-16T05:07:54.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=erasure 2024-09-16T05:07:54.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=200 2024-09-16T05:07:54.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-09-16T05:07:54.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=400 2024-09-16T05:07:54.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-09-16T05:07:54.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-09-16T05:07:54.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-09-16T05:07:54.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-09-16T05:07:54.972 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-09-16T05:07:54.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-09-16T05:07:54.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-09-16T05:07:54.977 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-09-16T05:07:54.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-09-16T05:07:54.996 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-09-16T05:07:54.996 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-09-16T05:07:54.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-09-16T05:07:54.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-09-16T05:07:54.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' erasure = erasure ']' 2024-09-16T05:07:54.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:89: check: addp=p 2024-09-16T05:07:54.998 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-09-16T05:07:54.998 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:07:54.998 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-09-16T05:07:54.998 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-09-16T05:07:55.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[4,3,5]/[1,NONE,2]' 2024-09-16T05:07:55.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[4,3,5]/[1,NONE,2]' ']' 2024-09-16T05:07:55.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-09-16T05:07:55.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:07:55.030 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:07:55.030 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [4,3,5]/[1,NONE,2]p' 2024-09-16T05:07:55.030 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-09-16T05:07:55.030 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-09-16T05:07:55.030 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:07:55.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=200 2024-09-16T05:07:55.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 200 ']' 2024-09-16T05:07:55.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 200 200 2024-09-16T05:07:55.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-09-16T05:07:55.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:07:55.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-09-16T05:07:55.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:07:55.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:07:55.038 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:07:55.038 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-09-16T05:07:55.038 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:07:55.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=1 2024-09-16T05:07:55.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 1 ']' 2024-09-16T05:07:55.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 1 0 2024-09-16T05:07:55.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-09-16T05:07:55.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:07:55.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:07:55.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:07:55.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-09-16T05:07:55.053 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:07:55.053 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:07:55.053 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [4,3,5]/[1,NONE,2]p' 2024-09-16T05:07:55.053 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-09-16T05:07:55.053 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-09-16T05:07:55.053 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:07:55.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=400 2024-09-16T05:07:55.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 400 ']' 2024-09-16T05:07:55.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 400 400 2024-09-16T05:07:55.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-09-16T05:07:55.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:07:55.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-09-16T05:07:55.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:07:55.060 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:07:55.060 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:07:55.061 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-09-16T05:07:55.061 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:07:55.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=2 2024-09-16T05:07:55.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 2 ']' 2024-09-16T05:07:55.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 2 0 2024-09-16T05:07:55.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=2 2024-09-16T05:07:55.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:07:55.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:07:55.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:07:55.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-09-16T05:07:55.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:696: TEST_backfill_ec_down_all_out: delete_pool test 2024-09-16T05:07:55.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T05:07:55.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T05:07:55.588 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T05:07:55.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:697: TEST_backfill_ec_down_all_out: kill_daemons td/osd-backfill-stats 2024-09-16T05:07:55.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:07:55.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:07:55.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:07:55.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:07:55.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:08:00.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:08:00.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-09-16T05:08:00.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:08:00.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:08:00.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:08:00.918 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:08:00.919 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:08:00.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:08:00.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:08:00.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:08:00.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:08:00.928 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:08:00.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:08:00.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:08:00.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:08:00.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:08:00.931 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:08:00.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:08:00.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:08:00.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:08:00.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:08:00.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:08:00.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:08:00.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:08:00.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:08:00.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:08:00.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:08:00.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:08:00.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:08:00.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:08:00.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-09-16T05:08:00.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-09-16T05:08:00.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-stats 2024-09-16T05:08:00.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-stats 2024-09-16T05:08:00.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:08:00.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:08:00.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:08:00.983 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:08:00.984 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:08:00.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:08:00.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:08:00.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:08:00.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:08:00.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:08:00.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:08:00.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:08:00.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:08:00.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:08:00.986 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:08:00.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:08:00.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:08:00.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:08:00.988 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:08:00.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:08:00.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:08:00.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:08:00.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:08:00.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:08:00.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:08:00.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:08:00.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:08:00.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:08:00.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-stats 2024-09-16T05:08:00.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T05:08:00.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:08:00.995 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:08:00.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.478321 2024-09-16T05:08:00.998 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T05:08:00.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T05:08:00.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T05:08:00.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-09-16T05:08:00.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_ec_down_out td/osd-backfill-stats 2024-09-16T05:08:00.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:708: TEST_backfill_ec_down_out: local dir=td/osd-backfill-stats 2024-09-16T05:08:00.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:710: TEST_backfill_ec_down_out: run_mon td/osd-backfill-stats a 2024-09-16T05:08:00.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-stats 2024-09-16T05:08:00.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T05:08:00.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T05:08:00.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T05:08:00.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-stats/a 2024-09-16T05:08:00.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-09-16T05:08:01.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T05:08:01.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:08:01.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:08:01.449 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:08:01.449 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:08:01.449 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:08:01.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:08:01.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T05:08:01.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T05:08:01.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T05:08:01.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:08:01.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:08:01.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T05:08:01.635 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T05:08:01.636 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:08:01.636 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:08:01.636 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:08:01.636 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:08:01.636 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:08:01.636 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:08:01.636 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:08:01.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:08:01.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get fsid 2024-09-16T05:08:01.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T05:08:01.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:08:01.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:08:01.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T05:08:01.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T05:08:01.727 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:08:01.727 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:08:01.727 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:08:01.727 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:08:01.728 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:08:01.728 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:08:01.728 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:08:01.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:08:01.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get mon_host 2024-09-16T05:08:01.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:711: TEST_backfill_ec_down_out: run_mgr td/osd-backfill-stats x 2024-09-16T05:08:01.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-stats 2024-09-16T05:08:01.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T05:08:01.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T05:08:01.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T05:08:01.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-stats/x 2024-09-16T05:08:01.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T05:08:02.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T05:08:02.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:08:02.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:08:02.675 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:08:02.675 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:08:02.676 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:08:02.676 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:08:02.676 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:08:02.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:08:02.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:712: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 0 2024-09-16T05:08:02.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:08:02.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:08:02.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T05:08:02.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:08:02.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/0 2024-09-16T05:08:02.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:08:02.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:08:02.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:08:02.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:08:02.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-09-16T05:08:02.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-09-16T05:08:02.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:08:02.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:08:02.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:08:02.716 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:08:02.716 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:08:02.716 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:08:02.716 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:08:02.716 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:08:02.717 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:08:02.717 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:08:02.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:08:02.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:08:02.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:08:02.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:08:02.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:08:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:08:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:08:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:08:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:08:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:08:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:08:02.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:08:02.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/0 2024-09-16T05:08:02.719 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:08:02.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0d925b3f-1298-4049-9943-4e59307001dc 2024-09-16T05:08:02.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 0d925b3f-1298-4049-9943-4e59307001dc' 2024-09-16T05:08:02.720 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 0d925b3f-1298-4049-9943-4e59307001dc 2024-09-16T05:08:02.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:08:02.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAyvedmgAOEKxAAIv1r5US/eEHYptP6WOAspA== 2024-09-16T05:08:02.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAyvedmgAOEKxAAIv1r5US/eEHYptP6WOAspA=="}' 2024-09-16T05:08:02.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0d925b3f-1298-4049-9943-4e59307001dc -i td/osd-backfill-stats/0/new.json 2024-09-16T05:08:02.999 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:08:03.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/0/new.json 2024-09-16T05:08:03.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAyvedmgAOEKxAAIv1r5US/eEHYptP6WOAspA== --osd-uuid 0d925b3f-1298-4049-9943-4e59307001dc 2024-09-16T05:08:03.042 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:03.041+0000 7fdc86717640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:08:03.068 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:03.067+0000 7fdc86717640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:08:03.069 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:03.068+0000 7fdc86717640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:08:03.069 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:03.069+0000 7fdc86717640 -1 bdev(0x56025e3e7c00 td/osd-backfill-stats/0/block) open stat got: (1) Operation not permitted 2024-09-16T05:08:03.069 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:03.069+0000 7fdc86717640 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-09-16T05:08:08.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-09-16T05:08:08.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:08:08.781 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T05:08:08.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T05:08:08.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:08:09.350 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T05:08:09.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T05:08:09.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:08:09.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:08:09.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:08:09.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:08:09.381 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:09.380+0000 7fd725611640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:08:09.383 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:09.382+0000 7fd725611640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:08:09.384 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:09.383+0000 7fd725611640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:08:09.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T05:08:09.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:08:09.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T05:08:09.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:08:09.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:08:09.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:09.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:08:09.786 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:08:09.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:09.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:10.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:10.470 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:10.469+0000 7fd725611640 -1 Falling back to public interface 2024-09-16T05:08:11.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:11.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:11.221 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:08:11.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:08:11.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:11.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:12.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:12.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:12.672 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:08:12.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:08:12.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:12.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:13.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:13.123 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:13.122+0000 7fd725611640 -1 osd.0 0 log_to_monitors true 2024-09-16T05:08:14.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:14.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:14.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:08:14.089 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:08:14.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:14.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:14.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:15.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:15.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:15.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:08:15.514 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:08:15.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:15.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:16.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:17.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:17.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:17.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:08:17.019 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:08:17.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:17.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:17.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:18.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:18.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:18.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:08:18.451 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:08:18.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:18.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:18.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:19.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:19.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:19.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:08:19.891 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:08:19.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:19.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:20.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:21.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:21.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:21.321 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:08:21.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:08:21.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:21.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:21.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:22.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:22.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:22.848 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:08:22.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:08:22.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:22.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:23.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:24.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:24.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:24.265 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:08:24.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:08:24.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:24.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:24.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:25.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:25.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:25.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:08:25.689 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:08:25.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:25.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:26.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:27.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:27.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:27.239 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:08:27.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:08:27.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:27.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:27.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:28.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:28.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:28.926 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:08:28.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:08:28.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:28.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:29.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:30.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:30.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:30.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:08:30.439 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:08:30.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:30.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:31.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:32.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:32.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:32.151 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:08:32.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:08:32.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:32.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:32.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:33.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:33.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:33.903 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:08:33.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:08:33.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:33.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:34.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:35.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:35.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:35.648 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:08:35.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:08:35.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:35.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:08:36.102 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3080334334,v1:127.0.0.1:6803/3080334334] [v2:127.0.0.1:6804/3080334334,v1:127.0.0.1:6805/3080334334] exists,up 0d925b3f-1298-4049-9943-4e59307001dc 2024-09-16T05:08:36.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:08:36.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:08:36.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:08:36.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:713: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 1 2024-09-16T05:08:36.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:08:36.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:08:36.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T05:08:36.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:08:36.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/1 2024-09-16T05:08:36.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:08:36.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:08:36.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:08:36.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:08:36.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-09-16T05:08:36.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-09-16T05:08:36.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:08:36.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:08:36.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:08:36.108 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:08:36.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:08:36.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:08:36.109 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:08:36.109 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:08:36.109 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:08:36.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:08:36.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:08:36.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:08:36.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:08:36.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:08:36.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:08:36.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:08:36.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:08:36.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:08:36.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:08:36.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:08:36.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:08:36.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:08:36.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/1 2024-09-16T05:08:36.110 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:08:36.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3589dadd-55ee-4fe0-9237-07a78b20c5c3 2024-09-16T05:08:36.111 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 3589dadd-55ee-4fe0-9237-07a78b20c5c3 2024-09-16T05:08:36.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 3589dadd-55ee-4fe0-9237-07a78b20c5c3' 2024-09-16T05:08:36.111 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:08:36.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBUvedm+/JyBxAAMhGhmKu4UgqCe5kovR1iqw== 2024-09-16T05:08:36.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBUvedm+/JyBxAAMhGhmKu4UgqCe5kovR1iqw=="}' 2024-09-16T05:08:36.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3589dadd-55ee-4fe0-9237-07a78b20c5c3 -i td/osd-backfill-stats/1/new.json 2024-09-16T05:08:36.760 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:08:36.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/1/new.json 2024-09-16T05:08:36.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBUvedm+/JyBxAAMhGhmKu4UgqCe5kovR1iqw== --osd-uuid 3589dadd-55ee-4fe0-9237-07a78b20c5c3 2024-09-16T05:08:36.803 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:36.802+0000 7fb3c4e0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:08:36.805 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:36.804+0000 7fb3c4e0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:08:36.806 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:36.805+0000 7fb3c4e0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:08:36.806 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:36.806+0000 7fb3c4e0d640 -1 bdev(0x562b12789c00 td/osd-backfill-stats/1/block) open stat got: (1) Operation not permitted 2024-09-16T05:08:36.806 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:36.806+0000 7fb3c4e0d640 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-09-16T05:08:42.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-09-16T05:08:42.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:08:42.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T05:08:42.785 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T05:08:42.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:08:43.366 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T05:08:43.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T05:08:43.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:08:43.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:08:43.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:08:43.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:08:43.396 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:43.395+0000 7f62b3e16640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:08:43.398 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:43.397+0000 7f62b3e16640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:08:43.399 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:43.398+0000 7f62b3e16640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:08:43.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T05:08:43.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:08:43.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T05:08:43.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:08:43.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:08:43.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:43.847 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:08:43.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:08:43.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:43.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:08:44.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:44.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:44.493+0000 7f62b3e16640 -1 Falling back to public interface 2024-09-16T05:08:45.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:45.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:45.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:08:45.281 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:08:45.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:45.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:08:45.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:46.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:46.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:46.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:08:46.723 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:08:46.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:46.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:08:47.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:47.551 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:08:47.551+0000 7f62b3e16640 -1 osd.1 0 log_to_monitors true 2024-09-16T05:08:48.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:48.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:48.142 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:08:48.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:08:48.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:48.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:08:48.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:49.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:49.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:49.684 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:08:49.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:08:49.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:49.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:08:50.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:51.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:51.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:51.179 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:08:51.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:08:51.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:51.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:08:51.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:52.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:52.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:52.638 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:08:52.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:08:52.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:52.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:08:53.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:54.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:54.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:54.091 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:08:54.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:08:54.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:54.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:08:54.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:55.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:55.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:55.548 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:08:55.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:08:55.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:55.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:08:56.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:57.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:57.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:57.007 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:08:57.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:08:57.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:57.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:08:57.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:58.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:58.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:58.493 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:08:58.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:08:58.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:58.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:08:58.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:08:59.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:08:59.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:08:59.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:08:59.913 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:08:59.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:08:59.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:09:00.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:01.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:01.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:01.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:09:01.746 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:09:01.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:01.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:09:02.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:03.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:03.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:03.541 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:09:03.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:09:03.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:03.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:09:04.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:05.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:05.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:05.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:09:05.471 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:09:05.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:05.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:09:06.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:07.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:07.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:07.165 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:09:07.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:09:07.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:07.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:09:07.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:08.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:08.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:08.910 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:09:08.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:09:08.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:08.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:09:09.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:10.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:10.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:10.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:09:10.945 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:09:10.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:10.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:09:11.359 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/603884276,v1:127.0.0.1:6811/603884276] [v2:127.0.0.1:6812/603884276,v1:127.0.0.1:6813/603884276] exists,up 3589dadd-55ee-4fe0-9237-07a78b20c5c3 2024-09-16T05:09:11.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:714: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 2 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/2 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:09:11.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:09:11.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:09:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:09:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:09:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:09:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:09:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:09:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:09:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:09:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:09:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:09:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/2 2024-09-16T05:09:11.365 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:09:11.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=06d1bbbd-5025-4471-8ab1-e24828272d67 2024-09-16T05:09:11.366 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 06d1bbbd-5025-4471-8ab1-e24828272d67 2024-09-16T05:09:11.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 06d1bbbd-5025-4471-8ab1-e24828272d67' 2024-09-16T05:09:11.366 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:09:11.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB3vedmx37FFhAA8cgPxw5BQr0YT70WtRRw1g== 2024-09-16T05:09:11.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB3vedmx37FFhAA8cgPxw5BQr0YT70WtRRw1g=="}' 2024-09-16T05:09:11.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 06d1bbbd-5025-4471-8ab1-e24828272d67 -i td/osd-backfill-stats/2/new.json 2024-09-16T05:09:11.857 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:09:11.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/2/new.json 2024-09-16T05:09:11.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB3vedmx37FFhAA8cgPxw5BQr0YT70WtRRw1g== --osd-uuid 06d1bbbd-5025-4471-8ab1-e24828272d67 2024-09-16T05:09:11.901 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:11.900+0000 7f6c2920d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:09:11.902 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:11.902+0000 7f6c2920d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:09:11.903 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:11.903+0000 7f6c2920d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:09:11.904 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:11.903+0000 7f6c2920d640 -1 bdev(0x56479248bc00 td/osd-backfill-stats/2/block) open stat got: (1) Operation not permitted 2024-09-16T05:09:11.904 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:11.903+0000 7f6c2920d640 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-09-16T05:09:17.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-09-16T05:09:17.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:09:17.594 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T05:09:17.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T05:09:17.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:09:18.156 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T05:09:18.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T05:09:18.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:09:18.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:09:18.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:09:18.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:09:18.185 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:18.184+0000 7f5a89413640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:09:18.194 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:18.193+0000 7f5a89413640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:09:18.195 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:18.194+0000 7f5a89413640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:09:18.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T05:09:18.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:09:18.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T05:09:18.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:09:18.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:09:18.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:18.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:09:18.617 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:09:18.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:18.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:19.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:19.288 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:19.287+0000 7f5a89413640 -1 Falling back to public interface 2024-09-16T05:09:20.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:20.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:20.036 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:09:20.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:09:20.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:20.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:20.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:21.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:21.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:21.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:09:21.488 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:09:21.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:21.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:21.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:22.031 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:22.029+0000 7f5a89413640 -1 osd.2 0 log_to_monitors true 2024-09-16T05:09:22.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:22.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:22.957 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:09:22.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:09:22.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:22.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:23.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:24.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:24.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:24.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:09:24.424 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:09:24.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:24.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:24.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:25.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:25.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:25.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:09:25.983 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:09:25.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:25.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:26.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:27.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:27.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:27.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:09:27.403 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:09:27.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:27.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:27.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:28.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:28.841 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:09:28.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:09:28.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:28.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:29.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:30.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:30.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:30.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:09:30.274 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:09:30.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:30.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:30.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:31.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:31.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:31.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:09:31.688 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:09:31.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:31.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:32.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:33.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:33.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:33.308 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:09:33.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:09:33.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:33.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:33.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:34.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:34.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:34.876 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:09:34.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:09:34.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:34.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:35.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:36.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:36.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:36.671 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:09:36.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:09:36.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:36.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:37.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:38.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:38.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:38.377 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:09:38.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:09:38.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:38.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:39.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:40.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:40.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:40.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:09:40.144 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:09:40.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:40.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:40.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:41.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:41.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:41.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:09:41.813 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:09:41.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:41.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:42.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:43.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:43.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:43.876 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:09:43.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:09:43.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:43.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:44.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:45.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:45.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:45.635 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:09:45.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:09:45.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:45.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:09:46.049 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3893459182,v1:127.0.0.1:6819/3893459182] [v2:127.0.0.1:6820/3893459182,v1:127.0.0.1:6821/3893459182] exists,up 06d1bbbd-5025-4471-8ab1-e24828272d67 2024-09-16T05:09:46.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:09:46.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:09:46.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:09:46.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:715: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 3 2024-09-16T05:09:46.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:09:46.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:09:46.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T05:09:46.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:09:46.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/3 2024-09-16T05:09:46.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:09:46.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:09:46.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:09:46.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:09:46.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-09-16T05:09:46.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-09-16T05:09:46.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:09:46.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:09:46.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:09:46.054 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:09:46.054 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:09:46.054 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:09:46.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:09:46.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:09:46.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:09:46.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:09:46.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/3 2024-09-16T05:09:46.056 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:09:46.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cc92b6b8-3ed8-4b42-890e-ecbaa6545158 2024-09-16T05:09:46.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 cc92b6b8-3ed8-4b42-890e-ecbaa6545158' 2024-09-16T05:09:46.056 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 cc92b6b8-3ed8-4b42-890e-ecbaa6545158 2024-09-16T05:09:46.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:09:46.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCavedmXSFLBBAAJKAYnYRe4xwtjxaay++EoQ== 2024-09-16T05:09:46.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCavedmXSFLBBAAJKAYnYRe4xwtjxaay++EoQ=="}' 2024-09-16T05:09:46.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cc92b6b8-3ed8-4b42-890e-ecbaa6545158 -i td/osd-backfill-stats/3/new.json 2024-09-16T05:09:46.621 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:09:46.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/3/new.json 2024-09-16T05:09:46.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCavedmXSFLBBAAJKAYnYRe4xwtjxaay++EoQ== --osd-uuid cc92b6b8-3ed8-4b42-890e-ecbaa6545158 2024-09-16T05:09:46.665 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:46.664+0000 7f230641e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:09:46.667 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:46.666+0000 7f230641e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:09:46.668 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:46.667+0000 7f230641e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:09:46.668 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:46.668+0000 7f230641e640 -1 bdev(0x564b75fe5c00 td/osd-backfill-stats/3/block) open stat got: (1) Operation not permitted 2024-09-16T05:09:46.669 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:46.668+0000 7f230641e640 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-09-16T05:09:52.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-09-16T05:09:52.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:09:52.918 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T05:09:52.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T05:09:52.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:09:53.481 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T05:09:53.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T05:09:53.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:09:53.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:09:53.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:09:53.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:09:53.511 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:53.510+0000 7f3feec0b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:09:53.546 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:53.545+0000 7f3feec0b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:09:53.547 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:53.546+0000 7f3feec0b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:09:53.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T05:09:53.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:09:53.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T05:09:53.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:09:53.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:09:53.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:53.888 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:09:53.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:09:53.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:53.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:09:54.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:54.870 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:54.869+0000 7f3feec0b640 -1 Falling back to public interface 2024-09-16T05:09:55.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:55.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:55.329 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:09:55.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:09:55.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:55.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:09:55.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:56.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:56.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:56.763 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:09:56.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:09:56.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:56.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:09:57.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:57.701 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:09:57.699+0000 7f3feec0b640 -1 osd.3 0 log_to_monitors true 2024-09-16T05:09:58.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:58.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:58.182 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:09:58.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:09:58.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:58.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:09:58.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:09:59.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:09:59.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:09:59.805 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:09:59.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:09:59.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:09:59.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:00.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:01.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:01.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:01.280 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:10:01.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:10:01.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:01.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:01.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:02.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:10:02.719 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:10:02.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:02.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:03.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:04.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:04.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:04.137 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:10:04.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:10:04.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:04.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:04.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:05.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:05.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:05.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:10:05.633 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:10:05.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:05.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:06.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:07.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:07.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:07.164 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:10:07.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:10:07.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:07.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:07.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:08.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:08.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:08.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:10:08.646 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:10:08.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:08.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:09.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:10.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:10.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:10.093 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:10:10.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:10:10.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:10.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:10.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:11.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:11.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:11.895 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:10:11.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:10:11.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:11.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:12.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:13.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:13.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:13.529 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:10:13.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:10:13.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:13.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:14.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:15.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:15.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:15.352 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:10:15.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:10:15.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:15.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:16.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:17.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:17.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:17.176 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:10:17.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:10:17.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:17.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:17.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:18.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:18.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:18.843 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:10:18.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:10:18.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:18.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:19.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:20.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:20.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:20.305 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:10:20.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:10:20.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:20.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:21.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:22.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:22.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:22.026 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T05:10:22.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T05:10:22.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:22.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:10:22.474 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2917384216,v1:127.0.0.1:6827/2917384216] [v2:127.0.0.1:6828/2917384216,v1:127.0.0.1:6829/2917384216] exists,up cc92b6b8-3ed8-4b42-890e-ecbaa6545158 2024-09-16T05:10:22.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:10:22.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:10:22.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:10:22.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:716: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 4 2024-09-16T05:10:22.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:10:22.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:10:22.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T05:10:22.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:10:22.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/4 2024-09-16T05:10:22.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:10:22.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:10:22.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:10:22.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:10:22.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-09-16T05:10:22.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-09-16T05:10:22.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:10:22.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:10:22.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:10:22.479 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:10:22.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:10:22.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:10:22.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:10:22.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:10:22.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:10:22.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:10:22.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/4 2024-09-16T05:10:22.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:10:22.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=aa242d56-fc8a-45c6-a233-a58d37dac978 2024-09-16T05:10:22.481 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 aa242d56-fc8a-45c6-a233-a58d37dac978 2024-09-16T05:10:22.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 aa242d56-fc8a-45c6-a233-a58d37dac978' 2024-09-16T05:10:22.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:10:22.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC+vedmlLSmHRAAF4nUJpCPwqB4GtdI+vpBhA== 2024-09-16T05:10:22.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC+vedmlLSmHRAAF4nUJpCPwqB4GtdI+vpBhA=="}' 2024-09-16T05:10:22.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new aa242d56-fc8a-45c6-a233-a58d37dac978 -i td/osd-backfill-stats/4/new.json 2024-09-16T05:10:23.038 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:10:23.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/4/new.json 2024-09-16T05:10:23.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC+vedmlLSmHRAAF4nUJpCPwqB4GtdI+vpBhA== --osd-uuid aa242d56-fc8a-45c6-a233-a58d37dac978 2024-09-16T05:10:23.082 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:23.081+0000 7f91341c1640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:10:23.097 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:23.097+0000 7f91341c1640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:10:23.098 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:23.098+0000 7f91341c1640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:10:23.099 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:23.098+0000 7f91341c1640 -1 bdev(0x557fb167dc00 td/osd-backfill-stats/4/block) open stat got: (1) Operation not permitted 2024-09-16T05:10:23.099 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:23.098+0000 7f91341c1640 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-09-16T05:10:29.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-09-16T05:10:29.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:10:29.216 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T05:10:29.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T05:10:29.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:10:29.788 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T05:10:29.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T05:10:29.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:10:29.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:10:29.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:10:29.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:10:29.818 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:29.816+0000 7f61cd21e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:10:29.820 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:29.818+0000 7f61cd21e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:10:29.821 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:29.820+0000 7f61cd21e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:10:30.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T05:10:30.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:10:30.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T05:10:30.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:10:30.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:10:30.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:30.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:10:30.229 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:10:30.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:30.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:30.653 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:30.651+0000 7f61cd21e640 -1 Falling back to public interface 2024-09-16T05:10:30.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:31.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:31.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:31.672 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:10:31.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:10:31.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:31.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:32.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:33.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:33.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:33.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:10:33.123 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:10:33.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:33.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:33.340 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:33.338+0000 7f61cd21e640 -1 osd.4 0 log_to_monitors true 2024-09-16T05:10:33.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:34.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:34.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:34.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:10:34.564 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:10:34.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:34.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:34.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:35.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:35.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:35.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:10:35.980 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:10:35.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:35.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:36.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:37.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:37.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:37.500 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:10:37.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:10:37.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:37.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:38.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:39.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:39.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:39.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:10:39.087 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:10:39.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:39.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:39.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:40.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:40.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:40.562 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:10:40.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:10:40.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:40.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:40.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:41.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:41.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:41.982 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:10:41.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:10:41.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:41.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:42.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:43.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:43.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:43.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:10:43.525 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:10:43.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:43.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:44.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:45.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:45.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:45.048 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:10:45.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:10:45.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:45.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:45.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:46.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:46.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:46.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:10:46.722 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:10:46.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:46.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:47.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:48.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:48.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:48.961 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:10:48.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:10:48.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:48.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:49.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:50.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:50.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:50.851 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:10:50.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:10:50.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:50.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:51.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:52.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:52.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:52.673 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:10:52.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:10:52.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:52.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:53.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:54.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:54.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:54.301 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:10:54.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:10:54.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:54.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:55.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:10:56.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:10:56.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:10:56.422 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:10:56.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:10:56.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:10:56.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:10:56.967 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/4175385020,v1:127.0.0.1:6835/4175385020] [v2:127.0.0.1:6836/4175385020,v1:127.0.0.1:6837/4175385020] exists,up aa242d56-fc8a-45c6-a233-a58d37dac978 2024-09-16T05:10:56.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:10:56.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:10:56.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:10:56.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:717: TEST_backfill_ec_down_out: run_osd td/osd-backfill-stats 5 2024-09-16T05:10:56.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:10:56.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:10:56.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T05:10:56.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:10:56.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/5 2024-09-16T05:10:56.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:10:56.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:10:56.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:10:56.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:10:56.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-09-16T05:10:56.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-09-16T05:10:56.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:10:56.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:10:56.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:10:56.977 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:10:56.977 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:10:56.977 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:10:56.977 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:10:56.977 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:10:56.978 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:10:56.978 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:10:56.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:10:56.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:10:56.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:10:56.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:10:56.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:10:56.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:10:56.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:10:56.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:10:56.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:10:56.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:10:56.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:10:56.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:10:56.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/5 2024-09-16T05:10:56.981 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:10:56.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9d20eb46-d8dd-4dfb-ad1f-b255df1f9d8c 2024-09-16T05:10:56.981 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 9d20eb46-d8dd-4dfb-ad1f-b255df1f9d8c 2024-09-16T05:10:56.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 9d20eb46-d8dd-4dfb-ad1f-b255df1f9d8c' 2024-09-16T05:10:56.982 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:10:56.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDgvedmWdoNOxAAK8yzjZPJ6sv7I3L7iKKfNg== 2024-09-16T05:10:56.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDgvedmWdoNOxAAK8yzjZPJ6sv7I3L7iKKfNg=="}' 2024-09-16T05:10:56.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9d20eb46-d8dd-4dfb-ad1f-b255df1f9d8c -i td/osd-backfill-stats/5/new.json 2024-09-16T05:10:57.493 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:10:57.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/5/new.json 2024-09-16T05:10:57.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDgvedmWdoNOxAAK8yzjZPJ6sv7I3L7iKKfNg== --osd-uuid 9d20eb46-d8dd-4dfb-ad1f-b255df1f9d8c 2024-09-16T05:10:57.537 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:57.536+0000 7f39e3c26640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:10:57.539 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:57.538+0000 7f39e3c26640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:10:57.540 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:57.539+0000 7f39e3c26640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:10:57.541 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:57.540+0000 7f39e3c26640 -1 bdev(0x5583447cdc00 td/osd-backfill-stats/5/block) open stat got: (1) Operation not permitted 2024-09-16T05:10:57.541 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:10:57.540+0000 7f39e3c26640 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-09-16T05:11:03.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-09-16T05:11:03.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:11:03.234 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T05:11:03.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T05:11:03.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:11:03.806 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T05:11:03.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T05:11:03.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:11:03.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:11:03.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:11:03.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:11:03.836 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:11:03.835+0000 7fbf7ea0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:11:03.842 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:11:03.842+0000 7fbf7ea0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:11:03.844 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:11:03.843+0000 7fbf7ea0f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:11:04.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T05:11:04.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:11:04.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T05:11:04.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:11:04.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:11:04.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:04.267 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:11:04.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:11:04.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:04.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:04.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:04.938 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:11:04.937+0000 7fbf7ea0f640 -1 Falling back to public interface 2024-09-16T05:11:05.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:05.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:05.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:11:05.701 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:11:05.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:05.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:06.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:07.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:07.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:07.179 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:11:07.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:11:07.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:07.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:07.597 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:11:07.596+0000 7fbf7ea0f640 -1 osd.5 0 log_to_monitors true 2024-09-16T05:11:07.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:08.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:08.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:08.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:11:08.605 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:11:08.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:08.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:09.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:10.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:10.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:10.021 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:11:10.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:11:10.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:10.022 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:10.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:11.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:11.521 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:11:11.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:11.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:11:11.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:11.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:12.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:13.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:13.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:13.047 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:11:13.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:11:13.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:13.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:13.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:14.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:14.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:14.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:11:14.519 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:11:14.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:14.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:14.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:15.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:15.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:15.940 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:11:15.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:11:15.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:15.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:16.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:17.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:17.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:11:17.503 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:11:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:17.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:18.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:19.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:19.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:19.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:11:19.110 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:11:19.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:19.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:19.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:20.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:20.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:20.923 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:11:20.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:11:20.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:20.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:21.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:22.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:22.416 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:11:22.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:22.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:11:22.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:22.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:23.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:24.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:24.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:24.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:11:24.098 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:11:24.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:24.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:24.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:25.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:25.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:25.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:11:25.807 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:11:25.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:25.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:26.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:27.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:27.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:27.485 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:11:27.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:11:27.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:27.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:28.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:29.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:29.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:29.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:11:29.235 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:11:29.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:29.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:30.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:11:31.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:11:31.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:11:31.045 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:11:31.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:11:31.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:11:31.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:11:31.492 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/1664126126,v1:127.0.0.1:6843/1664126126] [v2:127.0.0.1:6844/1664126126,v1:127.0.0.1:6845/1664126126] exists,up 9d20eb46-d8dd-4dfb-ad1f-b255df1f9d8c 2024-09-16T05:11:31.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:11:31.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:11:31.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:11:31.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:719: TEST_backfill_ec_down_out: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T05:11:32.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:720: TEST_backfill_ec_down_out: create_pool test 1 1 erasure myprofile 2024-09-16T05:11:32.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2024-09-16T05:11:33.037 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T05:11:33.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T05:11:34.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:721: TEST_backfill_ec_down_out: ceph osd pool set test min_size 2 2024-09-16T05:11:34.731 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 min_size to 2 2024-09-16T05:11:34.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:723: TEST_backfill_ec_down_out: wait_for_clean 2024-09-16T05:11:34.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:11:34.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:11:34.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:11:34.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:11:34.743 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:11:34.744 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:11:34.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:11:34.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:11:34.744 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:11:34.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:11:34.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:11:34.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:11:34.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:11:34.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:11:34.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:11:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:11:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:11:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:11:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:11:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T05:11:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T05:11:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:11:35.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:11:35.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:11:35.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836523 2024-09-16T05:11:35.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836523 2024-09-16T05:11:35.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523' 2024-09-16T05:11:35.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:11:35.356 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:11:35.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672992 2024-09-16T05:11:35.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672992 2024-09-16T05:11:35.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672992' 2024-09-16T05:11:35.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:11:35.474 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:11:35.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509474 2024-09-16T05:11:35.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509474 2024-09-16T05:11:35.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672992 2-64424509474' 2024-09-16T05:11:35.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:11:35.593 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:11:35.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345941 2024-09-16T05:11:35.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345941 2024-09-16T05:11:35.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672992 2-64424509474 3-85899345941' 2024-09-16T05:11:35.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:11:35.710 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:11:35.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182417 2024-09-16T05:11:35.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182417 2024-09-16T05:11:35.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672992 2-64424509474 3-85899345941 4-107374182417' 2024-09-16T05:11:35.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:11:35.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T05:11:35.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018886 2024-09-16T05:11:35.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018886 2024-09-16T05:11:35.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672992 2-64424509474 3-85899345941 4-107374182417 5-128849018886' 2024-09-16T05:11:35.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:11:35.974 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836523 2024-09-16T05:11:35.974 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:11:35.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:11:35.975 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836523 2024-09-16T05:11:35.975 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:11:35.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836523 2024-09-16T05:11:35.977 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836523 2024-09-16T05:11:35.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836523' 2024-09-16T05:11:35.977 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:11:36.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836521 -lt 21474836523 2024-09-16T05:11:36.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T05:11:37.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T05:11:37.418 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:11:37.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836524 -lt 21474836523 2024-09-16T05:11:37.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:11:37.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672992 2024-09-16T05:11:37.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:11:37.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:11:37.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672992 2024-09-16T05:11:37.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:11:37.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672992 2024-09-16T05:11:37.873 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672992 2024-09-16T05:11:37.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672992' 2024-09-16T05:11:37.873 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:11:38.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672993 -lt 42949672992 2024-09-16T05:11:38.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:11:38.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509474 2024-09-16T05:11:38.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:11:38.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:11:38.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509474 2024-09-16T05:11:38.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:11:38.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509474 2024-09-16T05:11:38.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509474' 2024-09-16T05:11:38.279 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509474 2024-09-16T05:11:38.279 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:11:38.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509474 -lt 64424509474 2024-09-16T05:11:38.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:11:38.691 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345941 2024-09-16T05:11:38.691 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:11:38.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:11:38.693 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345941 2024-09-16T05:11:38.693 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:11:38.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345941 2024-09-16T05:11:38.694 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345941 2024-09-16T05:11:38.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345941' 2024-09-16T05:11:38.694 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:11:39.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345942 -lt 85899345941 2024-09-16T05:11:39.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:11:39.124 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182417 2024-09-16T05:11:39.124 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:11:39.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:11:39.130 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182417 2024-09-16T05:11:39.130 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:11:39.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182417 2024-09-16T05:11:39.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182417' 2024-09-16T05:11:39.130 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182417 2024-09-16T05:11:39.130 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:11:39.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182418 -lt 107374182417 2024-09-16T05:11:39.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:11:39.584 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018886 2024-09-16T05:11:39.584 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:11:39.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T05:11:39.585 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018886 2024-09-16T05:11:39.585 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:11:39.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018886 2024-09-16T05:11:39.586 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018886 2024-09-16T05:11:39.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018886' 2024-09-16T05:11:39.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T05:11:40.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018887 -lt 128849018886 2024-09-16T05:11:40.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:11:40.044 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:11:40.044 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:11:40.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:11:40.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:11:40.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:11:40.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:11:40.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:11:40.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:11:40.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:11:40.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:11:41.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:11:41.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:11:41.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:11:41.005 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:11:41.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:11:41.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:11:41.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:11:41.560 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: seq 1 200 2024-09-16T05:11:41.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:41.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj1 /dev/null 2024-09-16T05:11:41.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:41.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj2 /dev/null 2024-09-16T05:11:41.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:41.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj3 /dev/null 2024-09-16T05:11:42.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:42.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj4 /dev/null 2024-09-16T05:11:42.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:42.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj5 /dev/null 2024-09-16T05:11:42.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:42.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj6 /dev/null 2024-09-16T05:11:42.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:42.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj7 /dev/null 2024-09-16T05:11:42.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:42.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj8 /dev/null 2024-09-16T05:11:43.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:43.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj9 /dev/null 2024-09-16T05:11:43.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:43.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj10 /dev/null 2024-09-16T05:11:43.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:43.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj11 /dev/null 2024-09-16T05:11:43.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:43.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj12 /dev/null 2024-09-16T05:11:43.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:43.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj13 /dev/null 2024-09-16T05:11:43.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:43.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj14 /dev/null 2024-09-16T05:11:44.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:44.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj15 /dev/null 2024-09-16T05:11:44.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:44.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj16 /dev/null 2024-09-16T05:11:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:44.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj17 /dev/null 2024-09-16T05:11:44.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:44.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj18 /dev/null 2024-09-16T05:11:44.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:44.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj19 /dev/null 2024-09-16T05:11:45.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:45.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj20 /dev/null 2024-09-16T05:11:45.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:45.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj21 /dev/null 2024-09-16T05:11:45.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:45.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj22 /dev/null 2024-09-16T05:11:45.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:45.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj23 /dev/null 2024-09-16T05:11:45.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:45.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj24 /dev/null 2024-09-16T05:11:45.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:45.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj25 /dev/null 2024-09-16T05:11:46.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:46.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj26 /dev/null 2024-09-16T05:11:46.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:46.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj27 /dev/null 2024-09-16T05:11:46.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:46.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj28 /dev/null 2024-09-16T05:11:46.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:46.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj29 /dev/null 2024-09-16T05:11:46.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:46.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj30 /dev/null 2024-09-16T05:11:47.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:47.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj31 /dev/null 2024-09-16T05:11:47.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:47.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj32 /dev/null 2024-09-16T05:11:47.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:47.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj33 /dev/null 2024-09-16T05:11:47.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:47.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj34 /dev/null 2024-09-16T05:11:47.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:47.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj35 /dev/null 2024-09-16T05:11:48.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:48.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj36 /dev/null 2024-09-16T05:11:48.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:48.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj37 /dev/null 2024-09-16T05:11:48.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:48.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj38 /dev/null 2024-09-16T05:11:48.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:48.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj39 /dev/null 2024-09-16T05:11:48.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:48.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj40 /dev/null 2024-09-16T05:11:48.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:48.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj41 /dev/null 2024-09-16T05:11:49.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:49.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj42 /dev/null 2024-09-16T05:11:49.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:49.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj43 /dev/null 2024-09-16T05:11:49.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:49.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj44 /dev/null 2024-09-16T05:11:49.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:49.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj45 /dev/null 2024-09-16T05:11:49.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:49.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj46 /dev/null 2024-09-16T05:11:50.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:50.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj47 /dev/null 2024-09-16T05:11:50.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:50.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj48 /dev/null 2024-09-16T05:11:50.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:50.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj49 /dev/null 2024-09-16T05:11:50.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:50.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj50 /dev/null 2024-09-16T05:11:50.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:50.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj51 /dev/null 2024-09-16T05:11:50.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:50.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj52 /dev/null 2024-09-16T05:11:51.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:51.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj53 /dev/null 2024-09-16T05:11:51.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:51.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj54 /dev/null 2024-09-16T05:11:51.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:51.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj55 /dev/null 2024-09-16T05:11:51.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:51.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj56 /dev/null 2024-09-16T05:11:51.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:51.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj57 /dev/null 2024-09-16T05:11:52.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:52.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj58 /dev/null 2024-09-16T05:11:52.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:52.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj59 /dev/null 2024-09-16T05:11:52.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:52.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj60 /dev/null 2024-09-16T05:11:52.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:52.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj61 /dev/null 2024-09-16T05:11:52.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:52.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj62 /dev/null 2024-09-16T05:11:53.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:53.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj63 /dev/null 2024-09-16T05:11:53.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:53.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj64 /dev/null 2024-09-16T05:11:53.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:53.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj65 /dev/null 2024-09-16T05:11:53.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:53.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj66 /dev/null 2024-09-16T05:11:53.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:53.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj67 /dev/null 2024-09-16T05:11:54.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:54.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj68 /dev/null 2024-09-16T05:11:54.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:54.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj69 /dev/null 2024-09-16T05:11:54.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:54.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj70 /dev/null 2024-09-16T05:11:54.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:54.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj71 /dev/null 2024-09-16T05:11:54.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:54.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj72 /dev/null 2024-09-16T05:11:54.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:54.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj73 /dev/null 2024-09-16T05:11:55.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:55.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj74 /dev/null 2024-09-16T05:11:55.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:55.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj75 /dev/null 2024-09-16T05:11:55.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:55.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj76 /dev/null 2024-09-16T05:11:55.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:55.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj77 /dev/null 2024-09-16T05:11:55.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:55.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj78 /dev/null 2024-09-16T05:11:55.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:55.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj79 /dev/null 2024-09-16T05:11:56.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:56.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj80 /dev/null 2024-09-16T05:11:56.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:56.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj81 /dev/null 2024-09-16T05:11:56.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:56.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj82 /dev/null 2024-09-16T05:11:56.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:56.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj83 /dev/null 2024-09-16T05:11:56.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:56.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj84 /dev/null 2024-09-16T05:11:57.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:57.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj85 /dev/null 2024-09-16T05:11:57.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:57.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj86 /dev/null 2024-09-16T05:11:57.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:57.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj87 /dev/null 2024-09-16T05:11:57.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:57.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj88 /dev/null 2024-09-16T05:11:57.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:57.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj89 /dev/null 2024-09-16T05:11:58.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:58.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj90 /dev/null 2024-09-16T05:11:58.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:58.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj91 /dev/null 2024-09-16T05:11:58.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:58.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj92 /dev/null 2024-09-16T05:11:58.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:58.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj93 /dev/null 2024-09-16T05:11:59.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:59.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj94 /dev/null 2024-09-16T05:11:59.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:59.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj95 /dev/null 2024-09-16T05:11:59.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:59.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj96 /dev/null 2024-09-16T05:11:59.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:59.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj97 /dev/null 2024-09-16T05:11:59.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:11:59.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj98 /dev/null 2024-09-16T05:12:00.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:00.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj99 /dev/null 2024-09-16T05:12:00.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:00.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj100 /dev/null 2024-09-16T05:12:00.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:00.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj101 /dev/null 2024-09-16T05:12:00.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:00.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj102 /dev/null 2024-09-16T05:12:00.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:00.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj103 /dev/null 2024-09-16T05:12:00.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:00.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj104 /dev/null 2024-09-16T05:12:01.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:01.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj105 /dev/null 2024-09-16T05:12:01.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:01.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj106 /dev/null 2024-09-16T05:12:01.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:01.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj107 /dev/null 2024-09-16T05:12:01.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:01.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj108 /dev/null 2024-09-16T05:12:01.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:01.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj109 /dev/null 2024-09-16T05:12:02.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:02.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj110 /dev/null 2024-09-16T05:12:02.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:02.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj111 /dev/null 2024-09-16T05:12:02.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:02.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj112 /dev/null 2024-09-16T05:12:02.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:02.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj113 /dev/null 2024-09-16T05:12:02.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:02.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj114 /dev/null 2024-09-16T05:12:03.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:03.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj115 /dev/null 2024-09-16T05:12:03.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:03.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj116 /dev/null 2024-09-16T05:12:03.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:03.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj117 /dev/null 2024-09-16T05:12:03.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:03.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj118 /dev/null 2024-09-16T05:12:03.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:03.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj119 /dev/null 2024-09-16T05:12:04.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:04.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj120 /dev/null 2024-09-16T05:12:04.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:04.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj121 /dev/null 2024-09-16T05:12:04.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:04.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj122 /dev/null 2024-09-16T05:12:04.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:04.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj123 /dev/null 2024-09-16T05:12:04.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:04.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj124 /dev/null 2024-09-16T05:12:05.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:05.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj125 /dev/null 2024-09-16T05:12:05.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:05.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj126 /dev/null 2024-09-16T05:12:05.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:05.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj127 /dev/null 2024-09-16T05:12:05.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:05.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj128 /dev/null 2024-09-16T05:12:05.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:05.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj129 /dev/null 2024-09-16T05:12:05.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:05.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj130 /dev/null 2024-09-16T05:12:06.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:06.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj131 /dev/null 2024-09-16T05:12:06.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:06.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj132 /dev/null 2024-09-16T05:12:06.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:06.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj133 /dev/null 2024-09-16T05:12:06.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:06.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj134 /dev/null 2024-09-16T05:12:06.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:06.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj135 /dev/null 2024-09-16T05:12:07.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:07.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj136 /dev/null 2024-09-16T05:12:07.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:07.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj137 /dev/null 2024-09-16T05:12:07.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:07.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj138 /dev/null 2024-09-16T05:12:07.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:07.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj139 /dev/null 2024-09-16T05:12:07.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:07.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj140 /dev/null 2024-09-16T05:12:08.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:08.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj141 /dev/null 2024-09-16T05:12:08.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:08.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj142 /dev/null 2024-09-16T05:12:08.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:08.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj143 /dev/null 2024-09-16T05:12:08.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:08.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj144 /dev/null 2024-09-16T05:12:08.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:08.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj145 /dev/null 2024-09-16T05:12:09.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:09.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj146 /dev/null 2024-09-16T05:12:09.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:09.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj147 /dev/null 2024-09-16T05:12:09.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:09.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj148 /dev/null 2024-09-16T05:12:09.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:09.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj149 /dev/null 2024-09-16T05:12:09.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:09.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj150 /dev/null 2024-09-16T05:12:10.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:10.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj151 /dev/null 2024-09-16T05:12:10.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:10.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj152 /dev/null 2024-09-16T05:12:10.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:10.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj153 /dev/null 2024-09-16T05:12:10.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:10.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj154 /dev/null 2024-09-16T05:12:10.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:10.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj155 /dev/null 2024-09-16T05:12:11.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:11.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj156 /dev/null 2024-09-16T05:12:11.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:11.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj157 /dev/null 2024-09-16T05:12:11.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:11.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj158 /dev/null 2024-09-16T05:12:11.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:11.639 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj159 /dev/null 2024-09-16T05:12:11.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:11.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj160 /dev/null 2024-09-16T05:12:12.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:12.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj161 /dev/null 2024-09-16T05:12:12.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:12.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj162 /dev/null 2024-09-16T05:12:12.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:12.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj163 /dev/null 2024-09-16T05:12:12.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:12.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj164 /dev/null 2024-09-16T05:12:12.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:12.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj165 /dev/null 2024-09-16T05:12:12.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:12.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj166 /dev/null 2024-09-16T05:12:13.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:13.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj167 /dev/null 2024-09-16T05:12:13.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:13.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj168 /dev/null 2024-09-16T05:12:13.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:13.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj169 /dev/null 2024-09-16T05:12:13.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:13.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj170 /dev/null 2024-09-16T05:12:14.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:14.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj171 /dev/null 2024-09-16T05:12:14.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:14.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj172 /dev/null 2024-09-16T05:12:14.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:14.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj173 /dev/null 2024-09-16T05:12:14.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:14.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj174 /dev/null 2024-09-16T05:12:14.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:14.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj175 /dev/null 2024-09-16T05:12:14.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:14.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj176 /dev/null 2024-09-16T05:12:15.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:15.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj177 /dev/null 2024-09-16T05:12:15.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:15.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj178 /dev/null 2024-09-16T05:12:15.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:15.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj179 /dev/null 2024-09-16T05:12:15.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:15.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj180 /dev/null 2024-09-16T05:12:15.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:15.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj181 /dev/null 2024-09-16T05:12:16.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:16.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj182 /dev/null 2024-09-16T05:12:16.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:16.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj183 /dev/null 2024-09-16T05:12:16.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:16.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj184 /dev/null 2024-09-16T05:12:16.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:16.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj185 /dev/null 2024-09-16T05:12:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:16.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj186 /dev/null 2024-09-16T05:12:17.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:17.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj187 /dev/null 2024-09-16T05:12:17.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:17.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj188 /dev/null 2024-09-16T05:12:17.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:17.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj189 /dev/null 2024-09-16T05:12:17.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:17.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj190 /dev/null 2024-09-16T05:12:17.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:17.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj191 /dev/null 2024-09-16T05:12:17.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:17.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj192 /dev/null 2024-09-16T05:12:18.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:18.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj193 /dev/null 2024-09-16T05:12:18.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:18.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj194 /dev/null 2024-09-16T05:12:18.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:18.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj195 /dev/null 2024-09-16T05:12:18.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:18.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj196 /dev/null 2024-09-16T05:12:18.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:18.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj197 /dev/null 2024-09-16T05:12:19.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:19.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj198 /dev/null 2024-09-16T05:12:19.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:19.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj199 /dev/null 2024-09-16T05:12:19.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:725: TEST_backfill_ec_down_out: for i in $(seq 1 $objects) 2024-09-16T05:12:19.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:727: TEST_backfill_ec_down_out: rados -p test put obj200 /dev/null 2024-09-16T05:12:19.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:730: TEST_backfill_ec_down_out: get_pg test obj1 2024-09-16T05:12:19.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T05:12:19.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T05:12:19.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T05:12:19.735 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T05:12:20.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:730: TEST_backfill_ec_down_out: local PG=1.0 2024-09-16T05:12:20.179 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:732: TEST_backfill_ec_down_out: get_primary test obj1 2024-09-16T05:12:20.179 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:12:20.179 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:12:20.179 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:12:20.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:12:20.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:732: TEST_backfill_ec_down_out: local primary=1 2024-09-16T05:12:20.622 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:733: TEST_backfill_ec_down_out: get_not_primary test obj1 2024-09-16T05:12:20.622 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2024-09-16T05:12:20.622 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2024-09-16T05:12:20.623 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2024-09-16T05:12:20.623 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:12:20.623 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:12:20.623 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:12:20.623 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:12:21.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2024-09-16T05:12:21.073 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2024-09-16T05:12:21.073 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-09-16T05:12:21.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:733: TEST_backfill_ec_down_out: local otherosd=0 2024-09-16T05:12:21.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:735: TEST_backfill_ec_down_out: ceph osd set nobackfill 2024-09-16T05:12:22.214 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is set 2024-09-16T05:12:22.226 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:736: TEST_backfill_ec_down_out: cat td/osd-backfill-stats/osd.0.pid 2024-09-16T05:12:22.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:736: TEST_backfill_ec_down_out: kill 528894 2024-09-16T05:12:22.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:737: TEST_backfill_ec_down_out: ceph osd down osd.0 2024-09-16T05:12:22.759 INFO:tasks.workunit.client.0.smithi026.stderr:osd.0 is already down. 2024-09-16T05:12:22.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:738: TEST_backfill_ec_down_out: ceph osd out osd.0 2024-09-16T05:12:23.385 INFO:tasks.workunit.client.0.smithi026.stderr:osd.0 is already out. 2024-09-16T05:12:23.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:740: TEST_backfill_ec_down_out: sleep 2 2024-09-16T05:12:25.399 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:741: TEST_backfill_ec_down_out: get_primary test obj1 2024-09-16T05:12:25.399 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:12:25.399 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:12:25.399 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:12:25.399 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:12:25.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:741: TEST_backfill_ec_down_out: primary=1 2024-09-16T05:12:25.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:742: TEST_backfill_ec_down_out: ceph osd unset nobackfill 2024-09-16T05:12:26.459 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is unset 2024-09-16T05:12:26.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:743: TEST_backfill_ec_down_out: ceph tell osd.1 get_latest_osdmap 2024-09-16T05:12:26.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:744: TEST_backfill_ec_down_out: ceph tell osd.1 debug kick_recovery_wq 0 2024-09-16T05:12:26.780 INFO:tasks.workunit.client.0.smithi026.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-09-16T05:12:26.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:745: TEST_backfill_ec_down_out: sleep 2 2024-09-16T05:12:28.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:747: TEST_backfill_ec_down_out: wait_for_clean 2024-09-16T05:12:28.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:12:28.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:12:28.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:12:28.791 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:12:28.792 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:12:28.792 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:12:28.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:12:28.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:12:28.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:12:28.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:12:28.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:12:28.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:12:28.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:12:28.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:12:28.898 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:12:29.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:12:29.454 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:12:29.454 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:12:29.454 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:12:29.454 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T05:12:29.454 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T05:12:29.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:12:29.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:12:29.455 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:12:29.541 INFO:tasks.workunit.client.0.smithi026.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-09-16T05:12:29.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq= 2024-09-16T05:12:29.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z '' 2024-09-16T05:12:29.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2213: flush_pg_stats: continue 2024-09-16T05:12:29.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:12:29.543 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:12:29.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673005 2024-09-16T05:12:29.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673005 2024-09-16T05:12:29.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673005' 2024-09-16T05:12:29.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:12:29.662 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:12:29.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509486 2024-09-16T05:12:29.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509486 2024-09-16T05:12:29.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673005 2-64424509486' 2024-09-16T05:12:29.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:12:29.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:12:29.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345954 2024-09-16T05:12:29.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345954 2024-09-16T05:12:29.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673005 2-64424509486 3-85899345954' 2024-09-16T05:12:29.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:12:29.979 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:12:30.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182430 2024-09-16T05:12:30.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182430 2024-09-16T05:12:30.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673005 2-64424509486 3-85899345954 4-107374182430' 2024-09-16T05:12:30.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:12:30.098 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T05:12:30.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018899 2024-09-16T05:12:30.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018899 2024-09-16T05:12:30.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 1-42949673005 2-64424509486 3-85899345954 4-107374182430 5-128849018899' 2024-09-16T05:12:30.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:12:30.217 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673005 2024-09-16T05:12:30.217 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:12:30.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:12:30.218 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673005 2024-09-16T05:12:30.218 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:12:30.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673005 2024-09-16T05:12:30.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673005' 2024-09-16T05:12:30.221 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673005 2024-09-16T05:12:30.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:12:30.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673003 -lt 42949673005 2024-09-16T05:12:30.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T05:12:31.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T05:12:31.626 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:12:32.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673005 -lt 42949673005 2024-09-16T05:12:32.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:12:32.110 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509486 2024-09-16T05:12:32.110 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:12:32.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:12:32.111 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509486 2024-09-16T05:12:32.111 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:12:32.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509486 2024-09-16T05:12:32.113 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509486 2024-09-16T05:12:32.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509486' 2024-09-16T05:12:32.113 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:12:32.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509487 -lt 64424509486 2024-09-16T05:12:32.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:12:32.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345954 2024-09-16T05:12:32.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:12:32.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:12:32.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345954 2024-09-16T05:12:32.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:12:32.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345954 2024-09-16T05:12:32.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345954' 2024-09-16T05:12:32.525 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345954 2024-09-16T05:12:32.525 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:12:32.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345954 -lt 85899345954 2024-09-16T05:12:32.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:12:32.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182430 2024-09-16T05:12:32.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:12:32.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:12:32.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182430 2024-09-16T05:12:32.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:12:32.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182430 2024-09-16T05:12:32.940 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182430 2024-09-16T05:12:32.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182430' 2024-09-16T05:12:32.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:12:33.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182431 -lt 107374182430 2024-09-16T05:12:33.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:12:33.461 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018899 2024-09-16T05:12:33.461 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:12:33.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T05:12:33.462 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018899 2024-09-16T05:12:33.462 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:12:33.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018899 2024-09-16T05:12:33.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018899' 2024-09-16T05:12:33.463 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018899 2024-09-16T05:12:33.464 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T05:12:34.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018900 -lt 128849018899 2024-09-16T05:12:34.009 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:12:34.009 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:34.009 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:34.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:12:34.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:12:34.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:12:34.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:12:34.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:12:34.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:12:34.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:12:34.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:12:35.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:12:35.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:12:35.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:35.090 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:35.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:12:35.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T05:12:35.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T05:12:35.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T05:12:35.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:12:35.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:12:35.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:12:35.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:12:35.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:12:35.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:12:35.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:12:35.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:12:35.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:12:35.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:12:36.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:12:36.230 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:12:36.230 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:36.231 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:36.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:12:36.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:12:36.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:12:36.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:12:36.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:12:36.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:12:36.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:12:36.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:12:36.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:12:37.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=9 2024-09-16T05:12:37.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 9 '!=' null 2024-09-16T05:12:37.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:12:37.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:12:37.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:12:37.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:12:37.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:12:37.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:12:37.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:12:37.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:12:37.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:12:37.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:12:37.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:12:38.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:12:38.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:12:38.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:38.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:38.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:12:38.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:12:38.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:12:38.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:12:38.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:12:38.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:12:38.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:12:38.717 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:12:38.717 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:12:39.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:12:39.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:12:39.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:12:39.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:12:39.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:12:39.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:12:39.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:12:39.397 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:12:39.397 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:12:39.397 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:12:39.397 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:12:39.397 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:12:39.397 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:12:39.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:12:39.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:12:39.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:39.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:40.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:12:40.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:12:40.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:12:40.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:12:40.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:12:40.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:12:40.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:12:40.491 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:12:40.491 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:12:41.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:12:41.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:12:41.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:12:41.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:12:41.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:12:41.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:12:41.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:12:41.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:12:41.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:12:41.324 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:12:41.324 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:12:41.324 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:12:41.324 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:12:41.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:12:41.730 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:12:41.730 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:41.730 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:42.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:12:42.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:12:42.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:12:42.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:12:42.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:12:42.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:12:42.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:12:42.364 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:12:42.364 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:12:42.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:12:42.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:12:42.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:12:42.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:12:42.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:12:43.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:12:43.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:12:43.052 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:12:43.052 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:12:43.052 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:12:43.052 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:12:43.052 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:12:43.052 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:12:43.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:12:43.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:12:43.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:43.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:44.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:12:44.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:12:44.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:12:44.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:12:44.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:12:44.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:12:44.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:12:44.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:12:44.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:12:44.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=9 2024-09-16T05:12:44.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 9 '!=' null 2024-09-16T05:12:44.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:12:44.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:12:44.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:12:44.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:12:44.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:12:44.833 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:12:44.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:12:44.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:12:44.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:12:44.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:12:44.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:12:45.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:12:45.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:12:45.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:45.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:45.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:12:45.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:12:45.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:12:45.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:12:45.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:12:45.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:12:45.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:12:45.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:12:45.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:12:46.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=8 2024-09-16T05:12:46.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 8 '!=' null 2024-09-16T05:12:46.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:12:46.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:12:46.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:12:46.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:12:46.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:12:46.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:12:46.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:12:46.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:12:46.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:12:46.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:12:46.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:12:46.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:12:46.979 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:12:46.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:46.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:47.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:12:47.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:12:47.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:12:47.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:12:47.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:12:47.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:12:47.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:12:47.629 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:12:47.629 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:12:48.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=11 2024-09-16T05:12:48.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 11 '!=' null 2024-09-16T05:12:48.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:12:48.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:12:48.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:12:48.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:12:48.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:12:48.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:12:48.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:12:48.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:12:48.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:12:48.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:12:48.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:12:48.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:12:48.831 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:12:48.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:48.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:49.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:12:49.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:12:49.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:12:49.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:12:49.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:12:49.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:12:49.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:12:49.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:12:49.385 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:12:49.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=11 2024-09-16T05:12:49.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 11 '!=' null 2024-09-16T05:12:49.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:12:49.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:12:49.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:12:50.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:12:50.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:12:50.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:12:50.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:12:50.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:12:50.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:12:50.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:12:50.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:12:50.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:12:50.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:12:50.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:50.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:51.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:12:51.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:12:51.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:12:51.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:12:51.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:12:51.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:12:51.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:12:51.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:12:51.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:12:51.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:12:51.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:12:51.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:12:51.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:12:51.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:12:51.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:12:51.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:12:51.713 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:12:51.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:12:51.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:12:51.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:12:51.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:12:51.714 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:12:52.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:12:52.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:12:52.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:52.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:52.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:12:52.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:12:52.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:12:52.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:12:52.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:12:52.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:12:52.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:12:52.656 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:12:52.656 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:12:53.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:12:53.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:12:53.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:12:53.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:12:53.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:12:53.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:12:53.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:12:53.365 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:12:53.365 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:12:53.365 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:12:53.366 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:12:53.366 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:12:53.366 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:12:53.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:12:53.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:12:53.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:12:53.762 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:12:54.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:12:54.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:12:54.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:12:54.313 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:749: TEST_backfill_ec_down_out: expr 200 '*' 2 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:749: TEST_backfill_ec_down_out: local misplaced=400 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:750: TEST_backfill_ec_down_out: check td/osd-backfill-stats 1.0 1 erasure 200 0 0 0 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=erasure 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=200 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=0 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-09-16T05:12:54.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-09-16T05:12:54.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-09-16T05:12:54.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-09-16T05:12:54.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-09-16T05:12:54.321 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-09-16T05:12:54.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-09-16T05:12:54.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-09-16T05:12:54.336 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-09-16T05:12:54.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-09-16T05:12:54.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-09-16T05:12:54.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' erasure = erasure ']' 2024-09-16T05:12:54.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:89: check: addp=p 2024-09-16T05:12:54.338 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-09-16T05:12:54.338 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:12:54.338 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-09-16T05:12:54.338 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-09-16T05:12:54.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[1,3,2]/[1,NONE,2]' 2024-09-16T05:12:54.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[1,3,2]/[1,NONE,2]' ']' 2024-09-16T05:12:54.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-09-16T05:12:54.355 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:12:54.356 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:12:54.356 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [1,3,2]/[1,NONE,2]p' 2024-09-16T05:12:54.356 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-09-16T05:12:54.356 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-09-16T05:12:54.356 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:12:54.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=200 2024-09-16T05:12:54.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 200 ']' 2024-09-16T05:12:54.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 200 200 2024-09-16T05:12:54.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-09-16T05:12:54.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:12:54.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-09-16T05:12:54.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:12:54.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:12:54.363 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:12:54.363 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-09-16T05:12:54.363 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:12:54.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=1 2024-09-16T05:12:54.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 1 ']' 2024-09-16T05:12:54.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 1 0 2024-09-16T05:12:54.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-09-16T05:12:54.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:12:54.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:12:54.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:12:54.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-09-16T05:12:54.375 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:12:54.375 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:12:54.375 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [1,3,2]/[1,NONE,2]p' 2024-09-16T05:12:54.375 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-09-16T05:12:54.375 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-09-16T05:12:54.375 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:12:54.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=0 2024-09-16T05:12:54.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 0 ']' 2024-09-16T05:12:54.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 0 0 2024-09-16T05:12:54.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-09-16T05:12:54.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:12:54.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-09-16T05:12:54.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:12:54.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:12:54.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:12:54.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-09-16T05:12:54.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:12:54.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=0 2024-09-16T05:12:54.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 0 ']' 2024-09-16T05:12:54.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 0 0 2024-09-16T05:12:54.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-09-16T05:12:54.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:12:54.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:12:54.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:12:54.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-09-16T05:12:54.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:752: TEST_backfill_ec_down_out: delete_pool test 2024-09-16T05:12:54.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T05:12:54.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T05:12:54.885 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T05:12:54.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:753: TEST_backfill_ec_down_out: kill_daemons td/osd-backfill-stats 2024-09-16T05:12:54.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:12:54.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:12:54.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:12:54.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:12:54.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:13:00.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:13:00.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-09-16T05:13:00.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:13:00.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:13:00.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:13:00.212 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:13:00.212 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:13:00.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:13:00.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:13:00.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:13:00.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:13:00.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:13:00.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:13:00.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:13:00.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:13:00.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:13:00.223 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:13:00.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:13:00.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:13:00.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:13:00.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:13:00.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:13:00.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:13:00.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:13:00.270 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:13:00.270 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:13:00.270 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:13:00.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:13:00.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:13:00.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:13:00.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-09-16T05:13:00.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-09-16T05:13:00.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-stats 2024-09-16T05:13:00.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-stats 2024-09-16T05:13:00.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:13:00.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:13:00.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:13:00.272 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:13:00.273 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:13:00.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:13:00.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:13:00.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:13:00.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:13:00.274 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:13:00.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:13:00.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:13:00.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:13:00.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:13:00.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:13:00.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:13:00.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:13:00.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:13:00.278 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:13:00.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:13:00.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:13:00.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:13:00.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:13:00.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:13:00.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:13:00.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:13:00.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:13:00.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:13:00.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-stats 2024-09-16T05:13:00.285 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T05:13:00.285 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:13:00.285 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:13:00.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.478321 2024-09-16T05:13:00.286 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T05:13:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T05:13:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T05:13:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-09-16T05:13:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_ec_prim_out td/osd-backfill-stats 2024-09-16T05:13:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:569: TEST_backfill_ec_prim_out: local dir=td/osd-backfill-stats 2024-09-16T05:13:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:571: TEST_backfill_ec_prim_out: run_mon td/osd-backfill-stats a 2024-09-16T05:13:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-stats 2024-09-16T05:13:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T05:13:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T05:13:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T05:13:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-stats/a 2024-09-16T05:13:00.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-09-16T05:13:00.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T05:13:00.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:13:00.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:13:00.795 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:13:00.795 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:13:00.795 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:13:00.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:13:00.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T05:13:00.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T05:13:00.988 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T05:13:00.988 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:13:00.989 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:13:00.989 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T05:13:00.990 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T05:13:00.990 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:13:00.990 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:13:00.990 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:13:00.990 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:13:00.990 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:13:00.990 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:13:00.991 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:13:00.991 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:13:00.991 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get fsid 2024-09-16T05:13:01.081 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T05:13:01.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:13:01.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:13:01.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T05:13:01.082 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T05:13:01.082 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:13:01.082 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:13:01.082 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:13:01.083 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:13:01.083 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:13:01.083 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:13:01.083 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:13:01.083 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:13:01.084 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get mon_host 2024-09-16T05:13:01.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:572: TEST_backfill_ec_prim_out: run_mgr td/osd-backfill-stats x 2024-09-16T05:13:01.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-stats 2024-09-16T05:13:01.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T05:13:01.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T05:13:01.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T05:13:01.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-stats/x 2024-09-16T05:13:01.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T05:13:02.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T05:13:02.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:13:02.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:13:02.037 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:13:02.037 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:13:02.037 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:13:02.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:13:02.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:13:02.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:13:02.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:573: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 0 2024-09-16T05:13:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:13:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:13:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T05:13:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:13:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/0 2024-09-16T05:13:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:13:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:13:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:13:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:13:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-09-16T05:13:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-09-16T05:13:02.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:13:02.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:13:02.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:13:02.075 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:13:02.075 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:13:02.075 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:13:02.075 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:13:02.075 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:13:02.075 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:13:02.075 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:13:02.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:13:02.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:13:02.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:13:02.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:13:02.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:13:02.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:13:02.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:13:02.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:13:02.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:13:02.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:13:02.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:13:02.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:13:02.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/0 2024-09-16T05:13:02.077 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:13:02.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ece70c7d-91ce-443a-ba1e-5d53297048da 2024-09-16T05:13:02.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 ece70c7d-91ce-443a-ba1e-5d53297048da' 2024-09-16T05:13:02.077 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 ece70c7d-91ce-443a-ba1e-5d53297048da 2024-09-16T05:13:02.077 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:13:02.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBevudmYA1pBRAAeYp2RfIMQ4nL1cyONM6JNQ== 2024-09-16T05:13:02.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBevudmYA1pBRAAeYp2RfIMQ4nL1cyONM6JNQ=="}' 2024-09-16T05:13:02.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ece70c7d-91ce-443a-ba1e-5d53297048da -i td/osd-backfill-stats/0/new.json 2024-09-16T05:13:02.354 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:13:02.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/0/new.json 2024-09-16T05:13:02.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBevudmYA1pBRAAeYp2RfIMQ4nL1cyONM6JNQ== --osd-uuid ece70c7d-91ce-443a-ba1e-5d53297048da 2024-09-16T05:13:02.396 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:02.395+0000 7f970660d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:13:02.413 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:02.413+0000 7f970660d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:13:02.414 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:02.414+0000 7f970660d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:13:02.415 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:02.414+0000 7f970660d640 -1 bdev(0x56227a3bdc00 td/osd-backfill-stats/0/block) open stat got: (1) Operation not permitted 2024-09-16T05:13:02.415 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:02.414+0000 7f970660d640 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-09-16T05:13:08.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-09-16T05:13:08.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:13:08.101 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T05:13:08.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T05:13:08.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:13:08.681 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T05:13:08.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T05:13:08.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:13:08.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:13:08.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:13:08.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:13:08.710 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:08.710+0000 7f1ffeb17640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:13:08.717 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:08.716+0000 7f1ffeb17640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:13:08.718 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:08.718+0000 7f1ffeb17640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:13:09.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T05:13:09.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:13:09.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T05:13:09.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:13:09.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:13:09.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:09.149 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:13:09.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:13:09.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:09.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:09.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:10.070 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:10.069+0000 7f1ffeb17640 -1 Falling back to public interface 2024-09-16T05:13:10.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:10.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:10.786 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:13:10.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:13:10.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:10.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:10.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:11.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:11.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:11.977 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:13:11.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:13:11.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:11.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:12.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:12.838 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:12.837+0000 7f1ffeb17640 -1 osd.0 0 log_to_monitors true 2024-09-16T05:13:13.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:13.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:13.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:13:13.395 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:13:13.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:13.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:13.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:14.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:14.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:14.909 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:13:14.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:13:14.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:14.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:15.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:16.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:16.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:16.331 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:13:16.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:13:16.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:16.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:16.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:17.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:17.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:17.871 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:13:17.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:13:17.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:17.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:18.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:19.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:19.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:19.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:13:19.302 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:13:19.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:19.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:19.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:20.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:20.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:20.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:13:20.758 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:13:20.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:20.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:21.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:22.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:22.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:22.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:13:22.231 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:13:22.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:22.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:22.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:23.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:23.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:23.712 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:13:23.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:13:23.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:23.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:24.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:25.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:25.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:25.276 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:13:25.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:13:25.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:25.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:25.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:26.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:26.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:26.899 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:13:26.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:13:26.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:26.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:27.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:28.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:28.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:28.594 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:13:28.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:13:28.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:28.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:29.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:30.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:30.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:30.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:13:30.553 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:13:30.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:30.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:31.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:32.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:32.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:32.089 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:13:32.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:13:32.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:32.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:32.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:33.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:33.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:33.561 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:13:33.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:13:33.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:33.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:34.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:35.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:35.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:35.123 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:13:35.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:13:35.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:35.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:13:35.622 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/99043497,v1:127.0.0.1:6803/99043497] [v2:127.0.0.1:6804/99043497,v1:127.0.0.1:6805/99043497] exists,up ece70c7d-91ce-443a-ba1e-5d53297048da 2024-09-16T05:13:35.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:13:35.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:13:35.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:574: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 1 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/1 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:13:35.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:13:35.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:13:35.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:13:35.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:13:35.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:13:35.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:13:35.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:13:35.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:13:35.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/1 2024-09-16T05:13:35.629 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:13:35.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=95a3f03b-5724-4880-acca-ab91a8d39c01 2024-09-16T05:13:35.629 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 95a3f03b-5724-4880-acca-ab91a8d39c01 2024-09-16T05:13:35.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 95a3f03b-5724-4880-acca-ab91a8d39c01' 2024-09-16T05:13:35.630 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:13:35.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB/vudmiZJ9JhAAInUHnQqWOr7ZrgGcwCTfRQ== 2024-09-16T05:13:35.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB/vudmiZJ9JhAAInUHnQqWOr7ZrgGcwCTfRQ=="}' 2024-09-16T05:13:35.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 95a3f03b-5724-4880-acca-ab91a8d39c01 -i td/osd-backfill-stats/1/new.json 2024-09-16T05:13:36.180 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:13:36.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/1/new.json 2024-09-16T05:13:36.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB/vudmiZJ9JhAAInUHnQqWOr7ZrgGcwCTfRQ== --osd-uuid 95a3f03b-5724-4880-acca-ab91a8d39c01 2024-09-16T05:13:36.225 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:36.224+0000 7f01b9415640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:13:36.226 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:36.226+0000 7f01b9415640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:13:36.227 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:36.227+0000 7f01b9415640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:13:36.228 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:36.227+0000 7f01b9415640 -1 bdev(0x55f2edde1c00 td/osd-backfill-stats/1/block) open stat got: (1) Operation not permitted 2024-09-16T05:13:36.228 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:36.227+0000 7f01b9415640 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-09-16T05:13:42.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-09-16T05:13:42.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:13:42.269 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T05:13:42.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T05:13:42.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:13:42.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T05:13:42.846 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T05:13:42.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:13:42.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:13:42.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:13:42.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:13:42.876 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:42.875+0000 7f94d920b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:13:42.919 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:42.918+0000 7f94d920b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:13:42.920 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:42.919+0000 7f94d920b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:13:43.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T05:13:43.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:13:43.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T05:13:43.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:13:43.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:13:43.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:43.286 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:13:43.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:13:43.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:43.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:13:43.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:44.282 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:44.281+0000 7f94d920b640 -1 Falling back to public interface 2024-09-16T05:13:44.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:44.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:44.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:13:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:13:44.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:44.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:13:45.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:46.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:46.193 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:13:46.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:46.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:13:46.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:46.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:13:46.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:47.087 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:13:47.086+0000 7f94d920b640 -1 osd.1 0 log_to_monitors true 2024-09-16T05:13:47.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:47.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:47.649 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:13:47.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:13:47.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:47.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:13:48.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:49.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:49.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:49.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:13:49.285 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:13:49.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:49.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:13:49.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:50.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:50.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:50.716 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:13:50.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:13:50.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:50.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:13:51.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:52.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:52.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:52.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:13:52.202 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:13:52.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:52.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:13:52.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:53.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:53.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:53.720 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:13:53.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:13:53.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:53.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:13:54.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:55.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:55.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:55.243 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:13:55.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:13:55.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:55.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:13:55.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:56.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:56.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:56.694 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:13:56.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:13:56.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:56.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:13:57.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:58.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:58.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:58.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:13:58.112 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:13:58.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:58.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:13:58.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:13:59.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:13:59.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:13:59.553 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:13:59.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:13:59.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:13:59.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:14:00.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:01.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:01.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:01.571 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:14:01.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:14:01.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:01.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:14:02.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:03.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:03.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:03.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:14:03.432 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:14:03.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:03.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:14:04.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:05.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:05.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:05.089 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:14:05.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:14:05.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:05.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:14:06.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:07.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:07.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:07.082 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:14:07.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:14:07.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:07.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:14:07.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:08.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:08.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:08.849 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:14:08.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:14:08.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:08.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:14:09.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:10.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:10.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:10.772 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:14:10.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:14:10.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:10.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:14:11.224 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3565789266,v1:127.0.0.1:6811/3565789266] [v2:127.0.0.1:6812/3565789266,v1:127.0.0.1:6813/3565789266] exists,up 95a3f03b-5724-4880-acca-ab91a8d39c01 2024-09-16T05:14:11.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:14:11.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:14:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:14:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:575: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 2 2024-09-16T05:14:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:14:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:14:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T05:14:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:14:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/2 2024-09-16T05:14:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:14:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:14:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:14:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:14:11.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:14:11.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:14:11.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:14:11.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:14:11.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:14:11.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:14:11.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:14:11.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:14:11.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:14:11.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:14:11.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:14:11.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/2 2024-09-16T05:14:11.231 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:14:11.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=dff733e1-d63c-4684-bd21-eadabfe7ecbf 2024-09-16T05:14:11.231 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 dff733e1-d63c-4684-bd21-eadabfe7ecbf 2024-09-16T05:14:11.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 dff733e1-d63c-4684-bd21-eadabfe7ecbf' 2024-09-16T05:14:11.231 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:14:11.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCjvudm2022DhAA+DGAtVlnhGAtSjfjSI/hXw== 2024-09-16T05:14:11.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCjvudm2022DhAA+DGAtVlnhGAtSjfjSI/hXw=="}' 2024-09-16T05:14:11.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new dff733e1-d63c-4684-bd21-eadabfe7ecbf -i td/osd-backfill-stats/2/new.json 2024-09-16T05:14:11.774 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:14:11.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/2/new.json 2024-09-16T05:14:11.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCjvudm2022DhAA+DGAtVlnhGAtSjfjSI/hXw== --osd-uuid dff733e1-d63c-4684-bd21-eadabfe7ecbf 2024-09-16T05:14:11.818 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:11.818+0000 7fb54cc11640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:14:11.820 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:11.820+0000 7fb54cc11640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:14:11.821 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:11.821+0000 7fb54cc11640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:14:11.822 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:11.821+0000 7fb54cc11640 -1 bdev(0x5653a2305c00 td/osd-backfill-stats/2/block) open stat got: (1) Operation not permitted 2024-09-16T05:14:11.822 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:11.821+0000 7fb54cc11640 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-09-16T05:14:18.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-09-16T05:14:18.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:14:18.055 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T05:14:18.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T05:14:18.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:14:18.619 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T05:14:18.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T05:14:18.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:14:18.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:14:18.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:14:18.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:14:18.649 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:18.648+0000 7f9e3afcc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:14:18.651 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:18.650+0000 7f9e3afcc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:14:18.652 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:18.651+0000 7f9e3afcc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:14:19.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T05:14:19.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:14:19.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T05:14:19.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:14:19.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:14:19.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:19.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:14:19.076 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:14:19.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:19.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:19.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:19.992 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:19.991+0000 7f9e3afcc640 -1 Falling back to public interface 2024-09-16T05:14:20.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:20.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:20.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:14:20.503 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:14:20.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:20.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:20.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:21.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:21.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:21.946 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:14:21.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:14:21.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:21.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:22.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:22.992 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:22.991+0000 7f9e3afcc640 -1 osd.2 0 log_to_monitors true 2024-09-16T05:14:23.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:23.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:23.376 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:14:23.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:14:23.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:23.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:23.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:24.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:24.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:24.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:14:24.791 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:14:24.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:24.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:25.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:26.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:26.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:26.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:14:26.211 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:14:26.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:26.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:26.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:27.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:27.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:27.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:14:27.778 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:14:27.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:27.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:28.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:29.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:29.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:29.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:14:29.197 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:14:29.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:29.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:29.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:30.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:30.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:30.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:14:30.790 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:14:30.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:30.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:31.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:32.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:32.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:32.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:14:32.229 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:14:32.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:32.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:32.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:33.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:33.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:33.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:14:33.784 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:14:33.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:33.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:34.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:35.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:35.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:35.217 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:14:35.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:14:35.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:35.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:36.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:37.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:37.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:37.142 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:14:37.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:14:37.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:37.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:37.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:38.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:38.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:38.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:14:38.903 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:14:38.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:38.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:39.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:40.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:40.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:40.864 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:14:40.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:14:40.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:40.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:41.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:42.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:42.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:42.625 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:14:42.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:14:42.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:42.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:43.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:44.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:44.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:44.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:14:44.385 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:14:44.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:44.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:45.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:46.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:46.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:46.196 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:14:46.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:14:46.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:46.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:14:46.641 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3903352696,v1:127.0.0.1:6819/3903352696] [v2:127.0.0.1:6820/3903352696,v1:127.0.0.1:6821/3903352696] exists,up dff733e1-d63c-4684-bd21-eadabfe7ecbf 2024-09-16T05:14:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:14:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:14:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:14:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:576: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 3 2024-09-16T05:14:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:14:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:14:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T05:14:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:14:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/3 2024-09-16T05:14:46.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:14:46.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:14:46.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:14:46.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:14:46.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-09-16T05:14:46.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-09-16T05:14:46.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:14:46.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:14:46.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:14:46.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:14:46.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:14:46.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:14:46.653 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:14:46.653 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:14:46.653 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:14:46.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:14:46.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:14:46.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:14:46.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:14:46.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:14:46.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:14:46.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:14:46.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:14:46.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:14:46.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:14:46.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:14:46.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:14:46.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:14:46.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/3 2024-09-16T05:14:46.655 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:14:46.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7743d97c-bb63-4d08-aef8-7ed5a2f3b49f 2024-09-16T05:14:46.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 7743d97c-bb63-4d08-aef8-7ed5a2f3b49f' 2024-09-16T05:14:46.656 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 7743d97c-bb63-4d08-aef8-7ed5a2f3b49f 2024-09-16T05:14:46.656 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:14:46.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDGvudmWXihJxAAyUyo3cGQaemAq/BpR8z65A== 2024-09-16T05:14:46.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDGvudmWXihJxAAyUyo3cGQaemAq/BpR8z65A=="}' 2024-09-16T05:14:46.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7743d97c-bb63-4d08-aef8-7ed5a2f3b49f -i td/osd-backfill-stats/3/new.json 2024-09-16T05:14:47.230 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:14:47.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/3/new.json 2024-09-16T05:14:47.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDGvudmWXihJxAAyUyo3cGQaemAq/BpR8z65A== --osd-uuid 7743d97c-bb63-4d08-aef8-7ed5a2f3b49f 2024-09-16T05:14:47.274 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:47.273+0000 7f30b700d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:14:47.275 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:47.275+0000 7f30b700d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:14:47.277 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:47.276+0000 7f30b700d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:14:47.277 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:47.276+0000 7f30b700d640 -1 bdev(0x564ecb683c00 td/osd-backfill-stats/3/block) open stat got: (1) Operation not permitted 2024-09-16T05:14:47.277 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:47.276+0000 7f30b700d640 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-09-16T05:14:52.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-09-16T05:14:52.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:14:52.972 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T05:14:52.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T05:14:52.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:14:53.538 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T05:14:53.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T05:14:53.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:14:53.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:14:53.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:14:53.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:14:53.568 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:53.568+0000 7f2c04e24640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:14:53.570 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:53.570+0000 7f2c04e24640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:14:53.572 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:53.571+0000 7f2c04e24640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:14:53.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T05:14:53.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:14:53.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T05:14:53.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:14:53.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:14:53.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:53.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:14:53.978 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:14:53.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:53.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:14:54.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:54.420 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:54.418+0000 7f2c04e24640 -1 Falling back to public interface 2024-09-16T05:14:55.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:55.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:55.387 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:14:55.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:14:55.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:55.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:14:55.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:56.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:56.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:56.841 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:14:56.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:14:56.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:56.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:14:57.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:57.450 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:14:57.448+0000 7f2c04e24640 -1 osd.3 0 log_to_monitors true 2024-09-16T05:14:58.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:58.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:58.336 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:14:58.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:14:58.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:58.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:14:58.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:14:59.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:14:59.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:14:59.923 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:14:59.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:14:59.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:14:59.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:00.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:01.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:01.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:01.449 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:15:01.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:15:01.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:01.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:01.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:02.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:02.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:02.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:15:02.866 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:15:02.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:02.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:03.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:04.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:04.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:04.340 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:15:04.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:15:04.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:04.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:04.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:05.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:05.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:05.760 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:15:05.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:15:05.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:05.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:06.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:07.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:07.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:07.181 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:15:07.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:15:07.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:07.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:07.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:08.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:08.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:08.694 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:15:08.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:15:08.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:08.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:09.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:10.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:10.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:10.110 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:15:10.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:15:10.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:10.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:11.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:12.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:12.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:12.158 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:15:12.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:15:12.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:12.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:12.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:13.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:13.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:13.936 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:15:13.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:15:13.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:13.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:14.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:15.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:15.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:15.703 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:15:15.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:15:15.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:15.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:16.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:17.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:17.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:17.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:15:17.401 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:15:17.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:17.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:18.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:19.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:19.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:19.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:15:19.463 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:15:19.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:19.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:20.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:21.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:21.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:21.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:15:21.087 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:15:21.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:21.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:15:21.513 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2849448263,v1:127.0.0.1:6827/2849448263] [v2:127.0.0.1:6828/2849448263,v1:127.0.0.1:6829/2849448263] exists,up 7743d97c-bb63-4d08-aef8-7ed5a2f3b49f 2024-09-16T05:15:21.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:15:21.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:15:21.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:15:21.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:577: TEST_backfill_ec_prim_out: run_osd td/osd-backfill-stats 4 2024-09-16T05:15:21.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:15:21.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:15:21.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T05:15:21.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:15:21.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/4 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:15:21.518 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:15:21.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:15:21.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/4 2024-09-16T05:15:21.520 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:15:21.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=06ea732c-05ea-4e4d-bd50-6e7e8119d2b2 2024-09-16T05:15:21.520 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 06ea732c-05ea-4e4d-bd50-6e7e8119d2b2 2024-09-16T05:15:21.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 06ea732c-05ea-4e4d-bd50-6e7e8119d2b2' 2024-09-16T05:15:21.520 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:15:21.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDpvudmPgS7HxAAgFJb06YOTFyWTtF2HD9EOA== 2024-09-16T05:15:21.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDpvudmPgS7HxAAgFJb06YOTFyWTtF2HD9EOA=="}' 2024-09-16T05:15:21.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 06ea732c-05ea-4e4d-bd50-6e7e8119d2b2 -i td/osd-backfill-stats/4/new.json 2024-09-16T05:15:22.016 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:15:22.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/4/new.json 2024-09-16T05:15:22.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDpvudmPgS7HxAAgFJb06YOTFyWTtF2HD9EOA== --osd-uuid 06ea732c-05ea-4e4d-bd50-6e7e8119d2b2 2024-09-16T05:15:22.059 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:15:22.058+0000 7fdc724e2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:15:22.063 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:15:22.062+0000 7fdc724e2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:15:22.064 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:15:22.063+0000 7fdc724e2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:15:22.064 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:15:22.064+0000 7fdc724e2640 -1 bdev(0x557d5b737c00 td/osd-backfill-stats/4/block) open stat got: (1) Operation not permitted 2024-09-16T05:15:22.065 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:15:22.064+0000 7fdc724e2640 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-09-16T05:15:28.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-09-16T05:15:28.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:15:28.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T05:15:28.032 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T05:15:28.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:15:28.594 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T05:15:28.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T05:15:28.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:15:28.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:15:28.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:15:28.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:15:28.624 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:15:28.623+0000 7f10e79bd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:15:28.626 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:15:28.625+0000 7f10e79bd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:15:28.627 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:15:28.626+0000 7f10e79bd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:15:29.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T05:15:29.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:15:29.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T05:15:29.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:15:29.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:15:29.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:29.013 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:15:29.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:15:29.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:29.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:29.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:29.709 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:15:29.708+0000 7f10e79bd640 -1 Falling back to public interface 2024-09-16T05:15:30.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:30.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:30.455 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:15:30.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:15:30.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:30.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:30.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:31.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:31.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:31.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:15:31.898 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:15:31.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:31.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:32.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:32.802 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:15:32.801+0000 7f10e79bd640 -1 osd.4 0 log_to_monitors true 2024-09-16T05:15:33.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:33.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:33.314 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:15:33.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:15:33.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:33.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:33.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:34.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:34.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:34.918 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:15:34.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:15:34.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:34.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:35.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:36.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:36.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:36.438 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:15:36.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:15:36.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:36.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:36.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:37.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:37.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:37.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:15:37.858 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:15:37.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:37.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:38.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:39.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:39.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:39.299 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:15:39.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:15:39.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:39.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:39.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:40.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:40.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:40.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:15:40.802 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:15:40.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:40.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:41.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:42.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:42.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:42.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:15:42.241 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:15:42.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:42.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:42.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:43.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:43.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:43.733 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:15:43.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:15:43.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:43.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:44.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:45.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:45.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:45.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:15:45.160 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:15:45.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:45.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:46.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:47.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:47.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:47.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:15:47.101 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:15:47.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:47.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:48.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:49.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:49.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:49.265 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:15:49.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:15:49.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:49.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:50.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:51.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:51.041 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:15:51.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:15:51.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:51.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:52.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:53.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:53.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:53.223 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:15:53.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:15:53.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:53.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:53.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:54.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:54.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:54.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:15:54.945 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:15:54.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:54.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:55.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:15:56.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:15:56.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:15:56.592 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:15:56.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:15:56.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:15:56.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:15:57.033 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/218438356,v1:127.0.0.1:6835/218438356] [v2:127.0.0.1:6836/218438356,v1:127.0.0.1:6837/218438356] exists,up 06ea732c-05ea-4e4d-bd50-6e7e8119d2b2 2024-09-16T05:15:57.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:15:57.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:15:57.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:15:57.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:579: TEST_backfill_ec_prim_out: ceph osd erasure-code-profile set myprofile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T05:15:57.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:580: TEST_backfill_ec_prim_out: create_pool test 1 1 erasure myprofile 2024-09-16T05:15:57.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2024-09-16T05:15:58.328 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T05:15:58.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T05:15:59.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:582: TEST_backfill_ec_prim_out: wait_for_clean 2024-09-16T05:15:59.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:15:59.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:15:59.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:15:59.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:15:59.342 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:15:59.343 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:15:59.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:15:59.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:15:59.343 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:15:59.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:15:59.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:15:59.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:15:59.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:15:59.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:15:59.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:15:59.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:15:59.853 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:15:59.853 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:15:59.853 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:15:59.853 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T05:15:59.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:15:59.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:15:59.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:15:59.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836512 2024-09-16T05:15:59.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836512 2024-09-16T05:15:59.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836512' 2024-09-16T05:15:59.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:15:59.997 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:16:00.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672989 2024-09-16T05:16:00.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672989 2024-09-16T05:16:00.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836512 1-42949672989' 2024-09-16T05:16:00.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:16:00.116 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:16:00.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509460 2024-09-16T05:16:00.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509460 2024-09-16T05:16:00.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836512 1-42949672989 2-64424509460' 2024-09-16T05:16:00.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:16:00.236 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:16:00.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345934 2024-09-16T05:16:00.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345934 2024-09-16T05:16:00.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836512 1-42949672989 2-64424509460 3-85899345934' 2024-09-16T05:16:00.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:16:00.372 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:16:00.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182408 2024-09-16T05:16:00.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182408 2024-09-16T05:16:00.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836512 1-42949672989 2-64424509460 3-85899345934 4-107374182408' 2024-09-16T05:16:00.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:16:00.489 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836512 2024-09-16T05:16:00.490 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:16:00.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:16:00.491 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836512 2024-09-16T05:16:00.491 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:16:00.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836512 2024-09-16T05:16:00.492 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836512 2024-09-16T05:16:00.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836512' 2024-09-16T05:16:00.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:16:00.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836512 -lt 21474836512 2024-09-16T05:16:00.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:16:00.902 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672989 2024-09-16T05:16:00.902 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:16:00.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:16:00.904 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672989 2024-09-16T05:16:00.904 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:16:00.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672989 2024-09-16T05:16:00.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672989' 2024-09-16T05:16:00.905 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672989 2024-09-16T05:16:00.906 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:16:01.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672989 -lt 42949672989 2024-09-16T05:16:01.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:16:01.321 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509460 2024-09-16T05:16:01.321 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:16:01.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:16:01.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509460 2024-09-16T05:16:01.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:16:01.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509460 2024-09-16T05:16:01.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509460' 2024-09-16T05:16:01.324 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509460 2024-09-16T05:16:01.324 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:16:01.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509460 -lt 64424509460 2024-09-16T05:16:01.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:16:01.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345934 2024-09-16T05:16:01.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:16:01.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:16:01.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345934 2024-09-16T05:16:01.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:16:01.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345934 2024-09-16T05:16:01.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345934' 2024-09-16T05:16:01.839 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345934 2024-09-16T05:16:01.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:16:02.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345932 -lt 85899345934 2024-09-16T05:16:02.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T05:16:03.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T05:16:03.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:16:03.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345935 -lt 85899345934 2024-09-16T05:16:03.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:16:03.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182408 2024-09-16T05:16:03.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:16:03.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:16:03.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182408 2024-09-16T05:16:03.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:16:03.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182408 2024-09-16T05:16:03.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182408' 2024-09-16T05:16:03.750 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182408 2024-09-16T05:16:03.750 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:16:04.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182409 -lt 107374182408 2024-09-16T05:16:04.183 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:16:04.183 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:16:04.183 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:16:04.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:16:04.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:16:04.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:16:04.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:16:04.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:16:04.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:16:04.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:16:04.740 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:16:05.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:16:05.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:16:05.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:16:05.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:16:05.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:16:05.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:16:05.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:16:05.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: seq 1 200 2024-09-16T05:16:05.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:05.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj1 /dev/null 2024-09-16T05:16:05.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:05.901 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj2 /dev/null 2024-09-16T05:16:06.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:06.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj3 /dev/null 2024-09-16T05:16:06.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:06.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj4 /dev/null 2024-09-16T05:16:06.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:06.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj5 /dev/null 2024-09-16T05:16:06.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:06.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj6 /dev/null 2024-09-16T05:16:06.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:06.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj7 /dev/null 2024-09-16T05:16:07.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:07.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj8 /dev/null 2024-09-16T05:16:07.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:07.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj9 /dev/null 2024-09-16T05:16:07.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:07.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj10 /dev/null 2024-09-16T05:16:07.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:07.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj11 /dev/null 2024-09-16T05:16:07.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:07.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj12 /dev/null 2024-09-16T05:16:07.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:07.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj13 /dev/null 2024-09-16T05:16:08.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:08.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj14 /dev/null 2024-09-16T05:16:08.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:08.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj15 /dev/null 2024-09-16T05:16:08.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:08.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj16 /dev/null 2024-09-16T05:16:08.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:08.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj17 /dev/null 2024-09-16T05:16:08.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:08.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj18 /dev/null 2024-09-16T05:16:09.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:09.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj19 /dev/null 2024-09-16T05:16:09.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:09.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj20 /dev/null 2024-09-16T05:16:09.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:09.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj21 /dev/null 2024-09-16T05:16:09.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:09.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj22 /dev/null 2024-09-16T05:16:09.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:09.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj23 /dev/null 2024-09-16T05:16:10.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:10.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj24 /dev/null 2024-09-16T05:16:10.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:10.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj25 /dev/null 2024-09-16T05:16:10.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:10.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj26 /dev/null 2024-09-16T05:16:10.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:10.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj27 /dev/null 2024-09-16T05:16:10.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:10.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj28 /dev/null 2024-09-16T05:16:11.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:11.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj29 /dev/null 2024-09-16T05:16:11.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:11.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj30 /dev/null 2024-09-16T05:16:11.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:11.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj31 /dev/null 2024-09-16T05:16:11.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:11.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj32 /dev/null 2024-09-16T05:16:11.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:11.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj33 /dev/null 2024-09-16T05:16:11.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:11.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj34 /dev/null 2024-09-16T05:16:12.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:12.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj35 /dev/null 2024-09-16T05:16:12.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:12.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj36 /dev/null 2024-09-16T05:16:12.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:12.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj37 /dev/null 2024-09-16T05:16:12.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:12.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj38 /dev/null 2024-09-16T05:16:12.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:12.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj39 /dev/null 2024-09-16T05:16:13.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:13.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj40 /dev/null 2024-09-16T05:16:13.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:13.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj41 /dev/null 2024-09-16T05:16:13.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:13.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj42 /dev/null 2024-09-16T05:16:13.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:13.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj43 /dev/null 2024-09-16T05:16:13.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:13.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj44 /dev/null 2024-09-16T05:16:13.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:13.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj45 /dev/null 2024-09-16T05:16:14.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:14.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj46 /dev/null 2024-09-16T05:16:14.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:14.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj47 /dev/null 2024-09-16T05:16:14.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:14.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj48 /dev/null 2024-09-16T05:16:14.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:14.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj49 /dev/null 2024-09-16T05:16:14.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:14.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj50 /dev/null 2024-09-16T05:16:15.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:15.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj51 /dev/null 2024-09-16T05:16:15.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:15.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj52 /dev/null 2024-09-16T05:16:15.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:15.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj53 /dev/null 2024-09-16T05:16:15.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:15.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj54 /dev/null 2024-09-16T05:16:15.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:15.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj55 /dev/null 2024-09-16T05:16:16.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:16.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj56 /dev/null 2024-09-16T05:16:16.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:16.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj57 /dev/null 2024-09-16T05:16:16.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:16.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj58 /dev/null 2024-09-16T05:16:16.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:16.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj59 /dev/null 2024-09-16T05:16:16.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:16.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj60 /dev/null 2024-09-16T05:16:16.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:16.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj61 /dev/null 2024-09-16T05:16:17.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:17.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj62 /dev/null 2024-09-16T05:16:17.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:17.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj63 /dev/null 2024-09-16T05:16:17.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:17.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj64 /dev/null 2024-09-16T05:16:17.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:17.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj65 /dev/null 2024-09-16T05:16:17.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:17.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj66 /dev/null 2024-09-16T05:16:18.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:18.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj67 /dev/null 2024-09-16T05:16:18.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:18.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj68 /dev/null 2024-09-16T05:16:18.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:18.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj69 /dev/null 2024-09-16T05:16:18.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:18.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj70 /dev/null 2024-09-16T05:16:18.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:18.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj71 /dev/null 2024-09-16T05:16:18.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:18.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj72 /dev/null 2024-09-16T05:16:19.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:19.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj73 /dev/null 2024-09-16T05:16:19.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:19.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj74 /dev/null 2024-09-16T05:16:19.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:19.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj75 /dev/null 2024-09-16T05:16:19.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:19.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj76 /dev/null 2024-09-16T05:16:19.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:19.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj77 /dev/null 2024-09-16T05:16:20.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:20.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj78 /dev/null 2024-09-16T05:16:20.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:20.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj79 /dev/null 2024-09-16T05:16:20.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:20.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj80 /dev/null 2024-09-16T05:16:20.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:20.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj81 /dev/null 2024-09-16T05:16:20.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:20.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj82 /dev/null 2024-09-16T05:16:21.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:21.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj83 /dev/null 2024-09-16T05:16:21.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:21.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj84 /dev/null 2024-09-16T05:16:21.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:21.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj85 /dev/null 2024-09-16T05:16:21.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:21.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj86 /dev/null 2024-09-16T05:16:21.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:21.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj87 /dev/null 2024-09-16T05:16:21.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:21.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj88 /dev/null 2024-09-16T05:16:22.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:22.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj89 /dev/null 2024-09-16T05:16:22.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:22.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj90 /dev/null 2024-09-16T05:16:22.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:22.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj91 /dev/null 2024-09-16T05:16:22.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:22.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj92 /dev/null 2024-09-16T05:16:22.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:22.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj93 /dev/null 2024-09-16T05:16:23.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:23.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj94 /dev/null 2024-09-16T05:16:23.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:23.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj95 /dev/null 2024-09-16T05:16:23.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:23.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj96 /dev/null 2024-09-16T05:16:23.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:23.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj97 /dev/null 2024-09-16T05:16:23.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:23.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj98 /dev/null 2024-09-16T05:16:23.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:23.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj99 /dev/null 2024-09-16T05:16:24.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:24.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj100 /dev/null 2024-09-16T05:16:24.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:24.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj101 /dev/null 2024-09-16T05:16:24.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:24.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj102 /dev/null 2024-09-16T05:16:24.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:24.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj103 /dev/null 2024-09-16T05:16:24.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:24.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj104 /dev/null 2024-09-16T05:16:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:25.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj105 /dev/null 2024-09-16T05:16:25.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:25.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj106 /dev/null 2024-09-16T05:16:25.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:25.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj107 /dev/null 2024-09-16T05:16:26.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:26.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj108 /dev/null 2024-09-16T05:16:26.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:26.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj109 /dev/null 2024-09-16T05:16:26.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:26.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj110 /dev/null 2024-09-16T05:16:26.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:26.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj111 /dev/null 2024-09-16T05:16:26.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:26.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj112 /dev/null 2024-09-16T05:16:26.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:26.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj113 /dev/null 2024-09-16T05:16:27.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:27.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj114 /dev/null 2024-09-16T05:16:27.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:27.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj115 /dev/null 2024-09-16T05:16:27.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:27.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj116 /dev/null 2024-09-16T05:16:27.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:27.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj117 /dev/null 2024-09-16T05:16:27.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:27.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj118 /dev/null 2024-09-16T05:16:28.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:28.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj119 /dev/null 2024-09-16T05:16:28.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:28.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj120 /dev/null 2024-09-16T05:16:28.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:28.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj121 /dev/null 2024-09-16T05:16:28.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:28.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj122 /dev/null 2024-09-16T05:16:28.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:28.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj123 /dev/null 2024-09-16T05:16:29.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:29.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj124 /dev/null 2024-09-16T05:16:29.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:29.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj125 /dev/null 2024-09-16T05:16:29.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:29.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj126 /dev/null 2024-09-16T05:16:29.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:29.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj127 /dev/null 2024-09-16T05:16:29.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:29.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj128 /dev/null 2024-09-16T05:16:29.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:29.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj129 /dev/null 2024-09-16T05:16:30.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:30.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj130 /dev/null 2024-09-16T05:16:30.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:30.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj131 /dev/null 2024-09-16T05:16:30.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:30.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj132 /dev/null 2024-09-16T05:16:30.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:30.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj133 /dev/null 2024-09-16T05:16:30.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:30.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj134 /dev/null 2024-09-16T05:16:31.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:31.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj135 /dev/null 2024-09-16T05:16:31.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:31.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj136 /dev/null 2024-09-16T05:16:31.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:31.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj137 /dev/null 2024-09-16T05:16:31.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:31.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj138 /dev/null 2024-09-16T05:16:31.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:31.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj139 /dev/null 2024-09-16T05:16:32.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:32.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj140 /dev/null 2024-09-16T05:16:32.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:32.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj141 /dev/null 2024-09-16T05:16:32.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:32.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj142 /dev/null 2024-09-16T05:16:32.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:32.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj143 /dev/null 2024-09-16T05:16:32.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:32.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj144 /dev/null 2024-09-16T05:16:32.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:32.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj145 /dev/null 2024-09-16T05:16:33.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:33.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj146 /dev/null 2024-09-16T05:16:33.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:33.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj147 /dev/null 2024-09-16T05:16:33.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:33.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj148 /dev/null 2024-09-16T05:16:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:33.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj149 /dev/null 2024-09-16T05:16:33.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:33.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj150 /dev/null 2024-09-16T05:16:34.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:34.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj151 /dev/null 2024-09-16T05:16:34.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:34.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj152 /dev/null 2024-09-16T05:16:34.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:34.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj153 /dev/null 2024-09-16T05:16:34.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:34.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj154 /dev/null 2024-09-16T05:16:34.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:34.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj155 /dev/null 2024-09-16T05:16:35.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:35.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj156 /dev/null 2024-09-16T05:16:35.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:35.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj157 /dev/null 2024-09-16T05:16:35.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:35.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj158 /dev/null 2024-09-16T05:16:35.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:35.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj159 /dev/null 2024-09-16T05:16:35.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:35.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj160 /dev/null 2024-09-16T05:16:35.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:35.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj161 /dev/null 2024-09-16T05:16:36.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:36.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj162 /dev/null 2024-09-16T05:16:36.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:36.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj163 /dev/null 2024-09-16T05:16:36.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:36.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj164 /dev/null 2024-09-16T05:16:36.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:36.638 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj165 /dev/null 2024-09-16T05:16:36.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:36.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj166 /dev/null 2024-09-16T05:16:37.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:37.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj167 /dev/null 2024-09-16T05:16:37.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:37.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj168 /dev/null 2024-09-16T05:16:37.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:37.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj169 /dev/null 2024-09-16T05:16:37.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:37.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj170 /dev/null 2024-09-16T05:16:37.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:37.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj171 /dev/null 2024-09-16T05:16:37.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:37.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj172 /dev/null 2024-09-16T05:16:38.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:38.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj173 /dev/null 2024-09-16T05:16:38.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:38.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj174 /dev/null 2024-09-16T05:16:38.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:38.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj175 /dev/null 2024-09-16T05:16:38.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:38.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj176 /dev/null 2024-09-16T05:16:38.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:38.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj177 /dev/null 2024-09-16T05:16:39.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:39.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj178 /dev/null 2024-09-16T05:16:39.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:39.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj179 /dev/null 2024-09-16T05:16:39.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:39.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj180 /dev/null 2024-09-16T05:16:39.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:39.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj181 /dev/null 2024-09-16T05:16:39.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:39.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj182 /dev/null 2024-09-16T05:16:39.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:39.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj183 /dev/null 2024-09-16T05:16:40.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:40.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj184 /dev/null 2024-09-16T05:16:40.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:40.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj185 /dev/null 2024-09-16T05:16:40.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:40.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj186 /dev/null 2024-09-16T05:16:40.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:40.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj187 /dev/null 2024-09-16T05:16:40.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:40.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj188 /dev/null 2024-09-16T05:16:41.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:41.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj189 /dev/null 2024-09-16T05:16:41.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:41.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj190 /dev/null 2024-09-16T05:16:41.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:41.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj191 /dev/null 2024-09-16T05:16:41.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:41.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj192 /dev/null 2024-09-16T05:16:41.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:41.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj193 /dev/null 2024-09-16T05:16:42.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:42.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj194 /dev/null 2024-09-16T05:16:42.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:42.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj195 /dev/null 2024-09-16T05:16:42.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:42.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj196 /dev/null 2024-09-16T05:16:42.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:42.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj197 /dev/null 2024-09-16T05:16:42.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:42.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj198 /dev/null 2024-09-16T05:16:42.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:42.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj199 /dev/null 2024-09-16T05:16:43.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:584: TEST_backfill_ec_prim_out: for i in $(seq 1 $objects) 2024-09-16T05:16:43.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:586: TEST_backfill_ec_prim_out: rados -p test put obj200 /dev/null 2024-09-16T05:16:43.375 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:589: TEST_backfill_ec_prim_out: get_pg test obj1 2024-09-16T05:16:43.375 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T05:16:43.376 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T05:16:43.376 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T05:16:43.376 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T05:16:43.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:589: TEST_backfill_ec_prim_out: local PG=1.0 2024-09-16T05:16:43.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:591: TEST_backfill_ec_prim_out: get_primary test obj1 2024-09-16T05:16:43.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:16:43.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:16:43.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:16:43.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:16:44.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:591: TEST_backfill_ec_prim_out: local primary=1 2024-09-16T05:16:44.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:593: TEST_backfill_ec_prim_out: ceph osd set nobackfill 2024-09-16T05:16:44.952 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is set 2024-09-16T05:16:44.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:594: TEST_backfill_ec_prim_out: ceph osd out osd.1 2024-09-16T05:16:45.689 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. 2024-09-16T05:16:45.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:596: TEST_backfill_ec_prim_out: sleep 2 2024-09-16T05:16:47.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:597: TEST_backfill_ec_prim_out: get_primary test obj1 2024-09-16T05:16:47.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:16:47.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:16:47.704 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:16:47.704 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:16:48.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:597: TEST_backfill_ec_prim_out: primary=1 2024-09-16T05:16:48.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:598: TEST_backfill_ec_prim_out: ceph osd unset nobackfill 2024-09-16T05:16:48.886 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is unset 2024-09-16T05:16:48.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:599: TEST_backfill_ec_prim_out: ceph tell osd.1 get_latest_osdmap 2024-09-16T05:16:49.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:600: TEST_backfill_ec_prim_out: ceph tell osd.1 debug kick_recovery_wq 0 2024-09-16T05:16:49.158 INFO:tasks.workunit.client.0.smithi026.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-09-16T05:16:49.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:601: TEST_backfill_ec_prim_out: sleep 2 2024-09-16T05:16:51.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:603: TEST_backfill_ec_prim_out: wait_for_clean 2024-09-16T05:16:51.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:16:51.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:16:51.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:16:51.169 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:16:51.169 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:16:51.169 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:16:51.170 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:16:51.170 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:16:51.170 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:16:51.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:16:51.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:16:51.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:16:51.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:16:51.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:16:51.273 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:16:51.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:16:51.677 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:16:51.677 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:16:51.677 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:16:51.677 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T05:16:51.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:16:51.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:16:51.678 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:16:51.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836525 2024-09-16T05:16:51.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836525 2024-09-16T05:16:51.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836525' 2024-09-16T05:16:51.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:16:51.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:16:52.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673002 2024-09-16T05:16:52.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673002 2024-09-16T05:16:52.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836525 1-42949673002' 2024-09-16T05:16:52.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:16:52.035 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:16:52.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509473 2024-09-16T05:16:52.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509473 2024-09-16T05:16:52.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836525 1-42949673002 2-64424509473' 2024-09-16T05:16:52.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:16:52.155 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:16:52.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345947 2024-09-16T05:16:52.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345947 2024-09-16T05:16:52.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836525 1-42949673002 2-64424509473 3-85899345947' 2024-09-16T05:16:52.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:16:52.274 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:16:52.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182421 2024-09-16T05:16:52.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182421 2024-09-16T05:16:52.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836525 1-42949673002 2-64424509473 3-85899345947 4-107374182421' 2024-09-16T05:16:52.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:16:52.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836525 2024-09-16T05:16:52.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:16:52.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:16:52.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836525 2024-09-16T05:16:52.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:16:52.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836525 2024-09-16T05:16:52.397 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836525 2024-09-16T05:16:52.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836525' 2024-09-16T05:16:52.397 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:16:52.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836525 -lt 21474836525 2024-09-16T05:16:52.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:16:52.801 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673002 2024-09-16T05:16:52.801 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:16:52.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:16:52.801 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673002 2024-09-16T05:16:52.801 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:16:52.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673002 2024-09-16T05:16:52.802 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673002 2024-09-16T05:16:52.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673002' 2024-09-16T05:16:52.802 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:16:53.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673002 -lt 42949673002 2024-09-16T05:16:53.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:16:53.301 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509473 2024-09-16T05:16:53.301 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:16:53.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:16:53.302 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509473 2024-09-16T05:16:53.302 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:16:53.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509473 2024-09-16T05:16:53.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509473' 2024-09-16T05:16:53.303 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509473 2024-09-16T05:16:53.304 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:16:53.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509473 -lt 64424509473 2024-09-16T05:16:53.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:16:53.814 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345947 2024-09-16T05:16:53.814 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:16:53.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:16:53.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345947 2024-09-16T05:16:53.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:16:53.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345947 2024-09-16T05:16:53.817 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345947 2024-09-16T05:16:53.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345947' 2024-09-16T05:16:53.817 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:16:54.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345947 -lt 85899345947 2024-09-16T05:16:54.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:16:54.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182421 2024-09-16T05:16:54.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:16:54.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:16:54.318 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182421 2024-09-16T05:16:54.318 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:16:54.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182421 2024-09-16T05:16:54.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182421' 2024-09-16T05:16:54.320 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182421 2024-09-16T05:16:54.320 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:16:54.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182421 -lt 107374182421 2024-09-16T05:16:54.768 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:16:54.769 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:16:54.769 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:16:55.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:16:55.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:16:55.340 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:16:55.340 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:16:55.340 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:16:55.340 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:16:55.341 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:16:55.341 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:16:55.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:16:55.823 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:16:55.823 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:16:55.823 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:16:56.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:16:56.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T05:16:56.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T05:16:56.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T05:16:56.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:16:56.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:16:56.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:16:56.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:16:56.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:16:56.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:16:56.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:16:56.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:16:56.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:16:56.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:16:57.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:16:57.205 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:16:57.205 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:16:57.205 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:16:57.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:16:57.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:16:57.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:16:57.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:16:57.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:16:57.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:16:57.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:16:57.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:16:57.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:16:58.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:16:58.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:16:58.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:16:58.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:16:58.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:16:58.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:16:58.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:16:58.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:16:58.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:16:58.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:16:58.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:16:58.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:16:58.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:16:59.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:16:59.028 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:16:59.029 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:16:59.029 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:16:59.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:16:59.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:16:59.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:16:59.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:16:59.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:16:59.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:16:59.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:16:59.615 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:16:59.615 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:17:00.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:17:00.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:17:00.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:17:00.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:17:00.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:17:00.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:17:00.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:17:00.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:17:00.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:17:00.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:17:00.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:17:00.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:17:00.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:17:00.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:17:00.806 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:17:00.806 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:17:00.806 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:17:01.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:17:01.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:17:01.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:17:01.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:17:01.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:17:01.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:17:01.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:17:01.406 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:17:01.407 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:17:02.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:17:02.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:17:02.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:17:02.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:17:02.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:17:02.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:17:02.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:17:02.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:17:02.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:17:02.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:17:02.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:17:02.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:17:02.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:17:02.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:17:02.544 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:17:02.544 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:17:02.544 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:17:03.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:17:03.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:17:03.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:17:03.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:17:03.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:17:03.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:17:03.173 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:17:03.173 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:17:03.173 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:17:03.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=8 2024-09-16T05:17:03.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 8 '!=' null 2024-09-16T05:17:03.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:17:03.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:17:03.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:17:03.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:17:03.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:17:03.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:17:03.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:17:03.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:17:03.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:17:03.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:17:03.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:17:04.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:17:04.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:17:04.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:17:04.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:17:04.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:17:04.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:17:04.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:17:04.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:17:04.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:17:04.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:17:04.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:17:04.898 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:17:04.898 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:17:05.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:17:05.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:17:05.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:17:05.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:17:05.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:17:05.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:17:05.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:17:05.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:17:05.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:17:05.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:17:05.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:17:05.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:17:05.687 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:17:06.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:17:06.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:17:06.100 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:17:06.100 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:17:06.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:17:06.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:17:06.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:17:06.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:17:06.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:17:06.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:17:06.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:17:06.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:17:06.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:17:07.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=10 2024-09-16T05:17:07.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 10 '!=' null 2024-09-16T05:17:07.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:17:07.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:17:07.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:17:07.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:17:07.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:17:07.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:17:07.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:17:07.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:17:07.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:17:07.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:17:07.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:17:07.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:17:07.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:17:07.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:17:07.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:17:08.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:17:08.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:17:08.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:17:08.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:17:08.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:17:08.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:17:08.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:17:08.404 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:17:08.404 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:17:09.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:17:09.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:17:09.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:17:09.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:17:09.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:17:09.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:17:09.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:17:09.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:17:09.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:17:09.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:17:09.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:17:09.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:17:09.260 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:17:09.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:17:09.675 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:17:09.676 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:17:09.676 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:17:10.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:17:10.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:17:10.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:17:10.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:17:10.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:17:10.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:17:10.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:17:10.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:17:10.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:17:10.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=9 2024-09-16T05:17:10.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 9 '!=' null 2024-09-16T05:17:10.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:17:10.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:17:10.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:17:11.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:17:11.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:17:11.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:17:11.081 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:17:11.081 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:17:11.081 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:17:11.081 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:17:11.081 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:17:11.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:17:11.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:17:11.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:17:11.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:17:12.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:17:12.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:17:12.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:17:12.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:17:12.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:17:12.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:17:12.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:17:12.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:17:12.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:17:12.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2024-09-16T05:17:12.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2024-09-16T05:17:12.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1655: wait_for_clean: (( 1 >= 13 )) 2024-09-16T05:17:12.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:17:12.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.2 2024-09-16T05:17:12.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:17:12.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:17:12.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:17:12.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:17:12.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:17:12.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:17:12.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:17:12.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:17:13.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:17:13.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:17:13.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:17:13.225 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:17:13.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:17:13.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:17:13.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:17:13.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:605: TEST_backfill_ec_prim_out: expr 200 '*' 3 2024-09-16T05:17:13.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:605: TEST_backfill_ec_prim_out: local misplaced=600 2024-09-16T05:17:13.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:606: TEST_backfill_ec_prim_out: check td/osd-backfill-stats 1.0 1 erasure 0 0 200 0 2024-09-16T05:17:13.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-09-16T05:17:13.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-09-16T05:17:13.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-09-16T05:17:13.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=erasure 2024-09-16T05:17:13.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=0 2024-09-16T05:17:13.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-09-16T05:17:13.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=200 2024-09-16T05:17:13.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-09-16T05:17:13.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-09-16T05:17:13.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-09-16T05:17:13.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-09-16T05:17:13.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-09-16T05:17:13.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-09-16T05:17:13.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-09-16T05:17:13.781 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log 2024-09-16T05:17:13.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-09-16T05:17:13.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-09-16T05:17:13.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-09-16T05:17:13.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-09-16T05:17:13.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-09-16T05:17:13.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' erasure = erasure ']' 2024-09-16T05:17:13.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:89: check: addp=p 2024-09-16T05:17:13.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-09-16T05:17:13.796 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:17:13.797 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-09-16T05:17:13.797 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-09-16T05:17:13.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[4,0,2]/[1,0,2]' 2024-09-16T05:17:13.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[4,0,2]/[1,0,2]' ']' 2024-09-16T05:17:13.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-09-16T05:17:13.813 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:17:13.814 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:17:13.814 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [4,0,2]/[1,0,2]p' 2024-09-16T05:17:13.814 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-09-16T05:17:13.814 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-09-16T05:17:13.814 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:17:13.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=0 2024-09-16T05:17:13.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 0 ']' 2024-09-16T05:17:13.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 0 0 2024-09-16T05:17:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-09-16T05:17:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:17:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-09-16T05:17:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:17:13.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:17:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:17:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-09-16T05:17:13.822 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:17:13.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=0 2024-09-16T05:17:13.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 0 ']' 2024-09-16T05:17:13.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 0 0 2024-09-16T05:17:13.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-09-16T05:17:13.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:17:13.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:17:13.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:17:13.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-09-16T05:17:13.833 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:17:13.833 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:17:13.833 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [4,0,2]/[1,0,2]p' 2024-09-16T05:17:13.833 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-09-16T05:17:13.834 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-09-16T05:17:13.834 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:17:13.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=200 2024-09-16T05:17:13.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 200 ']' 2024-09-16T05:17:13.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 200 200 2024-09-16T05:17:13.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-09-16T05:17:13.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:17:13.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-09-16T05:17:13.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:17:13.841 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:17:13.841 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:17:13.841 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-09-16T05:17:13.841 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:17:13.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=1 2024-09-16T05:17:13.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 1 ']' 2024-09-16T05:17:13.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 1 0 2024-09-16T05:17:13.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-09-16T05:17:13.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:17:13.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:17:13.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:17:13.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-09-16T05:17:13.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:608: TEST_backfill_ec_prim_out: delete_pool test 2024-09-16T05:17:13.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T05:17:13.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T05:17:14.411 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T05:17:14.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:609: TEST_backfill_ec_prim_out: kill_daemons td/osd-backfill-stats 2024-09-16T05:17:14.424 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:17:14.424 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:17:14.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:17:14.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:17:14.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:17:19.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:17:19.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-09-16T05:17:19.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:17:19.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:17:19.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:17:19.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:17:19.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:17:19.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:17:19.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:17:19.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:17:19.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:17:19.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:17:19.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:17:19.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:17:19.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:17:19.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:17:19.751 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:17:19.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:17:19.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:17:19.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:17:19.752 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:17:19.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:17:19.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:17:19.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:17:19.791 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:17:19.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:17:19.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:17:19.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:17:19.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:17:19.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:17:19.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-09-16T05:17:19.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-09-16T05:17:19.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-stats 2024-09-16T05:17:19.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-stats 2024-09-16T05:17:19.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:17:19.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:17:19.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:17:19.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:17:19.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:17:19.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:17:19.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:17:19.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:17:19.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:17:19.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:17:19.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:17:19.797 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:17:19.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:17:19.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:17:19.798 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:17:19.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:17:19.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:17:19.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:17:19.800 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:17:19.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:17:19.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:17:19.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:17:19.803 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:17:19.803 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:17:19.804 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:17:19.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:17:19.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:17:19.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:17:19.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-stats 2024-09-16T05:17:19.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T05:17:19.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:17:19.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:17:19.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.478321 2024-09-16T05:17:19.808 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T05:17:19.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T05:17:19.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T05:17:19.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-09-16T05:17:19.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_out td/osd-backfill-stats 2024-09-16T05:17:19.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:230: TEST_backfill_out: local dir=td/osd-backfill-stats 2024-09-16T05:17:19.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:232: TEST_backfill_out: run_mon td/osd-backfill-stats a 2024-09-16T05:17:19.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-stats 2024-09-16T05:17:19.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T05:17:19.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T05:17:19.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T05:17:19.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-stats/a 2024-09-16T05:17:19.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-09-16T05:17:20.281 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T05:17:20.281 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:17:20.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:17:20.282 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:17:20.282 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:17:20.282 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:17:20.282 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:17:20.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T05:17:20.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T05:17:20.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T05:17:20.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:17:20.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:17:20.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T05:17:20.476 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T05:17:20.476 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:17:20.476 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:17:20.476 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:17:20.477 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:17:20.477 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:17:20.477 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:17:20.477 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:17:20.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:17:20.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get fsid 2024-09-16T05:17:20.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T05:17:20.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:17:20.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:17:20.566 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T05:17:20.566 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T05:17:20.566 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:17:20.566 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:17:20.566 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:17:20.567 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:17:20.567 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:17:20.567 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:17:20.567 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:17:20.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:17:20.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get mon_host 2024-09-16T05:17:20.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:233: TEST_backfill_out: run_mgr td/osd-backfill-stats x 2024-09-16T05:17:20.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-stats 2024-09-16T05:17:20.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T05:17:20.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T05:17:20.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T05:17:20.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-stats/x 2024-09-16T05:17:20.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T05:17:21.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T05:17:21.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:17:21.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:17:21.506 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:17:21.506 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:17:21.506 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:17:21.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:17:21.507 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:17:21.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:17:21.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:234: TEST_backfill_out: run_osd td/osd-backfill-stats 0 2024-09-16T05:17:21.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:17:21.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:17:21.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/0 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:17:21.541 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:17:21.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:17:21.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:17:21.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:17:21.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:17:21.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:17:21.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/0 2024-09-16T05:17:21.543 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:17:21.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0af3a1a5-e44a-49d8-8567-b6e6c68f418d 2024-09-16T05:17:21.544 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 0af3a1a5-e44a-49d8-8567-b6e6c68f418d 2024-09-16T05:17:21.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 0af3a1a5-e44a-49d8-8567-b6e6c68f418d' 2024-09-16T05:17:21.544 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:17:21.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBhv+dmoXh1IRAA4q9UYOf6Vh0VADLPPlZYkg== 2024-09-16T05:17:21.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBhv+dmoXh1IRAA4q9UYOf6Vh0VADLPPlZYkg=="}' 2024-09-16T05:17:21.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0af3a1a5-e44a-49d8-8567-b6e6c68f418d -i td/osd-backfill-stats/0/new.json 2024-09-16T05:17:21.838 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:17:21.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/0/new.json 2024-09-16T05:17:21.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBhv+dmoXh1IRAA4q9UYOf6Vh0VADLPPlZYkg== --osd-uuid 0af3a1a5-e44a-49d8-8567-b6e6c68f418d 2024-09-16T05:17:21.880 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:21.879+0000 7f41e05a8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:17:21.907 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:21.906+0000 7f41e05a8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:17:21.908 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:21.907+0000 7f41e05a8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:17:21.908 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:21.907+0000 7f41e05a8640 -1 bdev(0x55e01549fc00 td/osd-backfill-stats/0/block) open stat got: (1) Operation not permitted 2024-09-16T05:17:21.908 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:21.907+0000 7f41e05a8640 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-09-16T05:17:27.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-09-16T05:17:27.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:17:27.575 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T05:17:27.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T05:17:27.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:17:28.144 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T05:17:28.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T05:17:28.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:17:28.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:17:28.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:17:28.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:17:28.173 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:28.173+0000 7f3825a33640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:17:28.175 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:28.175+0000 7f3825a33640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:17:28.176 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:28.176+0000 7f3825a33640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:17:28.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T05:17:28.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:17:28.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T05:17:28.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:17:28.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:17:28.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:28.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:17:28.636 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:17:28.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:28.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:29.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:29.263 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:29.263+0000 7f3825a33640 -1 Falling back to public interface 2024-09-16T05:17:30.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:30.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:30.079 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:17:30.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:17:30.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:30.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:30.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:31.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:31.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:31.530 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:17:31.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:17:31.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:31.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:31.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:32.508 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:32.507+0000 7f3825a33640 -1 osd.0 0 log_to_monitors true 2024-09-16T05:17:32.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:32.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:32.987 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:17:32.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:17:32.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:32.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:33.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:34.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:34.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:34.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:17:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:17:34.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:34.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:34.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:35.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:35.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:35.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:17:35.925 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:17:35.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:35.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:36.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:37.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:37.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:37.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:17:37.448 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:17:37.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:37.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:37.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:38.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:38.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:38.863 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:17:38.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:17:38.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:38.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:39.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:40.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:40.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:40.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:17:40.327 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:17:40.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:40.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:40.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:41.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:41.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:41.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:17:41.773 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:17:41.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:41.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:42.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:43.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:43.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:43.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:17:43.345 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:17:43.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:43.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:43.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:44.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:44.767 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:17:44.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:17:44.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:44.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:45.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:46.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:46.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:46.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:17:46.528 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:17:46.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:46.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:47.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:48.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:48.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:48.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:17:48.258 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:17:48.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:48.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:49.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:50.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:50.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:50.195 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:17:50.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:17:50.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:50.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:50.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:51.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:51.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:51.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:17:51.939 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:17:51.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:51.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:52.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:53.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:53.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:53.989 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:17:53.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:17:53.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:53.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:54.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:17:55.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:17:55.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:17:55.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:17:55.588 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:17:55.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:17:55.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:17:56.040 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3360694301,v1:127.0.0.1:6803/3360694301] [v2:127.0.0.1:6804/3360694301,v1:127.0.0.1:6805/3360694301] exists,up 0af3a1a5-e44a-49d8-8567-b6e6c68f418d 2024-09-16T05:17:56.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:17:56.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:17:56.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:17:56.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:235: TEST_backfill_out: run_osd td/osd-backfill-stats 1 2024-09-16T05:17:56.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:17:56.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:17:56.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T05:17:56.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:17:56.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/1 2024-09-16T05:17:56.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:17:56.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:17:56.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:17:56.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:17:56.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-09-16T05:17:56.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-09-16T05:17:56.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:17:56.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:17:56.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:17:56.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:17:56.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:17:56.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:17:56.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:17:56.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:17:56.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:17:56.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/1 2024-09-16T05:17:56.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:17:56.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f57941a7-7faa-46c6-aff0-ff6685f4d4be 2024-09-16T05:17:56.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 f57941a7-7faa-46c6-aff0-ff6685f4d4be' 2024-09-16T05:17:56.047 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 f57941a7-7faa-46c6-aff0-ff6685f4d4be 2024-09-16T05:17:56.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:17:56.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCEv+dmxOTDAxAAIM5+7tICzqmDmXIR+OPDBg== 2024-09-16T05:17:56.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCEv+dmxOTDAxAAIM5+7tICzqmDmXIR+OPDBg=="}' 2024-09-16T05:17:56.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f57941a7-7faa-46c6-aff0-ff6685f4d4be -i td/osd-backfill-stats/1/new.json 2024-09-16T05:17:56.585 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:17:56.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/1/new.json 2024-09-16T05:17:56.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCEv+dmxOTDAxAAIM5+7tICzqmDmXIR+OPDBg== --osd-uuid f57941a7-7faa-46c6-aff0-ff6685f4d4be 2024-09-16T05:17:56.629 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:56.628+0000 7f64e21b9640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:17:56.631 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:56.630+0000 7f64e21b9640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:17:56.632 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:56.631+0000 7f64e21b9640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:17:56.633 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:56.632+0000 7f64e21b9640 -1 bdev(0x558c28dbfc00 td/osd-backfill-stats/1/block) open stat got: (1) Operation not permitted 2024-09-16T05:17:56.633 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:17:56.632+0000 7f64e21b9640 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-09-16T05:18:02.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-09-16T05:18:02.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:18:02.630 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T05:18:02.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T05:18:02.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:18:03.195 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T05:18:03.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T05:18:03.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:18:03.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:18:03.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:18:03.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:18:03.225 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:03.224+0000 7fda6fdcc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:18:03.242 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:03.241+0000 7fda6fdcc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:18:03.243 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:03.242+0000 7fda6fdcc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:18:03.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T05:18:03.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:18:03.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T05:18:03.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:18:03.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:18:03.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:03.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:18:03.673 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:18:03.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:03.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:04.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:04.832 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:04.831+0000 7fda6fdcc640 -1 Falling back to public interface 2024-09-16T05:18:05.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:05.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:05.108 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:18:05.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:18:05.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:05.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:05.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:06.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:06.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:06.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:18:06.561 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:18:06.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:06.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:07.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:07.689 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:07.688+0000 7fda6fdcc640 -1 osd.1 0 log_to_monitors true 2024-09-16T05:18:08.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:08.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:08.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:18:08.045 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:18:08.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:08.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:08.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:09.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:09.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:09.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:18:09.555 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:18:09.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:09.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:09.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:10.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:10.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:10.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:18:10.973 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:18:10.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:10.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:11.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:12.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:12.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:12.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:18:12.540 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:18:12.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:12.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:13.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:14.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:14.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:14.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:18:14.017 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:18:14.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:14.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:14.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:15.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:15.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:15.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:18:15.508 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:18:15.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:15.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:15.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:16.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:16.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:16.931 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:18:16.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:18:16.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:16.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:17.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:18.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:18.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:18.362 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:18:18.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:18:18.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:18.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:18.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:19.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:19.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:19.927 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:18:19.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:18:19.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:19.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:20.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:21.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:21.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:21.488 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:18:21.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:18:21.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:21.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:22.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:23.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:23.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:23.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:18:23.315 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:18:23.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:23.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:24.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:25.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:25.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:25.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:18:25.358 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:18:25.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:25.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:26.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:27.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:27.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:18:27.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:18:27.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:27.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:28.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:29.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:29.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:29.192 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:18:29.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:18:29.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:29.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:30.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:31.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:31.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:31.245 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:18:31.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:18:31.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:31.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:18:31.765 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1303670712,v1:127.0.0.1:6811/1303670712] [v2:127.0.0.1:6812/1303670712,v1:127.0.0.1:6813/1303670712] exists,up f57941a7-7faa-46c6-aff0-ff6685f4d4be 2024-09-16T05:18:31.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:18:31.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:18:31.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:18:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:236: TEST_backfill_out: run_osd td/osd-backfill-stats 2 2024-09-16T05:18:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:18:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:18:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T05:18:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:18:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/2 2024-09-16T05:18:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:18:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:18:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:18:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:18:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-09-16T05:18:31.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-09-16T05:18:31.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:18:31.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:18:31.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:18:31.771 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:18:31.771 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:18:31.771 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:18:31.771 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:18:31.771 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:18:31.771 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:18:31.771 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:18:31.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:18:31.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/2 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:18:31.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ccfe81ce-8f37-46c1-8fcb-e23e464de339 2024-09-16T05:18:31.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 ccfe81ce-8f37-46c1-8fcb-e23e464de339' 2024-09-16T05:18:31.773 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 ccfe81ce-8f37-46c1-8fcb-e23e464de339 2024-09-16T05:18:31.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:18:31.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCnv+dmq877LhAApQGbAeAuL21Y48h8HGpKVA== 2024-09-16T05:18:31.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCnv+dmq877LhAApQGbAeAuL21Y48h8HGpKVA=="}' 2024-09-16T05:18:31.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ccfe81ce-8f37-46c1-8fcb-e23e464de339 -i td/osd-backfill-stats/2/new.json 2024-09-16T05:18:32.354 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:18:32.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/2/new.json 2024-09-16T05:18:32.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCnv+dmq877LhAApQGbAeAuL21Y48h8HGpKVA== --osd-uuid ccfe81ce-8f37-46c1-8fcb-e23e464de339 2024-09-16T05:18:32.398 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:32.397+0000 7f8643618640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:18:32.400 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:32.399+0000 7f8643618640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:18:32.401 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:32.400+0000 7f8643618640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:18:32.401 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:32.401+0000 7f8643618640 -1 bdev(0x555bd439fc00 td/osd-backfill-stats/2/block) open stat got: (1) Operation not permitted 2024-09-16T05:18:32.401 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:32.401+0000 7f8643618640 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-09-16T05:18:38.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-09-16T05:18:38.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:18:38.229 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T05:18:38.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T05:18:38.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:18:38.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T05:18:38.796 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T05:18:38.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:18:38.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:18:38.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:18:38.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:18:38.825 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:38.824+0000 7fb75c026640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:18:38.827 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:38.826+0000 7fb75c026640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:18:38.828 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:38.827+0000 7fb75c026640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:18:39.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T05:18:39.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:18:39.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T05:18:39.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:18:39.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:18:39.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:39.234 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:18:39.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:18:39.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:39.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:39.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:39.673 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:39.672+0000 7fb75c026640 -1 Falling back to public interface 2024-09-16T05:18:40.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:40.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:40.661 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:18:40.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:18:40.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:40.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:41.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:42.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:42.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:18:42.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:18:42.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:42.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:42.472 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:18:42.471+0000 7fb75c026640 -1 osd.2 0 log_to_monitors true 2024-09-16T05:18:42.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:43.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:43.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:43.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:18:43.523 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:18:43.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:43.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:43.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:44.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:44.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:44.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:18:44.963 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:18:44.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:44.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:45.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:46.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:46.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:46.519 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:18:46.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:18:46.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:46.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:46.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:47.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:47.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:47.993 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:18:47.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:18:47.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:47.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:48.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:49.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:49.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:49.493 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:18:49.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:18:49.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:49.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:49.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:50.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:50.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:50.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:18:50.955 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:18:50.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:50.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:51.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:52.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:52.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:52.438 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:18:52.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:18:52.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:52.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:52.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:53.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:53.886 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:18:53.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:53.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:18:53.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:53.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:54.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:55.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:55.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:55.454 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:18:55.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:18:55.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:55.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:56.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:57.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:57.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:57.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:18:57.140 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:18:57.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:57.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:57.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:18:58.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:18:58.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:18:58.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:18:58.851 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:18:58.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:18:58.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:18:59.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:00.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:00.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:19:00.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:19:00.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:00.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:19:01.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:02.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:02.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:02.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:19:02.503 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:19:02.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:02.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:19:03.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:04.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:04.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:04.549 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:19:04.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:19:04.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:04.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:19:04.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:05.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:05.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:05.969 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:19:05.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:19:05.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:05.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:19:06.421 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1222777985,v1:127.0.0.1:6819/1222777985] [v2:127.0.0.1:6820/1222777985,v1:127.0.0.1:6821/1222777985] exists,up ccfe81ce-8f37-46c1-8fcb-e23e464de339 2024-09-16T05:19:06.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:19:06.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:19:06.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:19:06.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:237: TEST_backfill_out: run_osd td/osd-backfill-stats 3 2024-09-16T05:19:06.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:19:06.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:19:06.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T05:19:06.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:19:06.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/3 2024-09-16T05:19:06.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:19:06.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:19:06.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:19:06.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:19:06.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/3 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:19:06.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9aca2998-2049-4a74-a3cc-5160b7bae03f 2024-09-16T05:19:06.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 9aca2998-2049-4a74-a3cc-5160b7bae03f' 2024-09-16T05:19:06.428 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 9aca2998-2049-4a74-a3cc-5160b7bae03f 2024-09-16T05:19:06.428 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:19:06.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDKv+dmJlZ1GhAAutKMG2yOITTS6NIN+gatsA== 2024-09-16T05:19:06.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDKv+dmJlZ1GhAAutKMG2yOITTS6NIN+gatsA=="}' 2024-09-16T05:19:06.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9aca2998-2049-4a74-a3cc-5160b7bae03f -i td/osd-backfill-stats/3/new.json 2024-09-16T05:19:06.932 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:19:06.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/3/new.json 2024-09-16T05:19:06.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDKv+dmJlZ1GhAAutKMG2yOITTS6NIN+gatsA== --osd-uuid 9aca2998-2049-4a74-a3cc-5160b7bae03f 2024-09-16T05:19:06.977 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:06.975+0000 7fc7c4624640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:19:06.987 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:06.987+0000 7fc7c4624640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:19:06.989 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:06.988+0000 7fc7c4624640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:19:06.989 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:06.988+0000 7fc7c4624640 -1 bdev(0x5610f0469c00 td/osd-backfill-stats/3/block) open stat got: (1) Operation not permitted 2024-09-16T05:19:06.990 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:06.988+0000 7fc7c4624640 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-09-16T05:19:13.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-09-16T05:19:13.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:19:13.229 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T05:19:13.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T05:19:13.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:19:13.797 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T05:19:13.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T05:19:13.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:19:13.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:19:13.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:19:13.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:19:13.827 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:13.826+0000 7f5918d58640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:19:13.829 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:13.828+0000 7f5918d58640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:19:13.830 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:13.829+0000 7f5918d58640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:19:14.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T05:19:14.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:19:14.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T05:19:14.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:19:14.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:19:14.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:14.240 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:19:14.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:19:14.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:14.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:14.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:15.176 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:15.175+0000 7f5918d58640 -1 Falling back to public interface 2024-09-16T05:19:15.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:15.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:15.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:19:15.683 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:19:15.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:15.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:16.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:17.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:17.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:17.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:19:17.118 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:19:17.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:17.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:17.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:18.322 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:18.321+0000 7f5918d58640 -1 osd.3 0 log_to_monitors true 2024-09-16T05:19:18.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:18.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:18.562 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:19:18.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:19:18.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:18.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:19.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:20.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:20.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:20.115 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:19:20.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:19:20.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:20.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:20.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:21.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:21.552 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:21.552 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:19:21.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:19:21.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:21.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:21.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:22.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:22.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:22.970 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:19:22.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:19:22.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:22.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:23.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:24.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:24.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:24.385 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:19:24.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:19:24.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:24.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:24.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:25.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:25.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:25.889 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:19:25.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:19:25.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:25.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:26.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:27.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:27.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:27.316 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:19:27.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:19:27.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:27.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:27.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:28.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:28.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:28.748 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:19:28.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:19:28.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:28.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:29.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:30.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:30.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:30.258 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:19:30.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:19:30.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:30.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:30.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:31.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:31.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:31.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:19:31.836 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:19:31.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:31.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:32.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:33.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:33.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:33.874 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:19:33.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:19:33.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:33.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:34.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:35.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:35.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:35.585 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:19:35.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:19:35.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:35.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:36.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:37.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:37.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:37.511 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:19:37.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:19:37.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:37.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:38.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:39.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:39.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:39.221 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:19:39.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:19:39.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:39.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:40.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:41.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:41.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:41.014 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:19:41.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:19:41.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:41.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:19:41.433 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2681229653,v1:127.0.0.1:6827/2681229653] [v2:127.0.0.1:6828/2681229653,v1:127.0.0.1:6829/2681229653] exists,up 9aca2998-2049-4a74-a3cc-5160b7bae03f 2024-09-16T05:19:41.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:19:41.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:19:41.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:19:41.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:238: TEST_backfill_out: run_osd td/osd-backfill-stats 4 2024-09-16T05:19:41.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:19:41.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:19:41.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T05:19:41.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:19:41.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/4 2024-09-16T05:19:41.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:19:41.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:19:41.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:19:41.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:19:41.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-09-16T05:19:41.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-09-16T05:19:41.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:19:41.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:19:41.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:19:41.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:19:41.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:19:41.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:19:41.440 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:19:41.440 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:19:41.440 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:19:41.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:19:41.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:19:41.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:19:41.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:19:41.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:19:41.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:19:41.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:19:41.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:19:41.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:19:41.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:19:41.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:19:41.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:19:41.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:19:41.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/4 2024-09-16T05:19:41.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:19:41.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e90de375-be93-4acc-92ac-970cd842637c 2024-09-16T05:19:41.442 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 e90de375-be93-4acc-92ac-970cd842637c 2024-09-16T05:19:41.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 e90de375-be93-4acc-92ac-970cd842637c' 2024-09-16T05:19:41.443 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:19:41.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDtv+dmKNk6GxAAj1IirzDRdg+p6cI6obRu+w== 2024-09-16T05:19:41.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDtv+dmKNk6GxAAj1IirzDRdg+p6cI6obRu+w=="}' 2024-09-16T05:19:41.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e90de375-be93-4acc-92ac-970cd842637c -i td/osd-backfill-stats/4/new.json 2024-09-16T05:19:42.035 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:19:42.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/4/new.json 2024-09-16T05:19:42.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDtv+dmKNk6GxAAj1IirzDRdg+p6cI6obRu+w== --osd-uuid e90de375-be93-4acc-92ac-970cd842637c 2024-09-16T05:19:42.079 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:42.078+0000 7fa0e2d4f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:19:42.106 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:42.106+0000 7fa0e2d4f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:19:42.107 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:42.107+0000 7fa0e2d4f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:19:42.108 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:42.107+0000 7fa0e2d4f640 -1 bdev(0x56139bfc9c00 td/osd-backfill-stats/4/block) open stat got: (1) Operation not permitted 2024-09-16T05:19:42.108 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:42.107+0000 7fa0e2d4f640 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-09-16T05:19:48.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-09-16T05:19:48.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:19:48.069 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T05:19:48.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T05:19:48.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:19:48.630 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T05:19:48.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T05:19:48.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:19:48.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:19:48.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:19:48.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:19:48.659 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:48.658+0000 7fe0f401e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:19:48.670 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:48.669+0000 7fe0f401e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:19:48.671 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:48.670+0000 7fe0f401e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:19:49.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T05:19:49.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:19:49.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T05:19:49.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:19:49.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:19:49.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:49.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:19:49.093 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:19:49.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:49.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:19:49.519 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:49.519+0000 7fe0f401e640 -1 Falling back to public interface 2024-09-16T05:19:49.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:50.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:50.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:50.529 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:19:50.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:19:50.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:50.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:19:50.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:51.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:51.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:51.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:19:51.971 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:19:51.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:51.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:19:52.190 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:19:52.189+0000 7fe0f401e640 -1 osd.4 0 log_to_monitors true 2024-09-16T05:19:52.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:53.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:53.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:53.395 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:19:53.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:19:53.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:53.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:19:53.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:54.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:54.810 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:19:54.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:54.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:19:54.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:54.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:19:55.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:56.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:56.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:56.370 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:19:56.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:19:56.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:56.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:19:56.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:57.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:57.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:57.866 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:19:57.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:19:57.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:57.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:19:58.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:19:59.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:19:59.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:19:59.353 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:19:59.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:19:59.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:19:59.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:19:59.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:00.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:00.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:00.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:20:00.806 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:20:00.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:00.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:20:01.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:02.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:02.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:02.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:20:02.291 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:20:02.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:02.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:20:02.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:03.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:03.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:03.711 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:20:03.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:20:03.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:03.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:20:04.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:05.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:05.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:05.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:20:05.200 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:20:05.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:05.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:20:06.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:07.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:07.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:07.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:20:07.027 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:20:07.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:07.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:20:07.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:08.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:08.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:08.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:20:08.649 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:20:08.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:08.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:20:09.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:10.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:10.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:10.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:20:10.401 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:20:10.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:10.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:20:11.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:12.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:12.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:12.673 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:20:12.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:20:12.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:12.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:20:13.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:14.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:14.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:14.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:20:14.542 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:20:14.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:14.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:20:15.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:16.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:16.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:16.523 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:20:16.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:20:16.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:16.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:20:17.003 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2223893773,v1:127.0.0.1:6835/2223893773] [v2:127.0.0.1:6836/2223893773,v1:127.0.0.1:6837/2223893773] exists,up e90de375-be93-4acc-92ac-970cd842637c 2024-09-16T05:20:17.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:20:17.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:20:17.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:20:17.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:239: TEST_backfill_out: run_osd td/osd-backfill-stats 5 2024-09-16T05:20:17.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:20:17.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:20:17.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T05:20:17.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:20:17.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/5 2024-09-16T05:20:17.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:20:17.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:20:17.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:20:17.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:20:17.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-09-16T05:20:17.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-09-16T05:20:17.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:20:17.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:20:17.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:20:17.011 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:20:17.011 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:20:17.011 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:20:17.011 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:20:17.011 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:20:17.011 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:20:17.012 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:20:17.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:20:17.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:20:17.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:20:17.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:20:17.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:20:17.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:20:17.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:20:17.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:20:17.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:20:17.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:20:17.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:20:17.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:20:17.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/5 2024-09-16T05:20:17.013 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:20:17.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2182059b-5b55-44d4-a38c-146fc8c2d616 2024-09-16T05:20:17.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 2182059b-5b55-44d4-a38c-146fc8c2d616' 2024-09-16T05:20:17.013 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 2182059b-5b55-44d4-a38c-146fc8c2d616 2024-09-16T05:20:17.014 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:20:17.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQARwOdmB1+SARAAO5VFaedU3FUhBbioGByghQ== 2024-09-16T05:20:17.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQARwOdmB1+SARAAO5VFaedU3FUhBbioGByghQ=="}' 2024-09-16T05:20:17.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2182059b-5b55-44d4-a38c-146fc8c2d616 -i td/osd-backfill-stats/5/new.json 2024-09-16T05:20:17.524 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:20:17.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/5/new.json 2024-09-16T05:20:17.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQARwOdmB1+SARAAO5VFaedU3FUhBbioGByghQ== --osd-uuid 2182059b-5b55-44d4-a38c-146fc8c2d616 2024-09-16T05:20:17.568 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:20:17.567+0000 7f3b5ddb2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:20:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:20:17.619+0000 7f3b5ddb2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:20:17.620 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:20:17.620+0000 7f3b5ddb2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:20:17.621 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:20:17.620+0000 7f3b5ddb2640 -1 bdev(0x55cbcb963c00 td/osd-backfill-stats/5/block) open stat got: (1) Operation not permitted 2024-09-16T05:20:17.621 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:20:17.620+0000 7f3b5ddb2640 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-09-16T05:20:23.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-09-16T05:20:23.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:20:23.596 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T05:20:23.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T05:20:23.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:20:24.165 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T05:20:24.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T05:20:24.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:20:24.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:20:24.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:20:24.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:20:24.195 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:20:24.194+0000 7fa763619640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:20:24.197 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:20:24.197+0000 7fa763619640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:20:24.198 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:20:24.198+0000 7fa763619640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:20:24.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T05:20:24.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:20:24.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T05:20:24.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:20:24.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:20:24.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:24.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:20:24.615 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:20:24.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:24.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:25.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:25.300 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:20:25.299+0000 7fa763619640 -1 Falling back to public interface 2024-09-16T05:20:26.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:26.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:26.050 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:20:26.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:20:26.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:26.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:26.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:27.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:27.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:27.493 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:20:27.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:20:27.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:27.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:27.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:28.380 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:20:28.378+0000 7fa763619640 -1 osd.5 0 log_to_monitors true 2024-09-16T05:20:28.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:28.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:28.910 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:20:28.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:20:28.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:28.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:29.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:30.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:30.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:30.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:20:30.510 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:20:30.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:30.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:31.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:32.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:32.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:32.051 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:20:32.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:20:32.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:32.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:32.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:33.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:33.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:33.568 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:20:33.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:20:33.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:33.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:34.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:35.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:35.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:35.032 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:20:35.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:20:35.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:35.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:35.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:36.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:36.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:36.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:20:36.454 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:20:36.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:36.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:36.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:37.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:37.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:37.993 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:20:37.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:20:37.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:37.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:38.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:39.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:39.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:39.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:20:39.414 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:20:39.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:39.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:39.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:40.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:40.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:40.831 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:20:40.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:20:40.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:40.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:41.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:42.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:42.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:42.347 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:20:42.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:20:42.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:42.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:43.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:44.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:44.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:44.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:20:44.134 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:20:44.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:44.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:45.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:46.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:46.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:46.339 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:20:46.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:20:46.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:46.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:47.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:48.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:48.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:48.341 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:20:48.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:20:48.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:48.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:48.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:49.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:49.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:49.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:20:49.923 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:20:49.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:49.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:50.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:20:51.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:20:51.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:20:51.944 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:20:51.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:20:51.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:20:51.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:20:52.417 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3372930355,v1:127.0.0.1:6843/3372930355] [v2:127.0.0.1:6844/3372930355,v1:127.0.0.1:6845/3372930355] exists,up 2182059b-5b55-44d4-a38c-146fc8c2d616 2024-09-16T05:20:52.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:20:52.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:20:52.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:20:52.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:241: TEST_backfill_out: create_pool test 1 1 2024-09-16T05:20:52.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2024-09-16T05:20:52.981 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T05:20:52.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T05:20:53.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:242: TEST_backfill_out: ceph osd pool set test size 2 2024-09-16T05:20:54.935 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 2 2024-09-16T05:20:54.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:243: TEST_backfill_out: sleep 5 2024-09-16T05:20:59.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:245: TEST_backfill_out: wait_for_clean 2024-09-16T05:20:59.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:20:59.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:20:59.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:20:59.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:20:59.950 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:20:59.950 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:20:59.950 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:20:59.950 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:20:59.950 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:21:00.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:21:00.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:21:00.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:21:00.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:21:00.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:21:00.053 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:21:00.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:21:00.493 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:21:00.493 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:21:00.493 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:21:00.493 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T05:21:00.493 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T05:21:00.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:21:00.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:21:00.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:21:00.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836523 2024-09-16T05:21:00.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836523 2024-09-16T05:21:00.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523' 2024-09-16T05:21:00.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:21:00.611 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:21:00.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672995 2024-09-16T05:21:00.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672995 2024-09-16T05:21:00.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672995' 2024-09-16T05:21:00.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:21:00.750 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:21:00.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509469 2024-09-16T05:21:00.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509469 2024-09-16T05:21:00.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672995 2-64424509469' 2024-09-16T05:21:00.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:21:00.869 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:21:00.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345942 2024-09-16T05:21:00.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345942 2024-09-16T05:21:00.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672995 2-64424509469 3-85899345942' 2024-09-16T05:21:00.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:21:00.987 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:21:01.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182421 2024-09-16T05:21:01.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182421 2024-09-16T05:21:01.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672995 2-64424509469 3-85899345942 4-107374182421' 2024-09-16T05:21:01.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:21:01.105 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T05:21:01.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018888 2024-09-16T05:21:01.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018888 2024-09-16T05:21:01.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836523 1-42949672995 2-64424509469 3-85899345942 4-107374182421 5-128849018888' 2024-09-16T05:21:01.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:21:01.223 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836523 2024-09-16T05:21:01.223 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:21:01.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:21:01.224 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836523 2024-09-16T05:21:01.224 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:21:01.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836523 2024-09-16T05:21:01.226 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836523 2024-09-16T05:21:01.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836523' 2024-09-16T05:21:01.226 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:21:01.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836520 -lt 21474836523 2024-09-16T05:21:01.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T05:21:02.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T05:21:02.671 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:21:03.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836523 -lt 21474836523 2024-09-16T05:21:03.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:21:03.121 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672995 2024-09-16T05:21:03.121 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:21:03.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:21:03.123 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672995 2024-09-16T05:21:03.123 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:21:03.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672995 2024-09-16T05:21:03.124 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672995 2024-09-16T05:21:03.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672995' 2024-09-16T05:21:03.124 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:21:03.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672995 -lt 42949672995 2024-09-16T05:21:03.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:21:03.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509469 2024-09-16T05:21:03.557 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:21:03.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:21:03.558 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509469 2024-09-16T05:21:03.558 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:21:03.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509469 2024-09-16T05:21:03.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509469' 2024-09-16T05:21:03.559 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509469 2024-09-16T05:21:03.560 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:21:03.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509470 -lt 64424509469 2024-09-16T05:21:03.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:21:03.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345942 2024-09-16T05:21:03.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:21:03.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:21:03.967 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345942 2024-09-16T05:21:03.968 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:21:03.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345942 2024-09-16T05:21:03.969 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345942 2024-09-16T05:21:03.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345942' 2024-09-16T05:21:03.969 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:21:04.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345943 -lt 85899345942 2024-09-16T05:21:04.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:21:04.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182421 2024-09-16T05:21:04.417 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:21:04.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:21:04.418 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182421 2024-09-16T05:21:04.419 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:21:04.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182421 2024-09-16T05:21:04.420 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182421 2024-09-16T05:21:04.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182421' 2024-09-16T05:21:04.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:21:04.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182422 -lt 107374182421 2024-09-16T05:21:04.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:21:04.868 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018888 2024-09-16T05:21:04.868 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:21:04.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T05:21:04.869 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018888 2024-09-16T05:21:04.869 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:21:04.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018888 2024-09-16T05:21:04.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018888' 2024-09-16T05:21:04.871 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018888 2024-09-16T05:21:04.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T05:21:05.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018889 -lt 128849018888 2024-09-16T05:21:05.295 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:21:05.295 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:05.295 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:05.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:21:05.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:05.866 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:05.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:05.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:05.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:05.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:05.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:06.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:21:06.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:06.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:06.276 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:06.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:21:06.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:21:06.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:21:06.890 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: seq 1 200 2024-09-16T05:21:06.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:06.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj1 /dev/null 2024-09-16T05:21:07.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:07.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj2 /dev/null 2024-09-16T05:21:07.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:07.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj3 /dev/null 2024-09-16T05:21:07.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:07.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj4 /dev/null 2024-09-16T05:21:07.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:07.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj5 /dev/null 2024-09-16T05:21:07.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:07.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj6 /dev/null 2024-09-16T05:21:07.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:07.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj7 /dev/null 2024-09-16T05:21:07.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:07.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj8 /dev/null 2024-09-16T05:21:07.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:07.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj9 /dev/null 2024-09-16T05:21:07.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:07.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj10 /dev/null 2024-09-16T05:21:07.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:07.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj11 /dev/null 2024-09-16T05:21:08.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:08.050 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj12 /dev/null 2024-09-16T05:21:08.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:08.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj13 /dev/null 2024-09-16T05:21:08.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:08.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj14 /dev/null 2024-09-16T05:21:08.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:08.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj15 /dev/null 2024-09-16T05:21:08.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:08.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj16 /dev/null 2024-09-16T05:21:08.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:08.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj17 /dev/null 2024-09-16T05:21:08.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:08.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj18 /dev/null 2024-09-16T05:21:08.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:08.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj19 /dev/null 2024-09-16T05:21:08.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:08.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj20 /dev/null 2024-09-16T05:21:09.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:09.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj21 /dev/null 2024-09-16T05:21:09.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:09.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj22 /dev/null 2024-09-16T05:21:09.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:09.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj23 /dev/null 2024-09-16T05:21:09.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:09.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj24 /dev/null 2024-09-16T05:21:09.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:09.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj25 /dev/null 2024-09-16T05:21:09.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:09.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj26 /dev/null 2024-09-16T05:21:09.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:09.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj27 /dev/null 2024-09-16T05:21:09.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:09.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj28 /dev/null 2024-09-16T05:21:09.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:09.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj29 /dev/null 2024-09-16T05:21:09.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:09.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj30 /dev/null 2024-09-16T05:21:10.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:10.058 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj31 /dev/null 2024-09-16T05:21:10.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:10.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj32 /dev/null 2024-09-16T05:21:10.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:10.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj33 /dev/null 2024-09-16T05:21:10.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:10.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj34 /dev/null 2024-09-16T05:21:10.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:10.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj35 /dev/null 2024-09-16T05:21:10.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:10.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj36 /dev/null 2024-09-16T05:21:10.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:10.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj37 /dev/null 2024-09-16T05:21:10.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:10.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj38 /dev/null 2024-09-16T05:21:10.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:10.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj39 /dev/null 2024-09-16T05:21:11.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:11.013 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj40 /dev/null 2024-09-16T05:21:11.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:11.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj41 /dev/null 2024-09-16T05:21:11.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:11.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj42 /dev/null 2024-09-16T05:21:11.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:11.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj43 /dev/null 2024-09-16T05:21:11.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:11.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj44 /dev/null 2024-09-16T05:21:11.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:11.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj45 /dev/null 2024-09-16T05:21:11.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:11.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj46 /dev/null 2024-09-16T05:21:11.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:11.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj47 /dev/null 2024-09-16T05:21:11.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:11.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj48 /dev/null 2024-09-16T05:21:11.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:11.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj49 /dev/null 2024-09-16T05:21:12.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:12.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj50 /dev/null 2024-09-16T05:21:12.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:12.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj51 /dev/null 2024-09-16T05:21:12.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:12.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj52 /dev/null 2024-09-16T05:21:12.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:12.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj53 /dev/null 2024-09-16T05:21:12.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:12.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj54 /dev/null 2024-09-16T05:21:12.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:12.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj55 /dev/null 2024-09-16T05:21:12.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:12.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj56 /dev/null 2024-09-16T05:21:12.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:12.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj57 /dev/null 2024-09-16T05:21:12.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:12.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj58 /dev/null 2024-09-16T05:21:13.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:13.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj59 /dev/null 2024-09-16T05:21:13.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:13.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj60 /dev/null 2024-09-16T05:21:13.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:13.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj61 /dev/null 2024-09-16T05:21:13.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:13.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj62 /dev/null 2024-09-16T05:21:13.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:13.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj63 /dev/null 2024-09-16T05:21:13.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:13.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj64 /dev/null 2024-09-16T05:21:13.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:13.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj65 /dev/null 2024-09-16T05:21:13.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:13.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj66 /dev/null 2024-09-16T05:21:14.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:14.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj67 /dev/null 2024-09-16T05:21:14.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:14.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj68 /dev/null 2024-09-16T05:21:14.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:14.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj69 /dev/null 2024-09-16T05:21:14.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:14.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj70 /dev/null 2024-09-16T05:21:14.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:14.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj71 /dev/null 2024-09-16T05:21:14.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:14.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj72 /dev/null 2024-09-16T05:21:14.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:14.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj73 /dev/null 2024-09-16T05:21:14.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:14.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj74 /dev/null 2024-09-16T05:21:15.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:15.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj75 /dev/null 2024-09-16T05:21:15.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:15.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj76 /dev/null 2024-09-16T05:21:15.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:15.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj77 /dev/null 2024-09-16T05:21:15.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:15.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj78 /dev/null 2024-09-16T05:21:15.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:15.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj79 /dev/null 2024-09-16T05:21:15.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:15.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj80 /dev/null 2024-09-16T05:21:15.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:15.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj81 /dev/null 2024-09-16T05:21:15.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:15.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj82 /dev/null 2024-09-16T05:21:15.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:15.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj83 /dev/null 2024-09-16T05:21:15.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:15.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj84 /dev/null 2024-09-16T05:21:16.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:16.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj85 /dev/null 2024-09-16T05:21:16.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:16.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj86 /dev/null 2024-09-16T05:21:16.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:16.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj87 /dev/null 2024-09-16T05:21:16.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:16.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj88 /dev/null 2024-09-16T05:21:16.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:16.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj89 /dev/null 2024-09-16T05:21:16.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:16.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj90 /dev/null 2024-09-16T05:21:16.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:16.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj91 /dev/null 2024-09-16T05:21:16.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:16.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj92 /dev/null 2024-09-16T05:21:16.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:16.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj93 /dev/null 2024-09-16T05:21:17.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:17.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj94 /dev/null 2024-09-16T05:21:17.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:17.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj95 /dev/null 2024-09-16T05:21:17.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:17.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj96 /dev/null 2024-09-16T05:21:17.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:17.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj97 /dev/null 2024-09-16T05:21:17.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:17.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj98 /dev/null 2024-09-16T05:21:17.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:17.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj99 /dev/null 2024-09-16T05:21:17.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:17.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj100 /dev/null 2024-09-16T05:21:17.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:17.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj101 /dev/null 2024-09-16T05:21:17.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:17.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj102 /dev/null 2024-09-16T05:21:17.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:18.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj103 /dev/null 2024-09-16T05:21:18.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:18.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj104 /dev/null 2024-09-16T05:21:18.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:18.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj105 /dev/null 2024-09-16T05:21:18.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:18.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj106 /dev/null 2024-09-16T05:21:18.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:18.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj107 /dev/null 2024-09-16T05:21:18.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:18.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj108 /dev/null 2024-09-16T05:21:18.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:18.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj109 /dev/null 2024-09-16T05:21:18.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:18.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj110 /dev/null 2024-09-16T05:21:18.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:18.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj111 /dev/null 2024-09-16T05:21:18.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:18.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj112 /dev/null 2024-09-16T05:21:19.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:19.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj113 /dev/null 2024-09-16T05:21:19.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:19.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj114 /dev/null 2024-09-16T05:21:19.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:19.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj115 /dev/null 2024-09-16T05:21:19.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:19.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj116 /dev/null 2024-09-16T05:21:19.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:19.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj117 /dev/null 2024-09-16T05:21:19.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:19.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj118 /dev/null 2024-09-16T05:21:19.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:19.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj119 /dev/null 2024-09-16T05:21:19.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:19.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj120 /dev/null 2024-09-16T05:21:19.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:19.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj121 /dev/null 2024-09-16T05:21:19.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:19.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj122 /dev/null 2024-09-16T05:21:20.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:20.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj123 /dev/null 2024-09-16T05:21:20.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:20.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj124 /dev/null 2024-09-16T05:21:20.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:20.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj125 /dev/null 2024-09-16T05:21:20.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:20.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj126 /dev/null 2024-09-16T05:21:20.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:20.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj127 /dev/null 2024-09-16T05:21:20.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:20.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj128 /dev/null 2024-09-16T05:21:20.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:20.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj129 /dev/null 2024-09-16T05:21:20.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:20.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj130 /dev/null 2024-09-16T05:21:20.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:20.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj131 /dev/null 2024-09-16T05:21:21.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:21.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj132 /dev/null 2024-09-16T05:21:21.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:21.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj133 /dev/null 2024-09-16T05:21:21.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:21.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj134 /dev/null 2024-09-16T05:21:21.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:21.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj135 /dev/null 2024-09-16T05:21:21.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:21.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj136 /dev/null 2024-09-16T05:21:21.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:21.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj137 /dev/null 2024-09-16T05:21:21.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:21.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj138 /dev/null 2024-09-16T05:21:21.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:21.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj139 /dev/null 2024-09-16T05:21:21.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:21.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj140 /dev/null 2024-09-16T05:21:22.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:22.024 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj141 /dev/null 2024-09-16T05:21:22.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:22.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj142 /dev/null 2024-09-16T05:21:22.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:22.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj143 /dev/null 2024-09-16T05:21:22.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:22.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj144 /dev/null 2024-09-16T05:21:22.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:22.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj145 /dev/null 2024-09-16T05:21:22.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:22.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj146 /dev/null 2024-09-16T05:21:22.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:22.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj147 /dev/null 2024-09-16T05:21:22.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:22.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj148 /dev/null 2024-09-16T05:21:22.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:22.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj149 /dev/null 2024-09-16T05:21:22.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:22.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj150 /dev/null 2024-09-16T05:21:23.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:23.062 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj151 /dev/null 2024-09-16T05:21:23.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:23.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj152 /dev/null 2024-09-16T05:21:23.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:23.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj153 /dev/null 2024-09-16T05:21:23.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:23.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj154 /dev/null 2024-09-16T05:21:23.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:23.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj155 /dev/null 2024-09-16T05:21:23.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:23.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj156 /dev/null 2024-09-16T05:21:23.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:23.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj157 /dev/null 2024-09-16T05:21:23.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:23.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj158 /dev/null 2024-09-16T05:21:23.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:23.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj159 /dev/null 2024-09-16T05:21:24.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:24.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj160 /dev/null 2024-09-16T05:21:24.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:24.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj161 /dev/null 2024-09-16T05:21:24.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:24.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj162 /dev/null 2024-09-16T05:21:24.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:24.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj163 /dev/null 2024-09-16T05:21:24.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:24.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj164 /dev/null 2024-09-16T05:21:24.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:24.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj165 /dev/null 2024-09-16T05:21:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj166 /dev/null 2024-09-16T05:21:24.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:24.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj167 /dev/null 2024-09-16T05:21:24.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:24.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj168 /dev/null 2024-09-16T05:21:25.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:25.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj169 /dev/null 2024-09-16T05:21:25.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:25.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj170 /dev/null 2024-09-16T05:21:25.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:25.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj171 /dev/null 2024-09-16T05:21:25.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:25.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj172 /dev/null 2024-09-16T05:21:25.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:25.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj173 /dev/null 2024-09-16T05:21:25.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:25.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj174 /dev/null 2024-09-16T05:21:25.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:25.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj175 /dev/null 2024-09-16T05:21:25.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:25.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj176 /dev/null 2024-09-16T05:21:25.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:25.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj177 /dev/null 2024-09-16T05:21:26.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:26.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj178 /dev/null 2024-09-16T05:21:26.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:26.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj179 /dev/null 2024-09-16T05:21:26.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:26.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj180 /dev/null 2024-09-16T05:21:26.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:26.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj181 /dev/null 2024-09-16T05:21:26.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:26.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj182 /dev/null 2024-09-16T05:21:26.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:26.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj183 /dev/null 2024-09-16T05:21:26.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:26.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj184 /dev/null 2024-09-16T05:21:26.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:26.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj185 /dev/null 2024-09-16T05:21:26.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:26.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj186 /dev/null 2024-09-16T05:21:27.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:27.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj187 /dev/null 2024-09-16T05:21:27.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:27.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj188 /dev/null 2024-09-16T05:21:27.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:27.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj189 /dev/null 2024-09-16T05:21:27.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:27.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj190 /dev/null 2024-09-16T05:21:27.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:27.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj191 /dev/null 2024-09-16T05:21:27.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:27.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj192 /dev/null 2024-09-16T05:21:27.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:27.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj193 /dev/null 2024-09-16T05:21:27.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:27.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj194 /dev/null 2024-09-16T05:21:27.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:27.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj195 /dev/null 2024-09-16T05:21:28.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:28.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj196 /dev/null 2024-09-16T05:21:28.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:28.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj197 /dev/null 2024-09-16T05:21:28.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:28.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj198 /dev/null 2024-09-16T05:21:28.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:28.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj199 /dev/null 2024-09-16T05:21:28.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:247: TEST_backfill_out: for i in $(seq 1 $objects) 2024-09-16T05:21:28.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:249: TEST_backfill_out: rados -p test put obj200 /dev/null 2024-09-16T05:21:28.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:252: TEST_backfill_out: get_pg test obj1 2024-09-16T05:21:28.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T05:21:28.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T05:21:28.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T05:21:28.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T05:21:29.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:252: TEST_backfill_out: local PG=1.0 2024-09-16T05:21:29.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:254: TEST_backfill_out: get_primary test obj1 2024-09-16T05:21:29.030 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:21:29.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:21:29.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:21:29.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:21:29.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:254: TEST_backfill_out: local primary=1 2024-09-16T05:21:29.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:256: TEST_backfill_out: ceph osd set nobackfill 2024-09-16T05:21:30.120 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is set 2024-09-16T05:21:30.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:257: TEST_backfill_out: get_not_primary test obj1 2024-09-16T05:21:30.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2024-09-16T05:21:30.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2024-09-16T05:21:30.133 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2024-09-16T05:21:30.133 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:21:30.133 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:21:30.133 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:21:30.133 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:21:30.546 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2024-09-16T05:21:30.546 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2024-09-16T05:21:30.546 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-09-16T05:21:31.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:257: TEST_backfill_out: ceph osd out osd.0 2024-09-16T05:21:31.613 INFO:tasks.workunit.client.0.smithi026.stderr:osd.0 is already out. 2024-09-16T05:21:31.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:258: TEST_backfill_out: sleep 2 2024-09-16T05:21:33.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:259: TEST_backfill_out: ceph osd unset nobackfill 2024-09-16T05:21:34.339 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is unset 2024-09-16T05:21:34.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:261: TEST_backfill_out: wait_for_clean 2024-09-16T05:21:34.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:21:34.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:21:34.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:21:34.351 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:21:34.352 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:21:34.352 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:21:34.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:21:34.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:21:34.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:21:34.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:21:34.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:21:34.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:21:34.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:21:34.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:21:34.444 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:21:35.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:21:35.108 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:21:35.109 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:21:35.109 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:21:35.109 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T05:21:35.109 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T05:21:35.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:21:35.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:21:35.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:21:35.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836532 2024-09-16T05:21:35.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836532 2024-09-16T05:21:35.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532' 2024-09-16T05:21:35.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:21:35.227 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:21:35.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673004 2024-09-16T05:21:35.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673004 2024-09-16T05:21:35.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673004' 2024-09-16T05:21:35.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:21:35.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:21:35.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509478 2024-09-16T05:21:35.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509478 2024-09-16T05:21:35.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673004 2-64424509478' 2024-09-16T05:21:35.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:21:35.468 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:21:35.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345951 2024-09-16T05:21:35.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345951 2024-09-16T05:21:35.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673004 2-64424509478 3-85899345951' 2024-09-16T05:21:35.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:21:35.585 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:21:35.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182430 2024-09-16T05:21:35.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182430 2024-09-16T05:21:35.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673004 2-64424509478 3-85899345951 4-107374182430' 2024-09-16T05:21:35.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:21:35.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T05:21:35.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018897 2024-09-16T05:21:35.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018897 2024-09-16T05:21:35.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673004 2-64424509478 3-85899345951 4-107374182430 5-128849018897' 2024-09-16T05:21:35.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:21:35.843 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836532 2024-09-16T05:21:35.843 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:21:35.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:21:35.844 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836532 2024-09-16T05:21:35.845 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:21:35.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836532 2024-09-16T05:21:35.846 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836532 2024-09-16T05:21:35.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836532' 2024-09-16T05:21:35.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:21:36.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836532 -lt 21474836532 2024-09-16T05:21:36.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:21:36.252 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673004 2024-09-16T05:21:36.253 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:21:36.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:21:36.254 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673004 2024-09-16T05:21:36.254 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:21:36.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673004 2024-09-16T05:21:36.255 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673004 2024-09-16T05:21:36.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673004' 2024-09-16T05:21:36.255 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:21:36.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673004 -lt 42949673004 2024-09-16T05:21:36.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:21:36.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509478 2024-09-16T05:21:36.725 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:21:36.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:21:36.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509478 2024-09-16T05:21:36.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:21:36.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509478 2024-09-16T05:21:36.727 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509478 2024-09-16T05:21:36.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509478' 2024-09-16T05:21:36.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:21:37.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509478 -lt 64424509478 2024-09-16T05:21:37.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:21:37.142 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345951 2024-09-16T05:21:37.142 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:21:37.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:21:37.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345951 2024-09-16T05:21:37.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:21:37.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345951 2024-09-16T05:21:37.144 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345951 2024-09-16T05:21:37.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345951' 2024-09-16T05:21:37.145 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:21:37.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345951 -lt 85899345951 2024-09-16T05:21:37.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:21:37.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182430 2024-09-16T05:21:37.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:21:37.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:21:37.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182430 2024-09-16T05:21:37.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:21:37.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182430 2024-09-16T05:21:37.602 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182430 2024-09-16T05:21:37.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182430' 2024-09-16T05:21:37.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:21:38.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182431 -lt 107374182430 2024-09-16T05:21:38.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:21:38.122 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018897 2024-09-16T05:21:38.122 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:21:38.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T05:21:38.123 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018897 2024-09-16T05:21:38.124 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:21:38.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018897 2024-09-16T05:21:38.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018897' 2024-09-16T05:21:38.125 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018897 2024-09-16T05:21:38.125 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T05:21:38.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018898 -lt 128849018897 2024-09-16T05:21:38.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:21:38.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:38.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:39.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:21:39.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:39.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:39.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:39.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:39.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:39.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:39.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:39.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:21:39.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:39.531 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:39.531 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:40.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:21:40.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T05:21:40.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T05:21:40.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T05:21:40.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:21:40.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:21:40.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:21:40.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:40.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:40.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:40.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:40.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:40.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:40.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:40.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:21:40.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:40.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:40.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:41.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:21:41.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:21:41.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:21:41.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:21:41.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:21:41.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:21:41.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:21:41.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:21:41.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:21:41.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=2 2024-09-16T05:21:41.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 2 '!=' null 2024-09-16T05:21:41.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:21:41.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:21:41.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:21:42.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:21:42.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:42.045 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:42.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:42.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:42.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:42.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:42.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:42.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:21:42.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:42.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:42.441 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:43.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:21:43.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:21:43.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:21:43.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:21:43.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:21:43.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:21:43.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:21:43.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:21:43.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:21:43.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=2 2024-09-16T05:21:43.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 2 '!=' null 2024-09-16T05:21:43.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:21:43.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:21:43.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:21:43.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:21:43.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:43.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:43.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:43.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:43.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:43.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:43.767 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:44.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:21:44.184 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:44.184 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:44.184 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:44.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:21:44.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:21:44.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:21:44.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:21:44.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:21:44.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:21:44.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:21:44.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:21:44.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:21:45.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=8 2024-09-16T05:21:45.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 8 '!=' null 2024-09-16T05:21:45.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:21:45.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:21:45.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:21:45.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:21:45.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:45.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:45.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:45.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:45.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:45.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:45.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:46.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:21:46.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:46.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:46.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:46.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:21:46.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:21:46.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:21:46.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:21:46.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:21:46.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:21:46.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:21:46.816 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:21:46.816 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:21:47.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:21:47.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:21:47.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:21:47.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:21:47.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:21:47.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:21:47.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:47.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:47.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:47.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:47.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:47.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:47.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:47.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:21:47.930 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:47.930 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:47.930 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:48.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:21:48.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:21:48.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:21:48.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:21:48.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:21:48.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:21:48.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:21:48.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:21:48.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:21:49.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=11 2024-09-16T05:21:49.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 11 '!=' null 2024-09-16T05:21:49.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:21:49.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:21:49.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:21:49.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:21:49.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:49.167 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:49.167 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:49.168 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:49.168 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:49.168 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:49.168 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:49.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:21:49.622 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:49.622 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:49.622 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:50.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:21:50.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:21:50.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:21:50.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:21:50.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:21:50.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:21:50.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:21:50.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:21:50.223 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:21:50.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=10 2024-09-16T05:21:50.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 10 '!=' null 2024-09-16T05:21:50.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:21:50.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:21:50.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:21:50.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:21:50.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:50.991 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:50.991 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:50.992 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:50.992 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:50.992 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:50.992 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:51.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:21:51.388 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:51.388 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:51.388 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:51.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:21:51.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:21:51.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:21:51.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:21:51.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:21:51.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:21:51.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:21:51.981 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:21:51.981 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:21:52.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=12 2024-09-16T05:21:52.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 12 '!=' null 2024-09-16T05:21:52.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:21:52.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:21:52.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:21:52.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:21:52.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:52.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:52.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:52.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:52.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:52.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:52.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:53.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:21:53.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:53.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:53.031 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:53.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:21:53.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:21:53.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:21:53.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:21:53.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:21:53.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:21:53.594 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:21:53.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:21:53.594 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:21:54.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=14 2024-09-16T05:21:54.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 14 '!=' null 2024-09-16T05:21:54.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:21:54.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:21:54.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:21:54.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:21:54.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:54.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:54.260 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:54.260 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:54.260 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:54.260 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:54.260 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:54.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:21:54.662 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:54.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:54.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:55.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:21:55.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:21:55.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:21:55.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:21:55.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:21:55.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:21:55.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:21:55.215 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:21:55.215 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:21:55.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=14 2024-09-16T05:21:55.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 14 '!=' null 2024-09-16T05:21:55.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:21:55.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:21:55.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:21:55.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:21:55.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:55.920 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:55.920 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:55.920 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:55.920 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:55.921 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:55.921 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:56.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:21:56.316 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:56.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:56.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:56.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:21:56.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:21:56.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:21:56.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:21:56.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:21:56.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:21:56.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:21:56.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:21:56.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:21:57.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:21:57.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:21:57.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:21:57.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:21:57.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:21:57.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:21:57.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:21:57.542 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:21:57.542 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:21:57.542 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:21:57.543 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:21:57.543 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:21:57.543 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:21:57.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:21:57.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:21:57.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:21:57.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:21:58.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:21:58.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:21:58.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:21:58.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:263: TEST_backfill_out: check td/osd-backfill-stats 1.0 1 replicated 0 0 200 0 2024-09-16T05:21:58.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-09-16T05:21:58.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-09-16T05:21:58.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-09-16T05:21:58.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-09-16T05:21:58.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=0 2024-09-16T05:21:58.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-09-16T05:21:58.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=200 2024-09-16T05:21:58.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-09-16T05:21:58.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-09-16T05:21:58.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-09-16T05:21:58.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-09-16T05:21:58.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-09-16T05:21:58.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-09-16T05:21:58.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-09-16T05:21:58.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-09-16T05:21:58.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-09-16T05:21:58.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-09-16T05:21:58.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-09-16T05:21:58.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-09-16T05:21:58.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-09-16T05:21:58.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-09-16T05:21:58.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-09-16T05:21:58.522 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:21:58.522 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-09-16T05:21:58.522 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-09-16T05:21:58.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[1,2]/[1,0]' 2024-09-16T05:21:58.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[1,2]/[1,0]' ']' 2024-09-16T05:21:58.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-09-16T05:21:58.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:21:58.534 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:21:58.534 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [1,2]/[1,0] ' 2024-09-16T05:21:58.534 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-09-16T05:21:58.534 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-09-16T05:21:58.535 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:21:58.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=0 2024-09-16T05:21:58.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 0 ']' 2024-09-16T05:21:58.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 0 0 2024-09-16T05:21:58.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-09-16T05:21:58.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:21:58.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-09-16T05:21:58.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:21:58.540 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:21:58.540 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:21:58.540 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-09-16T05:21:58.541 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=0 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 0 ']' 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 0 0 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [1,2]/[1,0] ' 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-09-16T05:21:58.550 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-09-16T05:21:58.551 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:21:58.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=200 2024-09-16T05:21:58.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 200 ']' 2024-09-16T05:21:58.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 200 200 2024-09-16T05:21:58.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-09-16T05:21:58.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:21:58.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-09-16T05:21:58.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:21:58.554 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:21:58.554 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:21:58.555 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-09-16T05:21:58.555 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:21:58.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=1 2024-09-16T05:21:58.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 1 ']' 2024-09-16T05:21:58.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 1 0 2024-09-16T05:21:58.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-09-16T05:21:58.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:21:58.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:21:58.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:21:58.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-09-16T05:21:58.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:265: TEST_backfill_out: delete_pool test 2024-09-16T05:21:58.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T05:21:58.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T05:21:59.060 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T05:21:59.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:266: TEST_backfill_out: kill_daemons td/osd-backfill-stats 2024-09-16T05:21:59.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:21:59.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:21:59.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:21:59.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:21:59.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:22:04.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:22:04.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-09-16T05:22:04.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:22:04.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:22:04.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:22:04.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:22:04.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:22:04.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:22:04.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:22:04.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:22:04.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:22:04.398 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:22:04.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:22:04.400 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:22:04.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:22:04.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:22:04.401 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:22:04.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:22:04.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:22:04.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:22:04.403 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:22:04.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:22:04.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:22:04.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:22:04.444 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:22:04.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:22:04.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:22:04.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:22:04.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:22:04.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:22:04.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-09-16T05:22:04.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-09-16T05:22:04.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-stats 2024-09-16T05:22:04.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-stats 2024-09-16T05:22:04.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:22:04.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:22:04.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:22:04.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:22:04.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:22:04.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:22:04.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:22:04.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:22:04.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:22:04.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:22:04.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:22:04.450 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:22:04.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:22:04.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:22:04.451 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:22:04.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:22:04.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:22:04.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:22:04.453 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:22:04.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:22:04.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:22:04.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:22:04.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:22:04.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:22:04.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:22:04.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:22:04.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:22:04.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:22:04.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-stats 2024-09-16T05:22:04.459 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T05:22:04.459 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:22:04.459 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:22:04.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.478321 2024-09-16T05:22:04.461 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T05:22:04.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T05:22:04.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T05:22:04.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-09-16T05:22:04.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_out2 td/osd-backfill-stats 2024-09-16T05:22:04.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:329: TEST_backfill_out2: local dir=td/osd-backfill-stats 2024-09-16T05:22:04.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:331: TEST_backfill_out2: run_mon td/osd-backfill-stats a 2024-09-16T05:22:04.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-stats 2024-09-16T05:22:04.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T05:22:04.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T05:22:04.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T05:22:04.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-stats/a 2024-09-16T05:22:04.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-09-16T05:22:04.935 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T05:22:04.936 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:22:04.936 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:22:04.936 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:22:04.936 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:22:04.936 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:22:04.937 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:22:04.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T05:22:05.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T05:22:05.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T05:22:05.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:22:05.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:22:05.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T05:22:05.139 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T05:22:05.139 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:22:05.139 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:22:05.139 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:22:05.140 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:22:05.140 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:22:05.140 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:22:05.140 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:22:05.140 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:22:05.140 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get fsid 2024-09-16T05:22:05.232 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T05:22:05.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:22:05.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:22:05.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T05:22:05.233 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T05:22:05.234 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:22:05.234 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:22:05.234 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:22:05.234 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:22:05.234 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:22:05.234 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:22:05.234 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:22:05.235 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:22:05.235 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get mon_host 2024-09-16T05:22:05.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:332: TEST_backfill_out2: run_mgr td/osd-backfill-stats x 2024-09-16T05:22:05.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-stats 2024-09-16T05:22:05.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T05:22:05.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T05:22:05.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T05:22:05.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-stats/x 2024-09-16T05:22:05.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T05:22:06.178 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T05:22:06.179 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:22:06.179 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:22:06.179 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:22:06.179 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:22:06.179 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:22:06.179 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:22:06.179 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:22:06.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:22:06.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:333: TEST_backfill_out2: run_osd td/osd-backfill-stats 0 2024-09-16T05:22:06.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:22:06.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:22:06.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T05:22:06.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:22:06.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/0 2024-09-16T05:22:06.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:22:06.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:22:06.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:22:06.214 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/0 2024-09-16T05:22:06.215 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:22:06.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=242bd604-4342-40d5-a4a9-126d79610d5e 2024-09-16T05:22:06.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 242bd604-4342-40d5-a4a9-126d79610d5e' 2024-09-16T05:22:06.216 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 242bd604-4342-40d5-a4a9-126d79610d5e 2024-09-16T05:22:06.217 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:22:06.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB+wOdmcNDsDRAAZAGxej+7/SOFKzXwCs3fGg== 2024-09-16T05:22:06.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB+wOdmcNDsDRAAZAGxej+7/SOFKzXwCs3fGg=="}' 2024-09-16T05:22:06.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 242bd604-4342-40d5-a4a9-126d79610d5e -i td/osd-backfill-stats/0/new.json 2024-09-16T05:22:06.653 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:22:06.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/0/new.json 2024-09-16T05:22:06.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB+wOdmcNDsDRAAZAGxej+7/SOFKzXwCs3fGg== --osd-uuid 242bd604-4342-40d5-a4a9-126d79610d5e 2024-09-16T05:22:06.696 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:06.695+0000 7fb6db7a2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:22:06.698 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:06.697+0000 7fb6db7a2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:22:06.699 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:06.698+0000 7fb6db7a2640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:22:06.699 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:06.699+0000 7fb6db7a2640 -1 bdev(0x562707ea1c00 td/osd-backfill-stats/0/block) open stat got: (1) Operation not permitted 2024-09-16T05:22:06.700 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:06.699+0000 7fb6db7a2640 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-09-16T05:22:12.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-09-16T05:22:12.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:22:12.366 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T05:22:12.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T05:22:12.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:22:12.948 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T05:22:12.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T05:22:12.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:22:12.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:22:12.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:22:12.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:22:12.978 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:12.977+0000 7f7b28413640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:22:12.981 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:12.981+0000 7f7b28413640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:22:12.982 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:12.982+0000 7f7b28413640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:22:13.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T05:22:13.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:22:13.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T05:22:13.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:22:13.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:22:13.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:13.388 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:22:13.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:22:13.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:13.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:13.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:14.321 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:14.320+0000 7f7b28413640 -1 Falling back to public interface 2024-09-16T05:22:14.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:14.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:14.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:22:14.823 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:22:14.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:14.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:15.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:16.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:16.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:16.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:22:16.274 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:22:16.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:16.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:16.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:17.285 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:17.284+0000 7f7b28413640 -1 osd.0 0 log_to_monitors true 2024-09-16T05:22:17.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:17.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:17.743 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:22:17.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:22:17.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:17.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:18.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:19.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:19.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:19.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:22:19.289 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:22:19.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:19.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:19.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:20.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:20.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:20.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:22:20.711 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:22:20.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:20.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:21.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:22.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:22.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:22.167 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:22:22.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:22:22.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:22.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:22.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:23.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:23.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:23.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:22:23.589 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:22:23.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:23.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:24.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:25.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:25.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:25.095 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:22:25.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:22:25.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:25.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:25.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:26.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:26.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:26.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:22:26.534 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:22:26.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:26.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:27.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:28.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:28.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:28.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:22:28.017 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:22:28.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:28.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:28.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:29.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:29.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:29.439 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:22:29.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:22:29.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:29.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:30.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:31.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:31.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:31.002 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:22:31.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:22:31.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:31.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:31.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:32.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:32.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:32.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:22:32.760 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:22:32.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:32.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:33.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:34.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:34.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:34.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:22:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:22:34.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:34.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:35.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:36.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:36.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:36.311 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:22:36.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:22:36.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:36.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:37.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:38.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:38.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:38.020 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:22:38.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:22:38.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:38.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:38.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:39.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:39.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:39.793 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:22:39.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:22:39.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:39.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:22:40.239 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2383233207,v1:127.0.0.1:6803/2383233207] [v2:127.0.0.1:6804/2383233207,v1:127.0.0.1:6805/2383233207] exists,up 242bd604-4342-40d5-a4a9-126d79610d5e 2024-09-16T05:22:40.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:22:40.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:22:40.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:22:40.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:334: TEST_backfill_out2: run_osd td/osd-backfill-stats 1 2024-09-16T05:22:40.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:22:40.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:22:40.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T05:22:40.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/1 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:22:40.244 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:22:40.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:22:40.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:22:40.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:22:40.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/1 2024-09-16T05:22:40.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:22:40.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=3688fb7b-e402-4fcc-9795-6d9da1750c94 2024-09-16T05:22:40.246 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 3688fb7b-e402-4fcc-9795-6d9da1750c94 2024-09-16T05:22:40.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 3688fb7b-e402-4fcc-9795-6d9da1750c94' 2024-09-16T05:22:40.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:22:40.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCgwOdmt9KlDxAAJqRSGqk54RauL7kfsq7RNQ== 2024-09-16T05:22:40.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCgwOdmt9KlDxAAJqRSGqk54RauL7kfsq7RNQ=="}' 2024-09-16T05:22:40.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 3688fb7b-e402-4fcc-9795-6d9da1750c94 -i td/osd-backfill-stats/1/new.json 2024-09-16T05:22:40.864 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:22:40.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/1/new.json 2024-09-16T05:22:40.876 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCgwOdmt9KlDxAAJqRSGqk54RauL7kfsq7RNQ== --osd-uuid 3688fb7b-e402-4fcc-9795-6d9da1750c94 2024-09-16T05:22:40.907 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:40.906+0000 7fef8da14640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:22:40.909 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:40.908+0000 7fef8da14640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:22:40.910 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:40.909+0000 7fef8da14640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:22:40.910 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:40.909+0000 7fef8da14640 -1 bdev(0x562408959c00 td/osd-backfill-stats/1/block) open stat got: (1) Operation not permitted 2024-09-16T05:22:40.910 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:40.909+0000 7fef8da14640 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-09-16T05:22:46.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-09-16T05:22:46.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:22:46.767 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T05:22:46.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T05:22:46.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:22:47.345 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T05:22:47.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T05:22:47.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:22:47.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:22:47.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:22:47.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:22:47.375 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:47.373+0000 7f32d640d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:22:47.377 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:47.375+0000 7f32d640d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:22:47.378 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:47.376+0000 7f32d640d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:22:47.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T05:22:47.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:22:47.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T05:22:47.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:22:47.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:22:47.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:47.773 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:22:47.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:22:47.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:47.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:22:48.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:48.962 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:48.960+0000 7f32d640d640 -1 Falling back to public interface 2024-09-16T05:22:49.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:49.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:49.207 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:22:49.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:22:49.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:49.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:22:49.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:50.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:50.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:50.660 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:22:50.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:22:50.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:50.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:22:51.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:51.620 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:22:51.619+0000 7f32d640d640 -1 osd.1 0 log_to_monitors true 2024-09-16T05:22:52.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:52.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:52.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:22:52.085 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:22:52.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:52.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:22:52.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:53.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:53.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:53.801 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:22:53.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:22:53.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:53.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:22:54.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:55.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:55.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:55.230 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:22:55.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:22:55.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:55.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:22:55.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:56.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:56.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:56.652 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:22:56.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:22:56.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:56.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:22:57.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:58.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:58.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:58.143 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:22:58.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:22:58.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:58.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:22:58.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:22:59.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:22:59.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:22:59.582 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:22:59.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:22:59.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:22:59.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:23:00.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:01.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:01.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:01.002 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:23:01.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:23:01.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:01.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:23:01.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:02.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:02.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:02.518 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:23:02.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:23:02.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:02.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:23:02.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:03.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:03.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:03.937 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:23:03.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:23:03.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:03.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:23:04.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:05.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:05.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:05.401 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:23:05.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:23:05.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:05.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:23:06.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:07.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:07.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:07.395 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:23:07.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:23:07.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:07.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:23:08.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:09.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:09.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:09.131 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:23:09.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:23:09.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:09.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:23:09.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:10.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:10.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:10.849 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:23:10.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:23:10.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:10.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:23:11.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:12.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:12.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:12.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:23:12.818 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:23:12.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:12.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:23:13.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:14.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:14.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:14.670 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:23:14.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:23:14.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:14.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:23:15.244 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2381793236,v1:127.0.0.1:6811/2381793236] [v2:127.0.0.1:6812/2381793236,v1:127.0.0.1:6813/2381793236] exists,up 3688fb7b-e402-4fcc-9795-6d9da1750c94 2024-09-16T05:23:15.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:23:15.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:23:15.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:23:15.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:335: TEST_backfill_out2: run_osd td/osd-backfill-stats 2 2024-09-16T05:23:15.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:23:15.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:23:15.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T05:23:15.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:23:15.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/2 2024-09-16T05:23:15.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:23:15.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:23:15.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:23:15.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:23:15.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-09-16T05:23:15.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-09-16T05:23:15.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:23:15.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:23:15.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:23:15.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:23:15.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:23:15.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:23:15.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:23:15.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:23:15.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:23:15.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:23:15.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/2 2024-09-16T05:23:15.251 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:23:15.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=50cf182c-8bac-44dc-9eab-165082417f38 2024-09-16T05:23:15.251 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 50cf182c-8bac-44dc-9eab-165082417f38 2024-09-16T05:23:15.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 50cf182c-8bac-44dc-9eab-165082417f38' 2024-09-16T05:23:15.252 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:23:15.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDDwOdmng7qDxAAy2FR7lybUCcP7oe5upAXEw== 2024-09-16T05:23:15.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDDwOdmng7qDxAAy2FR7lybUCcP7oe5upAXEw=="}' 2024-09-16T05:23:15.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 50cf182c-8bac-44dc-9eab-165082417f38 -i td/osd-backfill-stats/2/new.json 2024-09-16T05:23:15.784 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:23:15.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/2/new.json 2024-09-16T05:23:15.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDDwOdmng7qDxAAy2FR7lybUCcP7oe5upAXEw== --osd-uuid 50cf182c-8bac-44dc-9eab-165082417f38 2024-09-16T05:23:15.827 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:15.826+0000 7f73c431b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:23:15.829 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:15.829+0000 7f73c431b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:23:15.831 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:15.830+0000 7f73c431b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:23:15.831 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:15.830+0000 7f73c431b640 -1 bdev(0x55578ed83c00 td/osd-backfill-stats/2/block) open stat got: (1) Operation not permitted 2024-09-16T05:23:15.831 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:15.830+0000 7f73c431b640 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-09-16T05:23:21.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-09-16T05:23:21.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:23:21.259 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T05:23:21.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T05:23:21.259 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:23:21.831 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T05:23:21.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T05:23:21.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:23:21.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:23:21.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:23:21.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:23:21.860 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:21.860+0000 7faa4affd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:23:21.862 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:21.862+0000 7faa4affd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:23:21.863 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:21.863+0000 7faa4affd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:23:22.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T05:23:22.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:23:22.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T05:23:22.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:23:22.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:23:22.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:22.269 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:23:22.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:23:22.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:22.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:22.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:22.957 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:22.957+0000 7faa4affd640 -1 Falling back to public interface 2024-09-16T05:23:23.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:23.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:23.705 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:23:23.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:23:23.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:23.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:24.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:25.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:25.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:25.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:23:25.148 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:23:25.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:25.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:25.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:25.960 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:25.959+0000 7faa4affd640 -1 osd.2 0 log_to_monitors true 2024-09-16T05:23:26.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:26.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:26.564 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:23:26.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:23:26.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:26.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:27.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:28.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:28.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:28.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:23:28.167 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:23:28.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:28.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:28.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:29.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:29.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:29.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:23:29.583 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:23:29.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:29.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:30.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:31.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:31.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:31.002 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:23:31.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:23:31.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:31.003 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:31.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:32.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:32.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:32.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:23:32.511 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:23:32.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:32.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:32.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:33.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:33.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:33.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:23:33.982 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:23:33.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:33.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:34.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:35.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:35.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:35.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:23:35.427 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:23:35.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:35.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:35.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:36.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:36.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:36.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:23:36.969 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:23:36.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:36.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:37.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:38.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:38.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:38.387 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:23:38.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:23:38.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:38.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:39.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:40.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:40.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:40.341 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:23:40.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:23:40.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:40.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:41.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:42.224 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:42.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:42.225 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:23:42.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:23:42.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:42.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:42.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:43.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:43.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:43.885 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:23:43.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:23:43.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:43.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:44.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:45.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:45.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:45.658 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:23:45.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:23:45.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:45.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:46.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:47.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:47.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:47.372 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:23:47.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:23:47.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:47.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:48.296 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:49.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:49.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:49.298 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:23:49.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:23:49.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:49.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:23:49.750 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1192601388,v1:127.0.0.1:6819/1192601388] [v2:127.0.0.1:6820/1192601388,v1:127.0.0.1:6821/1192601388] exists,up 50cf182c-8bac-44dc-9eab-165082417f38 2024-09-16T05:23:49.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:23:49.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:23:49.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:23:49.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:336: TEST_backfill_out2: run_osd td/osd-backfill-stats 3 2024-09-16T05:23:49.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:23:49.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:23:49.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T05:23:49.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:23:49.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/3 2024-09-16T05:23:49.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:23:49.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:23:49.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:23:49.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:23:49.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-09-16T05:23:49.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-09-16T05:23:49.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:23:49.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:23:49.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:23:49.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:23:49.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:23:49.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:23:49.756 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:23:49.756 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:23:49.756 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:23:49.756 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:23:49.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:23:49.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:23:49.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/3 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7d03b13b-8507-4f5c-9c43-0876f1b0d5bb 2024-09-16T05:23:49.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 7d03b13b-8507-4f5c-9c43-0876f1b0d5bb' 2024-09-16T05:23:49.758 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 7d03b13b-8507-4f5c-9c43-0876f1b0d5bb 2024-09-16T05:23:49.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:23:49.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDlwOdmaOAcLhAAl0rTBiKLBu50EEVHMvHK5w== 2024-09-16T05:23:49.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDlwOdmaOAcLhAAl0rTBiKLBu50EEVHMvHK5w=="}' 2024-09-16T05:23:49.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7d03b13b-8507-4f5c-9c43-0876f1b0d5bb -i td/osd-backfill-stats/3/new.json 2024-09-16T05:23:50.279 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:23:50.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/3/new.json 2024-09-16T05:23:50.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDlwOdmaOAcLhAAl0rTBiKLBu50EEVHMvHK5w== --osd-uuid 7d03b13b-8507-4f5c-9c43-0876f1b0d5bb 2024-09-16T05:23:50.323 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:50.322+0000 7efdf73a4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:23:50.325 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:50.324+0000 7efdf73a4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:23:50.326 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:50.325+0000 7efdf73a4640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:23:50.327 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:50.325+0000 7efdf73a4640 -1 bdev(0x55c54de2fc00 td/osd-backfill-stats/3/block) open stat got: (1) Operation not permitted 2024-09-16T05:23:50.327 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:50.325+0000 7efdf73a4640 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-09-16T05:23:56.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-09-16T05:23:56.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:23:56.281 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T05:23:56.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T05:23:56.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:23:56.847 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T05:23:56.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T05:23:56.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:23:56.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:23:56.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:23:56.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:23:56.876 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:56.875+0000 7f5bbde1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:23:56.879 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:56.877+0000 7f5bbde1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:23:56.879 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:56.878+0000 7f5bbde1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:23:57.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T05:23:57.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:23:57.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T05:23:57.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:23:57.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:23:57.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:57.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:23:57.295 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:23:57.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:57.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:23:57.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:23:57.979 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:23:57.978+0000 7f5bbde1e640 -1 Falling back to public interface 2024-09-16T05:23:58.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:23:58.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:23:58.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:23:58.730 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:23:58.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:23:58.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:23:59.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:00.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:00.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:00.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:24:00.164 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:24:00.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:00.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:00.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:00.675 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:00.673+0000 7f5bbde1e640 -1 osd.3 0 log_to_monitors true 2024-09-16T05:24:01.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:01.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:01.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:24:01.575 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:24:01.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:01.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:02.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:03.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:03.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:03.121 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:24:03.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:24:03.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:03.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:03.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:04.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:04.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:04.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:24:04.655 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:24:04.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:04.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:05.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:06.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:06.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:06.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:24:06.109 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:24:06.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:06.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:06.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:07.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:07.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:07.587 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:24:07.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:24:07.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:07.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:08.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:09.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:09.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:09.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:24:09.017 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:24:09.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:09.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:09.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:10.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:10.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:10.525 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:24:10.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:24:10.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:10.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:10.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:11.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:11.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:11.971 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:24:11.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:24:11.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:11.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:12.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:13.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:13.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:13.535 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:24:13.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:24:13.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:13.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:14.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:15.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:15.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:15.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:24:15.533 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:24:15.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:15.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:16.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:17.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:17.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:17.151 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:24:17.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:24:17.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:17.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:17.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:18.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:18.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:18.796 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:24:18.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:24:18.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:18.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:19.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:20.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:20.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:20.633 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:24:20.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:24:20.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:20.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:21.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:22.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:22.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:22.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:24:22.330 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:24:22.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:22.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:24:22.886 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/515305415,v1:127.0.0.1:6827/515305415] [v2:127.0.0.1:6828/515305415,v1:127.0.0.1:6829/515305415] exists,up 7d03b13b-8507-4f5c-9c43-0876f1b0d5bb 2024-09-16T05:24:22.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:24:22.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:24:22.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:337: TEST_backfill_out2: run_osd td/osd-backfill-stats 4 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/4 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:24:22.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:24:22.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:24:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:24:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:24:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:24:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:24:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:24:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:24:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:24:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/4 2024-09-16T05:24:22.893 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:24:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=18a773ea-2bd7-4838-bdd9-1b2c1aac5b00 2024-09-16T05:24:22.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 18a773ea-2bd7-4838-bdd9-1b2c1aac5b00' 2024-09-16T05:24:22.894 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 18a773ea-2bd7-4838-bdd9-1b2c1aac5b00 2024-09-16T05:24:22.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:24:22.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAGwedmJfs5NhAALWJI29UQdTQw9l8hHDdFYw== 2024-09-16T05:24:22.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAGwedmJfs5NhAALWJI29UQdTQw9l8hHDdFYw=="}' 2024-09-16T05:24:22.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 18a773ea-2bd7-4838-bdd9-1b2c1aac5b00 -i td/osd-backfill-stats/4/new.json 2024-09-16T05:24:23.383 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:24:23.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/4/new.json 2024-09-16T05:24:23.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAGwedmJfs5NhAALWJI29UQdTQw9l8hHDdFYw== --osd-uuid 18a773ea-2bd7-4838-bdd9-1b2c1aac5b00 2024-09-16T05:24:23.427 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:23.426+0000 7f8b930d6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:24:23.430 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:23.429+0000 7f8b930d6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:24:23.431 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:23.430+0000 7f8b930d6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:24:23.431 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:23.431+0000 7f8b930d6640 -1 bdev(0x55b17a1ddc00 td/osd-backfill-stats/4/block) open stat got: (1) Operation not permitted 2024-09-16T05:24:23.431 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:23.431+0000 7f8b930d6640 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-09-16T05:24:29.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-09-16T05:24:29.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:24:29.111 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T05:24:29.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T05:24:29.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:24:29.677 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T05:24:29.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T05:24:29.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:24:29.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:24:29.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:24:29.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:24:29.707 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:29.706+0000 7fd7c21bb640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:24:29.711 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:29.710+0000 7fd7c21bb640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:24:29.712 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:29.712+0000 7fd7c21bb640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:24:30.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T05:24:30.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:24:30.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T05:24:30.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:24:30.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:24:30.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:30.126 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:24:30.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:24:30.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:30.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:30.571 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:30.570+0000 7fd7c21bb640 -1 Falling back to public interface 2024-09-16T05:24:30.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:31.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:31.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:31.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:24:31.610 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:24:31.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:31.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:32.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:33.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:33.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:33.047 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:24:33.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:24:33.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:33.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:33.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:33.581 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:33.580+0000 7fd7c21bb640 -1 osd.4 0 log_to_monitors true 2024-09-16T05:24:34.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:34.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:34.477 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:24:34.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:24:34.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:34.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:35.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:36.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:36.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:36.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:24:36.039 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:24:36.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:36.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:36.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:37.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:37.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:37.523 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:24:37.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:24:37.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:37.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:38.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:39.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:39.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:39.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:24:39.036 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:24:39.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:39.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:39.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:40.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:40.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:40.525 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:24:40.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:24:40.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:40.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:40.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:41.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:41.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:41.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:24:41.948 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:24:41.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:41.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:42.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:43.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:43.504 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:24:43.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:43.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:24:43.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:43.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:43.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:44.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:44.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:44.925 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:24:44.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:24:44.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:44.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:45.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:46.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:46.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:46.399 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:24:46.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:24:46.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:46.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:47.092 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:48.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:48.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:48.094 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:24:48.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:24:48.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:48.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:49.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:50.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:50.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:50.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:24:50.387 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:24:50.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:50.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:51.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:52.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:52.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:52.311 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:24:52.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:24:52.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:52.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:53.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:54.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:54.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:54.125 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:24:54.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:24:54.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:54.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:54.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:55.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:55.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:55.889 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:24:55.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:24:55.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:55.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:56.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:24:57.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:24:57.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:24:57.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:24:57.671 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:24:57.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:24:57.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:24:58.102 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1091627972,v1:127.0.0.1:6835/1091627972] [v2:127.0.0.1:6836/1091627972,v1:127.0.0.1:6837/1091627972] exists,up 18a773ea-2bd7-4838-bdd9-1b2c1aac5b00 2024-09-16T05:24:58.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:24:58.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:24:58.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:24:58.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:338: TEST_backfill_out2: run_osd td/osd-backfill-stats 5 2024-09-16T05:24:58.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:24:58.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:24:58.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T05:24:58.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:24:58.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/5 2024-09-16T05:24:58.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:24:58.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:24:58.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:24:58.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:24:58.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-09-16T05:24:58.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-09-16T05:24:58.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:24:58.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:24:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:24:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:24:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:24:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:24:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:24:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:24:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:24:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:24:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/5 2024-09-16T05:24:58.110 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:24:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e77f8568-ba21-41cb-b742-cb4a1e5320fb 2024-09-16T05:24:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 e77f8568-ba21-41cb-b742-cb4a1e5320fb' 2024-09-16T05:24:58.111 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 e77f8568-ba21-41cb-b742-cb4a1e5320fb 2024-09-16T05:24:58.111 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:24:58.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAqwedmPI58BxAAJKU2xlMSySt1uMv0CA4utQ== 2024-09-16T05:24:58.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAqwedmPI58BxAAJKU2xlMSySt1uMv0CA4utQ=="}' 2024-09-16T05:24:58.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e77f8568-ba21-41cb-b742-cb4a1e5320fb -i td/osd-backfill-stats/5/new.json 2024-09-16T05:24:58.666 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:24:58.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/5/new.json 2024-09-16T05:24:58.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAqwedmPI58BxAAJKU2xlMSySt1uMv0CA4utQ== --osd-uuid e77f8568-ba21-41cb-b742-cb4a1e5320fb 2024-09-16T05:24:58.710 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:58.709+0000 7f93a9e24640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:24:58.725 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:58.724+0000 7f93a9e24640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:24:58.726 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:58.725+0000 7f93a9e24640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:24:58.727 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:58.725+0000 7f93a9e24640 -1 bdev(0x55cea7e33c00 td/osd-backfill-stats/5/block) open stat got: (1) Operation not permitted 2024-09-16T05:24:58.727 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:24:58.725+0000 7f93a9e24640 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-09-16T05:25:04.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-09-16T05:25:04.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:25:04.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T05:25:04.899 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T05:25:04.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:25:05.466 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T05:25:05.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T05:25:05.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:25:05.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:25:05.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:25:05.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:25:05.496 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:25:05.494+0000 7eff19c15640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:25:05.498 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:25:05.496+0000 7eff19c15640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:25:05.499 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:25:05.497+0000 7eff19c15640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:25:05.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T05:25:05.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:25:05.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T05:25:05.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:25:05.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:25:05.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:05.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:25:05.931 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:25:05.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:05.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:06.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:07.078 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:25:07.076+0000 7eff19c15640 -1 Falling back to public interface 2024-09-16T05:25:07.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:07.407 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:25:07.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:07.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:25:07.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:07.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:07.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:08.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:08.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:08.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:25:08.851 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:25:08.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:08.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:09.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:10.205 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:25:10.203+0000 7eff19c15640 -1 osd.5 0 log_to_monitors true 2024-09-16T05:25:10.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:10.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:10.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:25:10.293 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:25:10.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:10.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:10.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:11.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:11.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:11.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:25:11.815 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:25:11.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:11.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:12.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:13.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:13.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:13.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:25:13.355 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:25:13.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:13.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:13.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:14.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:14.773 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:25:14.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:14.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:25:14.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:14.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:15.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:16.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:16.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:16.333 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:25:16.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:25:16.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:16.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:16.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:17.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:17.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:17.776 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:25:17.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:25:17.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:17.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:18.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:19.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:19.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:19.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:25:19.201 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:25:19.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:19.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:19.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:20.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:20.690 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:25:20.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:20.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:25:20.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:20.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:21.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:22.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:22.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:22.171 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:25:22.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:25:22.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:22.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:22.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:23.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:23.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:23.626 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:25:23.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:25:23.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:23.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:24.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:25.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:25.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:25.529 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:25:25.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:25:25.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:25.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:26.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:27.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:27.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:27.340 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:25:27.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:25:27.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:27.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:28.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:29.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:29.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:29.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:25:29.176 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:25:29.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:29.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:30.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:31.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:31.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:31.291 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:25:31.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:25:31.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:31.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:31.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:32.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:32.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:32.748 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:25:32.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:25:32.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:32.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:33.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:25:34.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:25:34.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:25:34.396 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T05:25:34.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T05:25:34.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:25:34.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:25:34.882 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/1449756564,v1:127.0.0.1:6843/1449756564] [v2:127.0.0.1:6844/1449756564,v1:127.0.0.1:6845/1449756564] exists,up e77f8568-ba21-41cb-b742-cb4a1e5320fb 2024-09-16T05:25:34.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:25:34.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:25:34.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:25:34.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:340: TEST_backfill_out2: create_pool test 1 1 2024-09-16T05:25:34.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2024-09-16T05:25:35.599 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T05:25:35.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T05:25:36.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:341: TEST_backfill_out2: ceph osd pool set test size 2 2024-09-16T05:25:37.308 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 2 2024-09-16T05:25:37.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:342: TEST_backfill_out2: sleep 5 2024-09-16T05:25:42.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:344: TEST_backfill_out2: wait_for_clean 2024-09-16T05:25:42.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:25:42.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:25:42.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:25:42.323 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:25:42.323 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:25:42.323 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:25:42.324 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:25:42.324 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:25:42.324 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:25:42.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:25:42.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:25:42.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:25:42.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:25:42.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:25:42.427 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:25:42.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:25:42.864 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:25:42.864 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:25:42.864 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:25:42.864 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T05:25:42.865 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T05:25:42.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:25:42.865 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:25:42.865 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:25:42.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836527 2024-09-16T05:25:42.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836527 2024-09-16T05:25:42.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527' 2024-09-16T05:25:42.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:25:42.983 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:25:43.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672996 2024-09-16T05:25:43.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672996 2024-09-16T05:25:43.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949672996' 2024-09-16T05:25:43.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:25:43.101 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:25:43.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509467 2024-09-16T05:25:43.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509467 2024-09-16T05:25:43.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949672996 2-64424509467' 2024-09-16T05:25:43.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:25:43.218 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:25:43.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345947 2024-09-16T05:25:43.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345947 2024-09-16T05:25:43.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949672996 2-64424509467 3-85899345947' 2024-09-16T05:25:43.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:25:43.367 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:25:43.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182413 2024-09-16T05:25:43.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182413 2024-09-16T05:25:43.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949672996 2-64424509467 3-85899345947 4-107374182413' 2024-09-16T05:25:43.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:25:43.485 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T05:25:43.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018887 2024-09-16T05:25:43.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018887 2024-09-16T05:25:43.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949672996 2-64424509467 3-85899345947 4-107374182413 5-128849018887' 2024-09-16T05:25:43.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:25:43.602 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836527 2024-09-16T05:25:43.602 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:25:43.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:25:43.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836527 2024-09-16T05:25:43.604 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:25:43.604 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836527 2024-09-16T05:25:43.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836527' 2024-09-16T05:25:43.605 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836527 2024-09-16T05:25:43.605 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:25:44.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836525 -lt 21474836527 2024-09-16T05:25:44.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T05:25:45.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T05:25:45.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:25:45.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836527 -lt 21474836527 2024-09-16T05:25:45.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:25:45.486 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672996 2024-09-16T05:25:45.486 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:25:45.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:25:45.487 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672996 2024-09-16T05:25:45.488 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:25:45.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672996 2024-09-16T05:25:45.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672996' 2024-09-16T05:25:45.489 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672996 2024-09-16T05:25:45.490 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:25:45.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672996 -lt 42949672996 2024-09-16T05:25:45.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:25:45.931 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509467 2024-09-16T05:25:45.932 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:25:45.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:25:45.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509467 2024-09-16T05:25:45.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:25:45.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509467 2024-09-16T05:25:45.934 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509467 2024-09-16T05:25:45.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509467' 2024-09-16T05:25:45.935 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:25:46.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509468 -lt 64424509467 2024-09-16T05:25:46.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:25:46.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345947 2024-09-16T05:25:46.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:25:46.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:25:46.350 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345947 2024-09-16T05:25:46.351 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:25:46.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345947 2024-09-16T05:25:46.352 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345947 2024-09-16T05:25:46.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345947' 2024-09-16T05:25:46.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:25:46.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345947 -lt 85899345947 2024-09-16T05:25:46.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:25:46.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182413 2024-09-16T05:25:46.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:25:46.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:25:46.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182413 2024-09-16T05:25:46.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:25:46.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182413 2024-09-16T05:25:46.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182413' 2024-09-16T05:25:46.760 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182413 2024-09-16T05:25:46.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:25:47.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182413 -lt 107374182413 2024-09-16T05:25:47.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:25:47.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018887 2024-09-16T05:25:47.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:25:47.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T05:25:47.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018887 2024-09-16T05:25:47.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:25:47.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018887 2024-09-16T05:25:47.204 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018887 2024-09-16T05:25:47.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018887' 2024-09-16T05:25:47.205 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T05:25:47.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018888 -lt 128849018887 2024-09-16T05:25:47.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:25:47.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:25:47.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:25:48.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:25:48.204 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:25:48.204 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:25:48.204 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:25:48.204 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:25:48.204 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:25:48.204 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:25:48.205 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:25:48.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:25:48.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:25:48.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:25:48.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:25:49.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:25:49.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:25:49.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:25:49.167 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: seq 1 200 2024-09-16T05:25:49.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:49.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj1 /dev/null 2024-09-16T05:25:49.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:49.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj2 /dev/null 2024-09-16T05:25:49.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:49.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj3 /dev/null 2024-09-16T05:25:49.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:49.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj4 /dev/null 2024-09-16T05:25:49.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:49.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj5 /dev/null 2024-09-16T05:25:49.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:49.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj6 /dev/null 2024-09-16T05:25:49.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:49.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj7 /dev/null 2024-09-16T05:25:49.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:49.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj8 /dev/null 2024-09-16T05:25:50.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:50.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj9 /dev/null 2024-09-16T05:25:50.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:50.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj10 /dev/null 2024-09-16T05:25:50.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:50.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj11 /dev/null 2024-09-16T05:25:50.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:50.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj12 /dev/null 2024-09-16T05:25:50.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:50.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj13 /dev/null 2024-09-16T05:25:50.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:50.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj14 /dev/null 2024-09-16T05:25:50.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:50.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj15 /dev/null 2024-09-16T05:25:50.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:50.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj16 /dev/null 2024-09-16T05:25:50.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:50.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj17 /dev/null 2024-09-16T05:25:50.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:50.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj18 /dev/null 2024-09-16T05:25:50.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:50.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj19 /dev/null 2024-09-16T05:25:51.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:51.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj20 /dev/null 2024-09-16T05:25:51.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:51.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj21 /dev/null 2024-09-16T05:25:51.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:51.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj22 /dev/null 2024-09-16T05:25:51.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:51.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj23 /dev/null 2024-09-16T05:25:51.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:51.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj24 /dev/null 2024-09-16T05:25:51.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:51.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj25 /dev/null 2024-09-16T05:25:51.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:51.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj26 /dev/null 2024-09-16T05:25:51.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:51.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj27 /dev/null 2024-09-16T05:25:51.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:51.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj28 /dev/null 2024-09-16T05:25:52.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:52.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj29 /dev/null 2024-09-16T05:25:52.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:52.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj30 /dev/null 2024-09-16T05:25:52.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:52.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj31 /dev/null 2024-09-16T05:25:52.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:52.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj32 /dev/null 2024-09-16T05:25:52.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:52.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj33 /dev/null 2024-09-16T05:25:52.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:52.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj34 /dev/null 2024-09-16T05:25:52.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:52.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj35 /dev/null 2024-09-16T05:25:52.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:52.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj36 /dev/null 2024-09-16T05:25:52.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:52.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj37 /dev/null 2024-09-16T05:25:52.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:52.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj38 /dev/null 2024-09-16T05:25:53.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:53.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj39 /dev/null 2024-09-16T05:25:53.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:53.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj40 /dev/null 2024-09-16T05:25:53.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:53.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj41 /dev/null 2024-09-16T05:25:53.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:53.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj42 /dev/null 2024-09-16T05:25:53.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:53.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj43 /dev/null 2024-09-16T05:25:53.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:53.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj44 /dev/null 2024-09-16T05:25:53.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:53.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj45 /dev/null 2024-09-16T05:25:53.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:53.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj46 /dev/null 2024-09-16T05:25:53.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:53.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj47 /dev/null 2024-09-16T05:25:53.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:53.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj48 /dev/null 2024-09-16T05:25:54.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:54.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj49 /dev/null 2024-09-16T05:25:54.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:54.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj50 /dev/null 2024-09-16T05:25:54.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:54.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj51 /dev/null 2024-09-16T05:25:54.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:54.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj52 /dev/null 2024-09-16T05:25:54.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:54.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj53 /dev/null 2024-09-16T05:25:54.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:54.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj54 /dev/null 2024-09-16T05:25:54.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:54.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj55 /dev/null 2024-09-16T05:25:54.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:54.774 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj56 /dev/null 2024-09-16T05:25:54.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:54.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj57 /dev/null 2024-09-16T05:25:54.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:54.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj58 /dev/null 2024-09-16T05:25:55.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:55.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj59 /dev/null 2024-09-16T05:25:55.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:55.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj60 /dev/null 2024-09-16T05:25:55.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:55.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj61 /dev/null 2024-09-16T05:25:55.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:55.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj62 /dev/null 2024-09-16T05:25:55.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:55.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj63 /dev/null 2024-09-16T05:25:55.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:55.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj64 /dev/null 2024-09-16T05:25:55.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:55.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj65 /dev/null 2024-09-16T05:25:55.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:55.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj66 /dev/null 2024-09-16T05:25:55.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:55.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj67 /dev/null 2024-09-16T05:25:56.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:56.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj68 /dev/null 2024-09-16T05:25:56.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:56.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj69 /dev/null 2024-09-16T05:25:56.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:56.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj70 /dev/null 2024-09-16T05:25:56.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:56.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj71 /dev/null 2024-09-16T05:25:56.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:56.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj72 /dev/null 2024-09-16T05:25:56.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:56.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj73 /dev/null 2024-09-16T05:25:56.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:56.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj74 /dev/null 2024-09-16T05:25:56.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:56.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj75 /dev/null 2024-09-16T05:25:56.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:56.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj76 /dev/null 2024-09-16T05:25:56.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:56.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj77 /dev/null 2024-09-16T05:25:57.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:57.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj78 /dev/null 2024-09-16T05:25:57.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:57.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj79 /dev/null 2024-09-16T05:25:57.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:57.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj80 /dev/null 2024-09-16T05:25:57.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:57.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj81 /dev/null 2024-09-16T05:25:57.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:57.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj82 /dev/null 2024-09-16T05:25:57.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:57.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj83 /dev/null 2024-09-16T05:25:57.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:57.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj84 /dev/null 2024-09-16T05:25:57.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:57.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj85 /dev/null 2024-09-16T05:25:57.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:57.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj86 /dev/null 2024-09-16T05:25:57.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:57.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj87 /dev/null 2024-09-16T05:25:58.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:58.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj88 /dev/null 2024-09-16T05:25:58.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:58.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj89 /dev/null 2024-09-16T05:25:58.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:58.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj90 /dev/null 2024-09-16T05:25:58.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:58.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj91 /dev/null 2024-09-16T05:25:58.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:58.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj92 /dev/null 2024-09-16T05:25:58.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:58.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj93 /dev/null 2024-09-16T05:25:58.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:58.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj94 /dev/null 2024-09-16T05:25:58.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:58.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj95 /dev/null 2024-09-16T05:25:58.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:58.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj96 /dev/null 2024-09-16T05:25:58.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:58.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj97 /dev/null 2024-09-16T05:25:59.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:59.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj98 /dev/null 2024-09-16T05:25:59.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:59.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj99 /dev/null 2024-09-16T05:25:59.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:59.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj100 /dev/null 2024-09-16T05:25:59.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:59.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj101 /dev/null 2024-09-16T05:25:59.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:59.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj102 /dev/null 2024-09-16T05:25:59.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:59.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj103 /dev/null 2024-09-16T05:25:59.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:59.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj104 /dev/null 2024-09-16T05:25:59.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:59.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj105 /dev/null 2024-09-16T05:25:59.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:59.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj106 /dev/null 2024-09-16T05:25:59.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:59.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj107 /dev/null 2024-09-16T05:25:59.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:25:59.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj108 /dev/null 2024-09-16T05:26:00.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:00.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj109 /dev/null 2024-09-16T05:26:00.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:00.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj110 /dev/null 2024-09-16T05:26:00.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:00.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj111 /dev/null 2024-09-16T05:26:00.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:00.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj112 /dev/null 2024-09-16T05:26:00.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:00.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj113 /dev/null 2024-09-16T05:26:00.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:00.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj114 /dev/null 2024-09-16T05:26:00.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:00.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj115 /dev/null 2024-09-16T05:26:00.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:00.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj116 /dev/null 2024-09-16T05:26:01.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:01.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj117 /dev/null 2024-09-16T05:26:01.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:01.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj118 /dev/null 2024-09-16T05:26:01.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:01.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj119 /dev/null 2024-09-16T05:26:01.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:01.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj120 /dev/null 2024-09-16T05:26:01.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:01.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj121 /dev/null 2024-09-16T05:26:01.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:01.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj122 /dev/null 2024-09-16T05:26:01.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:01.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj123 /dev/null 2024-09-16T05:26:02.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:02.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj124 /dev/null 2024-09-16T05:26:02.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:02.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj125 /dev/null 2024-09-16T05:26:02.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:02.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj126 /dev/null 2024-09-16T05:26:02.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:02.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj127 /dev/null 2024-09-16T05:26:02.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:02.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj128 /dev/null 2024-09-16T05:26:02.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:02.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj129 /dev/null 2024-09-16T05:26:02.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:02.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj130 /dev/null 2024-09-16T05:26:02.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:02.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj131 /dev/null 2024-09-16T05:26:02.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:02.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj132 /dev/null 2024-09-16T05:26:02.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:02.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj133 /dev/null 2024-09-16T05:26:03.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:03.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj134 /dev/null 2024-09-16T05:26:03.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:03.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj135 /dev/null 2024-09-16T05:26:03.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:03.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj136 /dev/null 2024-09-16T05:26:03.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:03.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj137 /dev/null 2024-09-16T05:26:03.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:03.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj138 /dev/null 2024-09-16T05:26:03.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:03.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj139 /dev/null 2024-09-16T05:26:03.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:03.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj140 /dev/null 2024-09-16T05:26:03.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:03.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj141 /dev/null 2024-09-16T05:26:03.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:03.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj142 /dev/null 2024-09-16T05:26:03.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:03.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj143 /dev/null 2024-09-16T05:26:04.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:04.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj144 /dev/null 2024-09-16T05:26:04.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:04.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj145 /dev/null 2024-09-16T05:26:04.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:04.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj146 /dev/null 2024-09-16T05:26:04.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:04.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj147 /dev/null 2024-09-16T05:26:04.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:04.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj148 /dev/null 2024-09-16T05:26:04.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:04.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj149 /dev/null 2024-09-16T05:26:04.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:04.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj150 /dev/null 2024-09-16T05:26:04.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:04.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj151 /dev/null 2024-09-16T05:26:04.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:04.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj152 /dev/null 2024-09-16T05:26:04.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:04.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj153 /dev/null 2024-09-16T05:26:05.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:05.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj154 /dev/null 2024-09-16T05:26:05.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:05.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj155 /dev/null 2024-09-16T05:26:05.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:05.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj156 /dev/null 2024-09-16T05:26:05.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:05.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj157 /dev/null 2024-09-16T05:26:05.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:05.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj158 /dev/null 2024-09-16T05:26:05.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:05.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj159 /dev/null 2024-09-16T05:26:05.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:05.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj160 /dev/null 2024-09-16T05:26:05.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:05.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj161 /dev/null 2024-09-16T05:26:05.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:05.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj162 /dev/null 2024-09-16T05:26:05.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:05.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj163 /dev/null 2024-09-16T05:26:06.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:06.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj164 /dev/null 2024-09-16T05:26:06.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:06.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj165 /dev/null 2024-09-16T05:26:06.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:06.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj166 /dev/null 2024-09-16T05:26:06.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:06.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj167 /dev/null 2024-09-16T05:26:06.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:06.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj168 /dev/null 2024-09-16T05:26:06.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:06.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj169 /dev/null 2024-09-16T05:26:06.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:06.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj170 /dev/null 2024-09-16T05:26:06.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:06.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj171 /dev/null 2024-09-16T05:26:06.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:06.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj172 /dev/null 2024-09-16T05:26:06.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:06.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj173 /dev/null 2024-09-16T05:26:07.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:07.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj174 /dev/null 2024-09-16T05:26:07.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:07.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj175 /dev/null 2024-09-16T05:26:07.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:07.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj176 /dev/null 2024-09-16T05:26:07.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:07.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj177 /dev/null 2024-09-16T05:26:07.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:07.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj178 /dev/null 2024-09-16T05:26:07.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:07.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj179 /dev/null 2024-09-16T05:26:07.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:07.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj180 /dev/null 2024-09-16T05:26:07.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:07.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj181 /dev/null 2024-09-16T05:26:07.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:07.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj182 /dev/null 2024-09-16T05:26:08.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:08.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj183 /dev/null 2024-09-16T05:26:08.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:08.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj184 /dev/null 2024-09-16T05:26:08.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:08.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj185 /dev/null 2024-09-16T05:26:08.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:08.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj186 /dev/null 2024-09-16T05:26:08.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:08.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj187 /dev/null 2024-09-16T05:26:08.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:08.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj188 /dev/null 2024-09-16T05:26:08.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:08.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj189 /dev/null 2024-09-16T05:26:08.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:08.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj190 /dev/null 2024-09-16T05:26:08.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:08.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj191 /dev/null 2024-09-16T05:26:08.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:08.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj192 /dev/null 2024-09-16T05:26:08.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:08.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj193 /dev/null 2024-09-16T05:26:09.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:09.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj194 /dev/null 2024-09-16T05:26:09.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:09.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj195 /dev/null 2024-09-16T05:26:09.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:09.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj196 /dev/null 2024-09-16T05:26:09.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:09.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj197 /dev/null 2024-09-16T05:26:09.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:09.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj198 /dev/null 2024-09-16T05:26:09.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:09.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj199 /dev/null 2024-09-16T05:26:09.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:346: TEST_backfill_out2: for i in $(seq 1 $objects) 2024-09-16T05:26:09.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:348: TEST_backfill_out2: rados -p test put obj200 /dev/null 2024-09-16T05:26:09.863 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:351: TEST_backfill_out2: get_pg test obj1 2024-09-16T05:26:09.863 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T05:26:09.864 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T05:26:09.864 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T05:26:09.864 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T05:26:10.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:351: TEST_backfill_out2: local PG=1.0 2024-09-16T05:26:10.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:353: TEST_backfill_out2: get_primary test obj1 2024-09-16T05:26:10.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:26:10.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:26:10.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:26:10.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:26:10.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:353: TEST_backfill_out2: local primary=1 2024-09-16T05:26:10.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:354: TEST_backfill_out2: get_not_primary test obj1 2024-09-16T05:26:10.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2024-09-16T05:26:10.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2024-09-16T05:26:10.707 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2024-09-16T05:26:10.707 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:26:10.707 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:26:10.707 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:26:10.707 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:26:11.152 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2024-09-16T05:26:11.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2024-09-16T05:26:11.153 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-09-16T05:26:11.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:354: TEST_backfill_out2: local otherosd=0 2024-09-16T05:26:11.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:356: TEST_backfill_out2: ceph osd set nobackfill 2024-09-16T05:26:12.202 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is set 2024-09-16T05:26:12.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:357: TEST_backfill_out2: ceph osd pool set test size 3 2024-09-16T05:26:12.888 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 3 2024-09-16T05:26:12.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:358: TEST_backfill_out2: ceph osd out osd.0 2024-09-16T05:26:14.232 INFO:tasks.workunit.client.0.smithi026.stderr:osd.0 is already out. 2024-09-16T05:26:14.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:359: TEST_backfill_out2: ceph osd out osd.1 2024-09-16T05:26:15.024 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. 2024-09-16T05:26:15.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:361: TEST_backfill_out2: sleep 2 2024-09-16T05:26:17.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:362: TEST_backfill_out2: get_primary test obj1 2024-09-16T05:26:17.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:26:17.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:26:17.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:26:17.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:26:17.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:362: TEST_backfill_out2: primary=1 2024-09-16T05:26:17.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:363: TEST_backfill_out2: ceph osd unset nobackfill 2024-09-16T05:26:18.124 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is unset 2024-09-16T05:26:18.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:364: TEST_backfill_out2: ceph tell osd.1 get_latest_osdmap 2024-09-16T05:26:18.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:365: TEST_backfill_out2: ceph tell osd.1 debug kick_recovery_wq 0 2024-09-16T05:26:18.427 INFO:tasks.workunit.client.0.smithi026.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-09-16T05:26:18.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:366: TEST_backfill_out2: sleep 2 2024-09-16T05:26:20.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:368: TEST_backfill_out2: wait_for_clean 2024-09-16T05:26:20.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:26:20.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:26:20.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:26:20.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:26:20.439 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:26:20.439 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:26:20.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:26:20.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:26:20.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:26:20.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:26:20.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:26:20.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:26:20.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:26:20.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:26:20.543 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:26:20.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:26:20.954 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:26:20.954 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:26:20.955 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:26:20.955 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T05:26:20.955 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T05:26:20.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:26:20.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:26:20.955 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:26:21.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836537 2024-09-16T05:26:21.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836537 2024-09-16T05:26:21.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836537' 2024-09-16T05:26:21.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:26:21.170 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:26:21.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673006 2024-09-16T05:26:21.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673006 2024-09-16T05:26:21.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836537 1-42949673006' 2024-09-16T05:26:21.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:26:21.289 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:26:21.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509477 2024-09-16T05:26:21.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509477 2024-09-16T05:26:21.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836537 1-42949673006 2-64424509477' 2024-09-16T05:26:21.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:26:21.452 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:26:21.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345956 2024-09-16T05:26:21.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345956 2024-09-16T05:26:21.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836537 1-42949673006 2-64424509477 3-85899345956' 2024-09-16T05:26:21.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:26:21.571 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:26:21.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182422 2024-09-16T05:26:21.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182422 2024-09-16T05:26:21.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836537 1-42949673006 2-64424509477 3-85899345956 4-107374182422' 2024-09-16T05:26:21.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:26:21.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T05:26:21.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018897 2024-09-16T05:26:21.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018897 2024-09-16T05:26:21.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836537 1-42949673006 2-64424509477 3-85899345956 4-107374182422 5-128849018897' 2024-09-16T05:26:21.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:26:21.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836537 2024-09-16T05:26:21.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:26:21.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:26:21.823 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836537 2024-09-16T05:26:21.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:26:21.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836537 2024-09-16T05:26:21.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836537' 2024-09-16T05:26:21.825 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836537 2024-09-16T05:26:21.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:26:22.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836535 -lt 21474836537 2024-09-16T05:26:22.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T05:26:23.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T05:26:23.234 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:26:23.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836537 -lt 21474836537 2024-09-16T05:26:23.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:26:23.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673006 2024-09-16T05:26:23.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:26:23.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:26:23.722 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673006 2024-09-16T05:26:23.722 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:26:23.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673006 2024-09-16T05:26:23.723 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673006 2024-09-16T05:26:23.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673006' 2024-09-16T05:26:23.723 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:26:24.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673006 -lt 42949673006 2024-09-16T05:26:24.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:26:24.219 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509477 2024-09-16T05:26:24.219 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:26:24.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:26:24.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509477 2024-09-16T05:26:24.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:26:24.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509477 2024-09-16T05:26:24.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509477' 2024-09-16T05:26:24.222 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509477 2024-09-16T05:26:24.222 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:26:24.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509478 -lt 64424509477 2024-09-16T05:26:24.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:26:24.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345956 2024-09-16T05:26:24.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:26:24.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:26:24.873 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345956 2024-09-16T05:26:24.873 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:26:24.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345956 2024-09-16T05:26:24.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345956' 2024-09-16T05:26:24.875 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345956 2024-09-16T05:26:24.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:26:25.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345957 -lt 85899345956 2024-09-16T05:26:25.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:26:25.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182422 2024-09-16T05:26:25.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:26:25.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:26:25.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182422 2024-09-16T05:26:25.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:26:25.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182422 2024-09-16T05:26:25.441 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182422 2024-09-16T05:26:25.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182422' 2024-09-16T05:26:25.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:26:26.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182423 -lt 107374182422 2024-09-16T05:26:26.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:26:26.083 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018897 2024-09-16T05:26:26.083 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:26:26.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T05:26:26.084 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018897 2024-09-16T05:26:26.084 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:26:26.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018897 2024-09-16T05:26:26.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018897' 2024-09-16T05:26:26.086 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018897 2024-09-16T05:26:26.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T05:26:26.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018898 -lt 128849018897 2024-09-16T05:26:26.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:26:26.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:26.636 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:27.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:26:27.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:27.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:27.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:27.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:27.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:27.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:27.475 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:27.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:27.907 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:27.908 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:27.908 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:28.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:28.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T05:26:28.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T05:26:28.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T05:26:28.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:28.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:28.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:28.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:28.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:28.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:28.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:28.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:28.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:28.596 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:29.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:29.085 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:29.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:29.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:29.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:29.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:29.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:29.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:29.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:29.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:29.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:29.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:29.666 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:30.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4 2024-09-16T05:26:30.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4 '!=' null 2024-09-16T05:26:30.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:30.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:30.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:30.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:30.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:30.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:30.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:30.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:30.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:30.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:30.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:31.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:31.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:31.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:31.048 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:31.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:31.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:31.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:31.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:31.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:31.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:31.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:31.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:31.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:32.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:26:32.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:26:32.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:32.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:32.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:32.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:32.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:32.374 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:32.374 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:32.374 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:32.374 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:32.374 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:32.374 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:32.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:32.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:32.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:32.838 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:33.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:33.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:33.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:33.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:33.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:33.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:33.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:33.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:33.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:34.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:26:34.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:26:34.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:34.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:34.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:34.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:34.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:34.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:34.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:34.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:34.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:34.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:34.247 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:34.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:34.678 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:34.678 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:34.678 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:35.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:35.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:35.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:35.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:35.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:35.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:35.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:35.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:35.315 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:35.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4 2024-09-16T05:26:35.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4 '!=' null 2024-09-16T05:26:35.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:35.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:35.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:35.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:35.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:35.999 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:35.999 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:35.999 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:35.999 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:35.999 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:35.999 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:36.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:36.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:36.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:36.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:37.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:37.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:37.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:37.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:37.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:37.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:37.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:37.091 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:37.091 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:37.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:26:37.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:26:37.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:37.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:37.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:37.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:37.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:37.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:37.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:37.807 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:37.808 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:37.808 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:37.808 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:38.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:38.285 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:38.286 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:38.286 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:38.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:38.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:38.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:38.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:38.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:38.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:38.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:38.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:38.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:39.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:26:39.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:26:39.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:39.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:39.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:39.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:39.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:39.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:39.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:39.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:39.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:39.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:39.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:40.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:40.137 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:40.137 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:40.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:40.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:40.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:40.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:40.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:40.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:40.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:40.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:40.882 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:40.882 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:41.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:26:41.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:26:41.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:41.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:41.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:41.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:41.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:41.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:41.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:41.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:41.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:41.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:41.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:42.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:42.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:42.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:42.110 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:42.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:42.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:42.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:42.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:42.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:42.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:42.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:42.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:42.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:43.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:26:43.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:26:43.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:43.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:43.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:43.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:43.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:43.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:43.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:43.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:43.598 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:43.598 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:43.598 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:44.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:44.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:44.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:44.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:44.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:44.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:44.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:44.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:44.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:44.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:44.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:44.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:44.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:45.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:26:45.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:26:45.501 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:45.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:45.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:45.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:45.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:45.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:45.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:45.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:45.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:45.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:45.603 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:46.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:46.067 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:46.067 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:46.068 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:46.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:46.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:46.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:46.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:46.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:46.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:46.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:46.622 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:46.622 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:47.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:26:47.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:26:47.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:47.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:47.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:47.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:47.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:47.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:47.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:47.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:47.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:47.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:47.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:47.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:47.695 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:47.696 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:47.696 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:48.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:48.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:48.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:48.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:48.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:48.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:48.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:48.332 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:48.333 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:49.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:26:49.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:26:49.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:49.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:49.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:49.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:49.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:49.105 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:49.105 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:49.105 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:49.105 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:49.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:49.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:49.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:49.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:49.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:49.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:50.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:50.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:50.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:50.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:50.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:50.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:50.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:50.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:50.221 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:50.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=3 2024-09-16T05:26:50.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 3 '!=' null 2024-09-16T05:26:50.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:50.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:50.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:50.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:50.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:50.883 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:50.883 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:50.883 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:50.883 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:50.884 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:50.884 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:51.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:51.283 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:51.283 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:51.283 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:51.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:51.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:51.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:51.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:51.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:51.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:51.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:51.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:51.841 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:52.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=3 2024-09-16T05:26:52.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 3 '!=' null 2024-09-16T05:26:52.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:52.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:52.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:52.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:52.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:52.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:52.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:52.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:52.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:52.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:52.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:52.898 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:52.898 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:52.898 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:53.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:53.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:53.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:53.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:53.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:53.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:53.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:53.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:53.450 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:54.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=3 2024-09-16T05:26:54.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 3 '!=' null 2024-09-16T05:26:54.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:26:54.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:54.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:26:54.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:54.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:54.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:54.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:54.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:54.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:54.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:54.106 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:54.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:26:54.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:54.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:54.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:55.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:26:55.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:26:55.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:26:55.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:26:55.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:26:55.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:26:55.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:26:55.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:26:55.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:26:55.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2024-09-16T05:26:55.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2024-09-16T05:26:55.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1655: wait_for_clean: (( 1 >= 13 )) 2024-09-16T05:26:55.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:26:55.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.2 2024-09-16T05:26:55.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:26:55.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:26:55.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:26:55.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:26:55.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:26:55.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:26:55.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:26:55.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:26:56.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:26:56.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:26:56.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:26:56.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:26:56.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:26:56.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:26:56.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:26:56.806 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:370: TEST_backfill_out2: expr 200 '*' 2 2024-09-16T05:26:56.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:370: TEST_backfill_out2: local misplaced=400 2024-09-16T05:26:56.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:372: TEST_backfill_out2: check td/osd-backfill-stats 1.0 1 replicated 200 0 400 0 2024-09-16T05:26:56.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-09-16T05:26:56.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-09-16T05:26:56.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-09-16T05:26:56.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-09-16T05:26:56.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=200 2024-09-16T05:26:56.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-09-16T05:26:56.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=400 2024-09-16T05:26:56.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-09-16T05:26:56.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-09-16T05:26:56.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-09-16T05:26:56.809 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-09-16T05:26:56.809 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-09-16T05:26:56.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-09-16T05:26:56.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-09-16T05:26:56.813 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-09-16T05:26:56.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-09-16T05:26:56.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-09-16T05:26:56.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-09-16T05:26:56.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-09-16T05:26:56.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-09-16T05:26:56.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-09-16T05:26:56.829 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-09-16T05:26:56.829 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:26:56.829 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-09-16T05:26:56.829 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-09-16T05:26:56.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[2,4,3]/[1,0]' 2024-09-16T05:26:56.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[2,4,3]/[1,0]' ']' 2024-09-16T05:26:56.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-09-16T05:26:56.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:26:56.855 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:26:56.855 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [2,4,3]/[1,0] ' 2024-09-16T05:26:56.855 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-09-16T05:26:56.855 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-09-16T05:26:56.855 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:26:56.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=200 2024-09-16T05:26:56.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 200 ']' 2024-09-16T05:26:56.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 200 200 2024-09-16T05:26:56.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-09-16T05:26:56.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:26:56.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-09-16T05:26:56.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:26:56.860 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:26:56.860 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:26:56.861 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-09-16T05:26:56.861 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:26:56.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=1 2024-09-16T05:26:56.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 1 ']' 2024-09-16T05:26:56.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 1 0 2024-09-16T05:26:56.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-09-16T05:26:56.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:26:56.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:26:56.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:26:56.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-09-16T05:26:56.872 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:26:56.872 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:26:56.872 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [2,4,3]/[1,0] ' 2024-09-16T05:26:56.872 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-09-16T05:26:56.873 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-09-16T05:26:56.873 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:26:56.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=400 2024-09-16T05:26:56.877 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 400 ']' 2024-09-16T05:26:56.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 400 400 2024-09-16T05:26:56.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-09-16T05:26:56.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:26:56.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-09-16T05:26:56.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:26:56.878 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:26:56.878 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:26:56.878 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-09-16T05:26:56.878 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:26:56.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=2 2024-09-16T05:26:56.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 2 ']' 2024-09-16T05:26:56.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 2 0 2024-09-16T05:26:56.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=2 2024-09-16T05:26:56.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:26:56.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:26:56.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:26:56.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-09-16T05:26:56.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:374: TEST_backfill_out2: delete_pool test 2024-09-16T05:26:56.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T05:26:56.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T05:26:57.382 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T05:26:57.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:375: TEST_backfill_out2: kill_daemons td/osd-backfill-stats 2024-09-16T05:26:57.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:26:57.394 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:26:57.394 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:26:57.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:26:57.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:27:02.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:27:02.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-09-16T05:27:02.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:27:02.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:27:02.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:27:02.712 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:27:02.712 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:27:02.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:27:02.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:27:02.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:27:02.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:27:02.722 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:27:02.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:27:02.723 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:27:02.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:27:02.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:27:02.724 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:27:02.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:27:02.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:27:02.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:27:02.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:27:02.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:27:02.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:27:02.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:27:02.772 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:27:02.772 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:27:02.772 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:27:02.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:27:02.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:27:02.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:27:02.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-09-16T05:27:02.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-09-16T05:27:02.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-stats 2024-09-16T05:27:02.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-stats 2024-09-16T05:27:02.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:27:02.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:27:02.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:27:02.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:27:02.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:27:02.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:27:02.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:27:02.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:27:02.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:27:02.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:27:02.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:27:02.777 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:27:02.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:27:02.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:27:02.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:27:02.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:27:02.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:27:02.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:27:02.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:27:02.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:27:02.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:27:02.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:27:02.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:27:02.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:27:02.784 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:27:02.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:27:02.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:27:02.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:27:02.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-stats 2024-09-16T05:27:02.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T05:27:02.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:27:02.787 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:27:02.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.478321 2024-09-16T05:27:02.790 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T05:27:02.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T05:27:02.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T05:27:02.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-09-16T05:27:02.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_remapped td/osd-backfill-stats 2024-09-16T05:27:02.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:442: TEST_backfill_remapped: local dir=td/osd-backfill-stats 2024-09-16T05:27:02.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:444: TEST_backfill_remapped: run_mon td/osd-backfill-stats a 2024-09-16T05:27:02.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-stats 2024-09-16T05:27:02.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T05:27:02.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T05:27:02.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T05:27:02.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-stats/a 2024-09-16T05:27:02.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-09-16T05:27:03.262 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T05:27:03.262 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:27:03.262 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:27:03.262 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:27:03.263 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:27:03.263 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:27:03.263 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:27:03.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T05:27:03.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T05:27:03.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T05:27:03.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:27:03.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:27:03.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T05:27:03.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T05:27:03.440 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:27:03.440 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:27:03.440 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:27:03.440 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:27:03.440 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:27:03.441 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:27:03.441 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:27:03.441 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:27:03.441 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get fsid 2024-09-16T05:27:03.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T05:27:03.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:27:03.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:27:03.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T05:27:03.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T05:27:03.532 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:27:03.532 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:27:03.532 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:27:03.533 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:27:03.533 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:27:03.533 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:27:03.533 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:27:03.533 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:27:03.534 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get mon_host 2024-09-16T05:27:03.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:445: TEST_backfill_remapped: run_mgr td/osd-backfill-stats x 2024-09-16T05:27:03.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-stats 2024-09-16T05:27:03.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T05:27:03.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T05:27:03.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T05:27:03.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-stats/x 2024-09-16T05:27:03.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T05:27:04.469 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T05:27:04.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:27:04.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:27:04.470 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:27:04.470 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:27:04.470 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:27:04.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:27:04.470 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:27:04.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:27:04.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:446: TEST_backfill_remapped: run_osd td/osd-backfill-stats 0 2024-09-16T05:27:04.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:27:04.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:27:04.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T05:27:04.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:27:04.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/0 2024-09-16T05:27:04.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:27:04.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:27:04.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:27:04.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:27:04.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-09-16T05:27:04.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-09-16T05:27:04.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:27:04.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:27:04.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:27:04.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:27:04.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:27:04.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:27:04.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:27:04.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:27:04.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:27:04.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:27:04.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/0 2024-09-16T05:27:04.507 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:27:04.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c3e4608b-c4f5-4421-9cce-f70cdd61f5eb 2024-09-16T05:27:04.508 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 c3e4608b-c4f5-4421-9cce-f70cdd61f5eb 2024-09-16T05:27:04.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c3e4608b-c4f5-4421-9cce-f70cdd61f5eb' 2024-09-16T05:27:04.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:27:04.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCowedm8H03HxAATCLx66fOfQ1DKA75He3iFg== 2024-09-16T05:27:04.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCowedm8H03HxAATCLx66fOfQ1DKA75He3iFg=="}' 2024-09-16T05:27:04.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c3e4608b-c4f5-4421-9cce-f70cdd61f5eb -i td/osd-backfill-stats/0/new.json 2024-09-16T05:27:04.829 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:27:04.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/0/new.json 2024-09-16T05:27:04.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCowedm8H03HxAATCLx66fOfQ1DKA75He3iFg== --osd-uuid c3e4608b-c4f5-4421-9cce-f70cdd61f5eb 2024-09-16T05:27:04.871 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:04.870+0000 7f462573e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:27:04.897 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:04.896+0000 7f462573e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:27:04.898 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:04.897+0000 7f462573e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:27:04.898 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:04.898+0000 7f462573e640 -1 bdev(0x5567231c5c00 td/osd-backfill-stats/0/block) open stat got: (1) Operation not permitted 2024-09-16T05:27:04.899 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:04.898+0000 7f462573e640 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-09-16T05:27:10.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-09-16T05:27:10.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:27:10.562 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T05:27:10.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T05:27:10.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:27:11.150 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T05:27:11.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T05:27:11.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:27:11.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:27:11.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:27:11.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:27:11.181 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:11.179+0000 7fdaca5dd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:27:11.183 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:11.181+0000 7fdaca5dd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:27:11.184 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:11.183+0000 7fdaca5dd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:27:11.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T05:27:11.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:27:11.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T05:27:11.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:27:11.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:27:11.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:11.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:27:11.609 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:27:11.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:11.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:12.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:12.273 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:12.272+0000 7fdaca5dd640 -1 Falling back to public interface 2024-09-16T05:27:13.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:13.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:13.044 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:27:13.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:27:13.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:13.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:13.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:14.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:14.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:14.495 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:27:14.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:27:14.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:14.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:14.861 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:14.859+0000 7fdaca5dd640 -1 osd.0 0 log_to_monitors true 2024-09-16T05:27:15.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:16.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:16.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:16.014 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:27:16.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:27:16.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:16.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:16.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:17.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:17.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:17.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:27:17.431 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:27:17.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:17.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:17.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:18.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:18.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:18.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:27:18.955 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:27:18.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:18.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:19.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:20.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:20.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:20.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:27:20.390 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:27:20.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:20.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:20.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:21.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:21.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:21.815 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:27:21.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:27:21.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:21.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:22.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:23.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:23.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:23.251 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:27:23.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:27:23.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:23.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:23.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:24.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:24.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:24.731 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:27:24.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:27:24.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:24.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:25.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:26.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:26.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:26.146 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:27:26.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:27:26.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:26.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:26.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:27.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:27.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:27.704 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:27:27.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:27:27.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:27.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:28.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:29.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:29.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:29.181 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:27:29.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:27:29.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:29.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:30.097 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:31.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:31.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:31.099 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:27:31.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:27:31.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:31.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:31.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:32.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:32.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:32.948 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:27:32.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:27:32.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:32.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:33.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:34.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:34.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:34.910 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:27:34.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:27:34.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:34.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:36.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:37.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:37.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:37.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:27:37.183 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:27:37.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:37.183 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:27:37.643 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3995559929,v1:127.0.0.1:6803/3995559929] [v2:127.0.0.1:6804/3995559929,v1:127.0.0.1:6805/3995559929] exists,up c3e4608b-c4f5-4421-9cce-f70cdd61f5eb 2024-09-16T05:27:37.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:27:37.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:27:37.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:27:37.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:447: TEST_backfill_remapped: run_osd td/osd-backfill-stats 1 2024-09-16T05:27:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:27:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:27:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T05:27:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:27:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/1 2024-09-16T05:27:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:27:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:27:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:27:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:27:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-09-16T05:27:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-09-16T05:27:37.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:27:37.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:27:37.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:27:37.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:27:37.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:27:37.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:27:37.649 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:27:37.649 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:27:37.649 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:27:37.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:27:37.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:27:37.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:27:37.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:27:37.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:27:37.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:27:37.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:27:37.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:27:37.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:27:37.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:27:37.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:27:37.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:27:37.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:27:37.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/1 2024-09-16T05:27:37.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:27:37.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0e11d051-367e-40e0-af6b-2f6a916168a6 2024-09-16T05:27:37.652 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 0e11d051-367e-40e0-af6b-2f6a916168a6 2024-09-16T05:27:37.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 0e11d051-367e-40e0-af6b-2f6a916168a6' 2024-09-16T05:27:37.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:27:37.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDJwedm6lK4JxAA9fwKh7aYvNbfL7BelDq/ew== 2024-09-16T05:27:37.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDJwedm6lK4JxAA9fwKh7aYvNbfL7BelDq/ew=="}' 2024-09-16T05:27:37.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0e11d051-367e-40e0-af6b-2f6a916168a6 -i td/osd-backfill-stats/1/new.json 2024-09-16T05:27:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:27:38.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/1/new.json 2024-09-16T05:27:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDJwedm6lK4JxAA9fwKh7aYvNbfL7BelDq/ew== --osd-uuid 0e11d051-367e-40e0-af6b-2f6a916168a6 2024-09-16T05:27:38.234 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:38.233+0000 7f6cd8e1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:27:38.236 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:38.235+0000 7f6cd8e1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:27:38.237 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:38.236+0000 7f6cd8e1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:27:38.238 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:38.237+0000 7f6cd8e1e640 -1 bdev(0x5585f0545c00 td/osd-backfill-stats/1/block) open stat got: (1) Operation not permitted 2024-09-16T05:27:38.238 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:38.237+0000 7f6cd8e1e640 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-09-16T05:27:44.094 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-09-16T05:27:44.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:27:44.096 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T05:27:44.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T05:27:44.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:27:44.662 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T05:27:44.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T05:27:44.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:27:44.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:27:44.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:27:44.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:27:44.692 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:44.691+0000 7f23c4214640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:27:44.695 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:44.694+0000 7f23c4214640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:27:44.696 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:44.695+0000 7f23c4214640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:27:45.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T05:27:45.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:27:45.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T05:27:45.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:27:45.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:27:45.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:45.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:27:45.106 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:27:45.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:45.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:27:45.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:45.557 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:45.557+0000 7f23c4214640 -1 Falling back to public interface 2024-09-16T05:27:46.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:46.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:46.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:27:46.545 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:27:46.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:46.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:27:46.958 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:47.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:47.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:47.960 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:27:47.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:27:47.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:47.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:27:48.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:48.908 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:27:48.908+0000 7f23c4214640 -1 osd.1 0 log_to_monitors true 2024-09-16T05:27:49.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:49.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:49.370 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:27:49.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:27:49.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:49.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:27:49.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:50.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:50.946 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:27:50.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:50.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:27:50.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:50.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:27:51.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:52.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:52.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:52.488 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:27:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:27:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:52.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:27:52.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:53.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:53.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:53.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:27:53.825 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:27:53.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:53.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:27:54.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:55.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:55.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:55.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:27:55.284 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:27:55.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:55.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:27:55.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:56.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:56.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:56.805 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:27:56.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:27:56.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:56.806 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:27:57.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:58.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:58.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:58.220 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:27:58.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:27:58.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:58.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:27:58.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:27:59.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:27:59.691 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:27:59.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:27:59.692 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:27:59.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:27:59.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:28:00.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:01.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:01.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:01.130 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:28:01.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:28:01.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:01.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:28:01.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:02.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:02.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:02.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:28:02.651 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:28:02.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:02.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:28:03.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:04.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:04.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:04.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:28:04.149 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:28:04.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:04.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:28:04.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:05.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:05.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:05.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:28:05.897 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:28:05.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:05.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:28:06.878 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:07.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:07.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:07.880 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:28:07.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:28:07.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:07.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:28:08.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:09.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:09.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:09.623 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:28:09.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:28:09.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:09.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:28:10.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:11.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:11.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:11.415 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:28:11.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:28:11.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:11.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:28:11.924 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3377311467,v1:127.0.0.1:6811/3377311467] [v2:127.0.0.1:6812/3377311467,v1:127.0.0.1:6813/3377311467] exists,up 0e11d051-367e-40e0-af6b-2f6a916168a6 2024-09-16T05:28:11.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:28:11.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:28:11.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:28:11.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:448: TEST_backfill_remapped: run_osd td/osd-backfill-stats 2 2024-09-16T05:28:11.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:28:11.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:28:11.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T05:28:11.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:28:11.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/2 2024-09-16T05:28:11.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:28:11.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:28:11.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:28:11.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:28:11.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-09-16T05:28:11.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-09-16T05:28:11.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:28:11.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:28:11.929 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:28:11.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:28:11.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:28:11.929 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:28:11.929 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:28:11.929 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:28:11.929 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:28:11.930 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:28:11.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:28:11.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:28:11.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:28:11.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:28:11.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:28:11.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:28:11.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:28:11.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:28:11.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:28:11.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:28:11.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:28:11.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:28:11.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/2 2024-09-16T05:28:11.931 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:28:11.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=59ffd808-691a-42cd-a9fc-5f69977a4be0 2024-09-16T05:28:11.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 59ffd808-691a-42cd-a9fc-5f69977a4be0' 2024-09-16T05:28:11.931 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 59ffd808-691a-42cd-a9fc-5f69977a4be0 2024-09-16T05:28:11.931 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:28:11.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDrwedmDZpxOBAAJtmh/fgECnb+7vpYzpWqXA== 2024-09-16T05:28:11.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDrwedmDZpxOBAAJtmh/fgECnb+7vpYzpWqXA=="}' 2024-09-16T05:28:11.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 59ffd808-691a-42cd-a9fc-5f69977a4be0 -i td/osd-backfill-stats/2/new.json 2024-09-16T05:28:12.607 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:28:12.618 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/2/new.json 2024-09-16T05:28:12.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDrwedmDZpxOBAAJtmh/fgECnb+7vpYzpWqXA== --osd-uuid 59ffd808-691a-42cd-a9fc-5f69977a4be0 2024-09-16T05:28:12.651 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:12.650+0000 7f04c8a16640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:28:12.653 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:12.652+0000 7f04c8a16640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:28:12.654 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:12.653+0000 7f04c8a16640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:28:12.654 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:12.654+0000 7f04c8a16640 -1 bdev(0x55ded9aadc00 td/osd-backfill-stats/2/block) open stat got: (1) Operation not permitted 2024-09-16T05:28:12.654 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:12.654+0000 7f04c8a16640 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-09-16T05:28:18.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-09-16T05:28:18.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:28:18.891 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T05:28:18.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T05:28:18.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:28:19.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T05:28:19.464 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T05:28:19.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:28:19.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:28:19.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:28:19.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:28:19.494 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:19.492+0000 7f0077232640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:28:19.495 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:19.494+0000 7f0077232640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:28:19.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:19.495+0000 7f0077232640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:28:19.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T05:28:19.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:28:19.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T05:28:19.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:28:19.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:28:19.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:19.889 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:28:19.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:28:19.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:19.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:20.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:20.845 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:20.843+0000 7f0077232640 -1 Falling back to public interface 2024-09-16T05:28:21.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:21.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:21.357 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:28:21.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:28:21.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:21.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:21.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:22.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:22.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:22.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:28:22.778 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:28:22.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:22.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:23.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:23.780 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:23.778+0000 7f0077232640 -1 osd.2 0 log_to_monitors true 2024-09-16T05:28:24.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:24.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:24.190 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:28:24.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:28:24.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:24.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:24.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:25.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:25.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:25.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:28:25.860 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:28:25.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:25.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:26.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:27.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:27.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:27.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:28:27.279 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:28:27.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:27.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:27.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:28.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:28.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:28.892 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:28:28.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:28:28.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:28.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:29.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:30.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:30.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:30.315 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:28:30.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:28:30.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:30.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:30.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:31.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:31.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:31.894 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:28:31.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:28:31.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:31.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:32.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:33.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:33.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:33.399 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:28:33.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:28:33.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:33.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:33.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:34.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:34.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:34.884 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:28:34.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:28:34.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:34.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:35.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:36.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:36.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:36.301 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:28:36.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:28:36.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:36.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:36.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:37.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:37.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:37.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:28:37.722 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:28:37.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:37.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:38.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:39.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:39.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:39.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:28:39.555 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:28:39.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:39.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:40.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:41.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:41.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:41.360 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:28:41.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:28:41.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:41.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:42.088 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:43.089 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:43.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:43.090 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:28:43.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:28:43.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:43.091 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:43.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:44.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:44.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:44.909 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:28:44.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:28:44.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:44.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:45.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:46.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:46.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:46.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:28:46.456 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:28:46.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:46.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:28:46.952 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4277294430,v1:127.0.0.1:6819/4277294430] [v2:127.0.0.1:6820/4277294430,v1:127.0.0.1:6821/4277294430] exists,up 59ffd808-691a-42cd-a9fc-5f69977a4be0 2024-09-16T05:28:46.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:28:46.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:28:46.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:28:46.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:449: TEST_backfill_remapped: run_osd td/osd-backfill-stats 3 2024-09-16T05:28:46.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:28:46.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:28:46.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T05:28:46.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:28:46.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/3 2024-09-16T05:28:46.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:28:46.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:28:46.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:28:46.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:28:46.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-09-16T05:28:46.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-09-16T05:28:46.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:28:46.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:28:46.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:28:46.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:28:46.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:28:46.962 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:28:46.962 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:28:46.962 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:28:46.962 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:28:46.962 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:28:46.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:28:46.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:28:46.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:28:46.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:28:46.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:28:46.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:28:46.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:28:46.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:28:46.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:28:46.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:28:46.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:28:46.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:28:46.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/3 2024-09-16T05:28:46.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:28:46.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1f63d2b7-7709-4251-a68f-06b5cdccc544 2024-09-16T05:28:46.965 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 1f63d2b7-7709-4251-a68f-06b5cdccc544 2024-09-16T05:28:46.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 1f63d2b7-7709-4251-a68f-06b5cdccc544' 2024-09-16T05:28:46.967 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:28:46.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAOwudmyGIaOhAAk0jv/YmAAvNuSeovQtjcyg== 2024-09-16T05:28:46.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAOwudmyGIaOhAAk0jv/YmAAvNuSeovQtjcyg=="}' 2024-09-16T05:28:46.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1f63d2b7-7709-4251-a68f-06b5cdccc544 -i td/osd-backfill-stats/3/new.json 2024-09-16T05:28:47.562 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:28:47.573 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/3/new.json 2024-09-16T05:28:47.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAOwudmyGIaOhAAk0jv/YmAAvNuSeovQtjcyg== --osd-uuid 1f63d2b7-7709-4251-a68f-06b5cdccc544 2024-09-16T05:28:47.605 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:47.604+0000 7f76e91c5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:28:47.607 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:47.606+0000 7f76e91c5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:28:47.608 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:47.607+0000 7f76e91c5640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:28:47.608 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:47.608+0000 7f76e91c5640 -1 bdev(0x556191f7bc00 td/osd-backfill-stats/3/block) open stat got: (1) Operation not permitted 2024-09-16T05:28:47.608 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:47.608+0000 7f76e91c5640 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-09-16T05:28:53.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-09-16T05:28:53.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:28:53.317 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T05:28:53.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T05:28:53.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:28:53.888 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T05:28:53.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T05:28:53.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:28:53.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:28:53.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:28:53.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:28:53.918 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:53.917+0000 7f3f8ac83640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:28:53.920 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:53.919+0000 7f3f8ac83640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:28:53.921 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:53.920+0000 7f3f8ac83640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:28:54.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T05:28:54.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:28:54.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T05:28:54.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:28:54.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:28:54.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:54.323 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:28:54.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:28:54.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:54.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:28:54.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:55.515 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:55.514+0000 7f3f8ac83640 -1 Falling back to public interface 2024-09-16T05:28:55.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:55.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:55.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:28:55.782 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:28:55.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:55.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:28:56.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:57.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:57.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:57.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:28:57.235 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:28:57.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:57.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:28:57.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:28:58.222 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:28:58.221+0000 7f3f8ac83640 -1 osd.3 0 log_to_monitors true 2024-09-16T05:28:58.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:28:58.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:28:58.671 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:28:58.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:28:58.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:28:58.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:28:59.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:00.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:00.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:00.302 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:29:00.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:29:00.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:00.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:00.718 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:01.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:01.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:01.720 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:29:01.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:29:01.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:01.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:02.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:03.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:03.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:03.245 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:29:03.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:29:03.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:03.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:03.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:04.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:04.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:04.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:29:04.665 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:29:04.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:04.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:05.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:06.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:06.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:06.234 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:29:06.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:29:06.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:06.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:06.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:07.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:07.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:07.649 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:29:07.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:29:07.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:07.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:08.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:09.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:09.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:09.132 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:29:09.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:29:09.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:09.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:09.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:10.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:10.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:10.633 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:29:10.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:29:10.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:10.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:11.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:12.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:12.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:12.547 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:29:12.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:29:12.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:12.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:13.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:14.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:14.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:14.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:29:14.489 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:29:14.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:14.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:15.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:16.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:16.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:16.214 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:29:16.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:29:16.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:16.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:17.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:18.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:18.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:18.086 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:29:18.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:29:18.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:18.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:18.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:19.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:19.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:19.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:29:19.625 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:29:19.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:19.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:20.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:29:21.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:29:21.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:29:21.417 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:29:21.418 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:29:21.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:29:21.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:29:21.906 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2938861106,v1:127.0.0.1:6827/2938861106] [v2:127.0.0.1:6828/2938861106,v1:127.0.0.1:6829/2938861106] exists,up 1f63d2b7-7709-4251-a68f-06b5cdccc544 2024-09-16T05:29:21.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:29:21.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:29:21.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:29:21.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:451: TEST_backfill_remapped: create_pool test 1 1 2024-09-16T05:29:21.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2024-09-16T05:29:22.663 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T05:29:22.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T05:29:23.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:452: TEST_backfill_remapped: ceph osd pool set test size 3 2024-09-16T05:29:24.374 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 3 2024-09-16T05:29:24.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:453: TEST_backfill_remapped: sleep 5 2024-09-16T05:29:29.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:455: TEST_backfill_remapped: wait_for_clean 2024-09-16T05:29:29.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:29:29.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:29:29.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:29:29.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:29:29.389 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:29:29.389 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:29:29.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:29:29.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:29:29.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:29:29.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:29:29.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:29:29.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:29:29.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:29:29.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:29:29.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:29:29.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:29:29.941 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:29:29.941 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:29:29.941 INFO:tasks.workunit.client.0.smithi026.stderr:3' 2024-09-16T05:29:29.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:29:29.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:29:29.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:29:30.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836509 2024-09-16T05:29:30.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836509 2024-09-16T05:29:30.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836509' 2024-09-16T05:29:30.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:29:30.098 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:29:30.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=38654705685 2024-09-16T05:29:30.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 38654705685 2024-09-16T05:29:30.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836509 1-38654705685' 2024-09-16T05:29:30.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:29:30.217 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:29:30.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=60129542160 2024-09-16T05:29:30.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 60129542160 2024-09-16T05:29:30.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836509 1-38654705685 2-60129542160' 2024-09-16T05:29:30.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:29:30.335 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:29:30.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=81604378633 2024-09-16T05:29:30.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 81604378633 2024-09-16T05:29:30.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836509 1-38654705685 2-60129542160 3-81604378633' 2024-09-16T05:29:30.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:29:30.453 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836509 2024-09-16T05:29:30.453 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:29:30.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:29:30.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836509 2024-09-16T05:29:30.454 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:29:30.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836509 2024-09-16T05:29:30.455 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836509 2024-09-16T05:29:30.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836509' 2024-09-16T05:29:30.456 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:29:30.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836509 -lt 21474836509 2024-09-16T05:29:30.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:29:30.909 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-38654705685 2024-09-16T05:29:30.910 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:29:30.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:29:30.910 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-38654705685 2024-09-16T05:29:30.911 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:29:30.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=38654705685 2024-09-16T05:29:30.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 38654705685' 2024-09-16T05:29:30.912 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 38654705685 2024-09-16T05:29:30.912 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:29:31.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 38654705685 -lt 38654705685 2024-09-16T05:29:31.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:29:31.351 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-60129542160 2024-09-16T05:29:31.351 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:29:31.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:29:31.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-60129542160 2024-09-16T05:29:31.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:29:31.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=60129542160 2024-09-16T05:29:31.353 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 60129542160' 2024-09-16T05:29:31.354 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 60129542160 2024-09-16T05:29:31.354 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:29:31.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 60129542160 -lt 60129542160 2024-09-16T05:29:31.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:29:31.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-81604378633 2024-09-16T05:29:31.795 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:29:31.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:29:31.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-81604378633 2024-09-16T05:29:31.796 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:29:31.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=81604378633 2024-09-16T05:29:31.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 81604378633' 2024-09-16T05:29:31.797 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 81604378633 2024-09-16T05:29:31.798 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:29:32.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 81604378633 -lt 81604378633 2024-09-16T05:29:32.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:29:32.237 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:29:32.238 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:29:32.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:29:32.788 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:29:32.788 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:29:32.788 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:29:32.788 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:29:32.788 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:29:32.788 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:29:32.788 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:29:33.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:29:33.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:29:33.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:29:33.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:29:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:29:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:29:33.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:29:33.742 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: seq 1 200 2024-09-16T05:29:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:33.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj1 /dev/null 2024-09-16T05:29:33.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:33.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj2 /dev/null 2024-09-16T05:29:34.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:34.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj3 /dev/null 2024-09-16T05:29:34.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:34.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj4 /dev/null 2024-09-16T05:29:34.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:34.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj5 /dev/null 2024-09-16T05:29:34.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:34.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj6 /dev/null 2024-09-16T05:29:34.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:34.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj7 /dev/null 2024-09-16T05:29:34.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:34.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj8 /dev/null 2024-09-16T05:29:34.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:34.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj9 /dev/null 2024-09-16T05:29:34.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:34.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj10 /dev/null 2024-09-16T05:29:34.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:34.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj11 /dev/null 2024-09-16T05:29:35.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:35.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj12 /dev/null 2024-09-16T05:29:35.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:35.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj13 /dev/null 2024-09-16T05:29:35.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:35.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj14 /dev/null 2024-09-16T05:29:35.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:35.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj15 /dev/null 2024-09-16T05:29:35.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:35.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj16 /dev/null 2024-09-16T05:29:35.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:35.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj17 /dev/null 2024-09-16T05:29:35.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:35.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj18 /dev/null 2024-09-16T05:29:35.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:35.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj19 /dev/null 2024-09-16T05:29:36.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:36.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj20 /dev/null 2024-09-16T05:29:36.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:36.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj21 /dev/null 2024-09-16T05:29:36.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:36.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj22 /dev/null 2024-09-16T05:29:36.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:36.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj23 /dev/null 2024-09-16T05:29:36.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:36.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj24 /dev/null 2024-09-16T05:29:36.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:36.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj25 /dev/null 2024-09-16T05:29:36.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:36.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj26 /dev/null 2024-09-16T05:29:36.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:36.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj27 /dev/null 2024-09-16T05:29:36.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:36.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj28 /dev/null 2024-09-16T05:29:37.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:37.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj29 /dev/null 2024-09-16T05:29:37.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:37.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj30 /dev/null 2024-09-16T05:29:37.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:37.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj31 /dev/null 2024-09-16T05:29:37.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:37.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj32 /dev/null 2024-09-16T05:29:37.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:37.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj33 /dev/null 2024-09-16T05:29:37.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:37.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj34 /dev/null 2024-09-16T05:29:37.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:37.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj35 /dev/null 2024-09-16T05:29:37.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:37.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj36 /dev/null 2024-09-16T05:29:37.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:37.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj37 /dev/null 2024-09-16T05:29:38.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:38.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj38 /dev/null 2024-09-16T05:29:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:38.203 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj39 /dev/null 2024-09-16T05:29:38.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:38.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj40 /dev/null 2024-09-16T05:29:38.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:38.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj41 /dev/null 2024-09-16T05:29:38.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:38.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj42 /dev/null 2024-09-16T05:29:38.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:38.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj43 /dev/null 2024-09-16T05:29:38.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:38.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj44 /dev/null 2024-09-16T05:29:38.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:38.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj45 /dev/null 2024-09-16T05:29:39.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:39.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj46 /dev/null 2024-09-16T05:29:39.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:39.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj47 /dev/null 2024-09-16T05:29:39.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:39.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj48 /dev/null 2024-09-16T05:29:39.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:39.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj49 /dev/null 2024-09-16T05:29:39.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:39.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj50 /dev/null 2024-09-16T05:29:39.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:39.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj51 /dev/null 2024-09-16T05:29:39.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:39.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj52 /dev/null 2024-09-16T05:29:39.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:39.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj53 /dev/null 2024-09-16T05:29:40.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:40.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj54 /dev/null 2024-09-16T05:29:40.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:40.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj55 /dev/null 2024-09-16T05:29:40.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:40.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj56 /dev/null 2024-09-16T05:29:40.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:40.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj57 /dev/null 2024-09-16T05:29:40.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:40.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj58 /dev/null 2024-09-16T05:29:40.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:40.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj59 /dev/null 2024-09-16T05:29:40.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:40.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj60 /dev/null 2024-09-16T05:29:40.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:40.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj61 /dev/null 2024-09-16T05:29:40.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:40.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj62 /dev/null 2024-09-16T05:29:41.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:41.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj63 /dev/null 2024-09-16T05:29:41.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:41.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj64 /dev/null 2024-09-16T05:29:41.292 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:41.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj65 /dev/null 2024-09-16T05:29:41.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:41.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj66 /dev/null 2024-09-16T05:29:41.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:41.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj67 /dev/null 2024-09-16T05:29:41.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:41.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj68 /dev/null 2024-09-16T05:29:41.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:41.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj69 /dev/null 2024-09-16T05:29:41.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:41.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj70 /dev/null 2024-09-16T05:29:42.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:42.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj71 /dev/null 2024-09-16T05:29:42.154 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:42.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj72 /dev/null 2024-09-16T05:29:42.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:42.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj73 /dev/null 2024-09-16T05:29:42.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:42.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj74 /dev/null 2024-09-16T05:29:42.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:42.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj75 /dev/null 2024-09-16T05:29:42.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:42.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj76 /dev/null 2024-09-16T05:29:42.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:42.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj77 /dev/null 2024-09-16T05:29:42.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:42.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj78 /dev/null 2024-09-16T05:29:42.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:42.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj79 /dev/null 2024-09-16T05:29:43.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:43.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj80 /dev/null 2024-09-16T05:29:43.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:43.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj81 /dev/null 2024-09-16T05:29:43.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:43.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj82 /dev/null 2024-09-16T05:29:43.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:43.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj83 /dev/null 2024-09-16T05:29:43.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:43.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj84 /dev/null 2024-09-16T05:29:43.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:43.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj85 /dev/null 2024-09-16T05:29:43.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:43.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj86 /dev/null 2024-09-16T05:29:43.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:43.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj87 /dev/null 2024-09-16T05:29:44.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:44.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj88 /dev/null 2024-09-16T05:29:44.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:44.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj89 /dev/null 2024-09-16T05:29:44.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:44.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj90 /dev/null 2024-09-16T05:29:44.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:44.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj91 /dev/null 2024-09-16T05:29:44.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:44.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj92 /dev/null 2024-09-16T05:29:44.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:44.617 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj93 /dev/null 2024-09-16T05:29:44.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:44.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj94 /dev/null 2024-09-16T05:29:44.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:44.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj95 /dev/null 2024-09-16T05:29:44.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:44.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj96 /dev/null 2024-09-16T05:29:45.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:45.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj97 /dev/null 2024-09-16T05:29:45.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:45.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj98 /dev/null 2024-09-16T05:29:45.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:45.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj99 /dev/null 2024-09-16T05:29:45.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:45.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj100 /dev/null 2024-09-16T05:29:45.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:45.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj101 /dev/null 2024-09-16T05:29:45.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:45.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj102 /dev/null 2024-09-16T05:29:45.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:45.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj103 /dev/null 2024-09-16T05:29:45.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:45.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj104 /dev/null 2024-09-16T05:29:46.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:46.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj105 /dev/null 2024-09-16T05:29:46.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:46.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj106 /dev/null 2024-09-16T05:29:46.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:46.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj107 /dev/null 2024-09-16T05:29:46.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:46.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj108 /dev/null 2024-09-16T05:29:46.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:46.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj109 /dev/null 2024-09-16T05:29:46.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:46.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj110 /dev/null 2024-09-16T05:29:46.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:46.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj111 /dev/null 2024-09-16T05:29:46.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:46.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj112 /dev/null 2024-09-16T05:29:46.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:46.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj113 /dev/null 2024-09-16T05:29:47.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:47.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj114 /dev/null 2024-09-16T05:29:47.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:47.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj115 /dev/null 2024-09-16T05:29:47.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:47.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj116 /dev/null 2024-09-16T05:29:47.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:47.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj117 /dev/null 2024-09-16T05:29:47.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:47.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj118 /dev/null 2024-09-16T05:29:47.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:47.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj119 /dev/null 2024-09-16T05:29:47.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:47.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj120 /dev/null 2024-09-16T05:29:47.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:47.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj121 /dev/null 2024-09-16T05:29:48.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:48.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj122 /dev/null 2024-09-16T05:29:48.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:48.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj123 /dev/null 2024-09-16T05:29:48.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:48.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj124 /dev/null 2024-09-16T05:29:48.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:48.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj125 /dev/null 2024-09-16T05:29:48.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:48.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj126 /dev/null 2024-09-16T05:29:48.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:48.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj127 /dev/null 2024-09-16T05:29:48.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:48.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj128 /dev/null 2024-09-16T05:29:48.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:48.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj129 /dev/null 2024-09-16T05:29:48.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:48.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj130 /dev/null 2024-09-16T05:29:49.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:49.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj131 /dev/null 2024-09-16T05:29:49.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:49.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj132 /dev/null 2024-09-16T05:29:49.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:49.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj133 /dev/null 2024-09-16T05:29:49.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:49.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj134 /dev/null 2024-09-16T05:29:49.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:49.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj135 /dev/null 2024-09-16T05:29:49.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:49.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj136 /dev/null 2024-09-16T05:29:49.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:49.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj137 /dev/null 2024-09-16T05:29:49.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:49.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj138 /dev/null 2024-09-16T05:29:50.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:50.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj139 /dev/null 2024-09-16T05:29:50.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:50.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj140 /dev/null 2024-09-16T05:29:50.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:50.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj141 /dev/null 2024-09-16T05:29:50.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:50.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj142 /dev/null 2024-09-16T05:29:50.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:50.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj143 /dev/null 2024-09-16T05:29:50.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:50.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj144 /dev/null 2024-09-16T05:29:50.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:50.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj145 /dev/null 2024-09-16T05:29:50.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:50.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj146 /dev/null 2024-09-16T05:29:50.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:50.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj147 /dev/null 2024-09-16T05:29:51.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:51.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj148 /dev/null 2024-09-16T05:29:51.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:51.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj149 /dev/null 2024-09-16T05:29:51.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:51.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj150 /dev/null 2024-09-16T05:29:51.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:51.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj151 /dev/null 2024-09-16T05:29:51.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:51.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj152 /dev/null 2024-09-16T05:29:51.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:51.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj153 /dev/null 2024-09-16T05:29:51.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:51.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj154 /dev/null 2024-09-16T05:29:51.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:51.944 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj155 /dev/null 2024-09-16T05:29:52.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:52.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj156 /dev/null 2024-09-16T05:29:52.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:52.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj157 /dev/null 2024-09-16T05:29:52.262 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:52.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj158 /dev/null 2024-09-16T05:29:52.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:52.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj159 /dev/null 2024-09-16T05:29:52.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:52.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj160 /dev/null 2024-09-16T05:29:52.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:52.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj161 /dev/null 2024-09-16T05:29:52.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:52.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj162 /dev/null 2024-09-16T05:29:52.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:52.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj163 /dev/null 2024-09-16T05:29:52.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:52.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj164 /dev/null 2024-09-16T05:29:53.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:53.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj165 /dev/null 2024-09-16T05:29:53.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:53.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj166 /dev/null 2024-09-16T05:29:53.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:53.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj167 /dev/null 2024-09-16T05:29:53.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:53.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj168 /dev/null 2024-09-16T05:29:53.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:53.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj169 /dev/null 2024-09-16T05:29:53.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:53.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj170 /dev/null 2024-09-16T05:29:53.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:53.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj171 /dev/null 2024-09-16T05:29:53.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:53.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj172 /dev/null 2024-09-16T05:29:54.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:54.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj173 /dev/null 2024-09-16T05:29:54.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:54.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj174 /dev/null 2024-09-16T05:29:54.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:54.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj175 /dev/null 2024-09-16T05:29:54.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:54.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj176 /dev/null 2024-09-16T05:29:54.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:54.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj177 /dev/null 2024-09-16T05:29:54.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:54.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj178 /dev/null 2024-09-16T05:29:54.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:54.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj179 /dev/null 2024-09-16T05:29:54.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:54.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj180 /dev/null 2024-09-16T05:29:54.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:54.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj181 /dev/null 2024-09-16T05:29:55.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:55.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj182 /dev/null 2024-09-16T05:29:55.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:55.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj183 /dev/null 2024-09-16T05:29:55.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:55.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj184 /dev/null 2024-09-16T05:29:55.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:55.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj185 /dev/null 2024-09-16T05:29:55.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:55.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj186 /dev/null 2024-09-16T05:29:55.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:55.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj187 /dev/null 2024-09-16T05:29:55.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:55.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj188 /dev/null 2024-09-16T05:29:55.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:55.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj189 /dev/null 2024-09-16T05:29:56.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:56.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj190 /dev/null 2024-09-16T05:29:56.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:56.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj191 /dev/null 2024-09-16T05:29:56.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:56.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj192 /dev/null 2024-09-16T05:29:56.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:56.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj193 /dev/null 2024-09-16T05:29:56.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:56.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj194 /dev/null 2024-09-16T05:29:56.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:56.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj195 /dev/null 2024-09-16T05:29:56.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:56.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj196 /dev/null 2024-09-16T05:29:56.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:56.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj197 /dev/null 2024-09-16T05:29:56.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:56.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj198 /dev/null 2024-09-16T05:29:57.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:57.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj199 /dev/null 2024-09-16T05:29:57.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:457: TEST_backfill_remapped: for i in $(seq 1 $objects) 2024-09-16T05:29:57.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:459: TEST_backfill_remapped: rados -p test put obj200 /dev/null 2024-09-16T05:29:57.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:462: TEST_backfill_remapped: get_pg test obj1 2024-09-16T05:29:57.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T05:29:57.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T05:29:57.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T05:29:57.296 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T05:29:57.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:462: TEST_backfill_remapped: local PG=1.0 2024-09-16T05:29:57.727 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:464: TEST_backfill_remapped: get_primary test obj1 2024-09-16T05:29:57.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:29:57.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:29:57.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:29:57.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:29:58.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:464: TEST_backfill_remapped: local primary=1 2024-09-16T05:29:58.193 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:465: TEST_backfill_remapped: get_not_primary test obj1 2024-09-16T05:29:58.193 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2024-09-16T05:29:58.193 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2024-09-16T05:29:58.194 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2024-09-16T05:29:58.194 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:29:58.194 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:29:58.194 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:29:58.194 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:29:58.610 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2024-09-16T05:29:58.610 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2024-09-16T05:29:58.610 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-09-16T05:29:59.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:465: TEST_backfill_remapped: local otherosd=0 2024-09-16T05:29:59.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:467: TEST_backfill_remapped: ceph osd set nobackfill 2024-09-16T05:29:59.733 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is set 2024-09-16T05:29:59.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:468: TEST_backfill_remapped: ceph osd out osd.0 2024-09-16T05:30:00.657 INFO:tasks.workunit.client.0.smithi026.stderr:osd.0 is already out. 2024-09-16T05:30:00.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:469: TEST_backfill_remapped: get_osds test obj1 2024-09-16T05:30:00.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2024-09-16T05:30:00.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=obj1 2024-09-16T05:30:00.670 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test obj1 2024-09-16T05:30:00.670 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2024-09-16T05:30:01.148 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2024-09-16T05:30:01.148 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:30:01.148 INFO:tasks.workunit.client.0.smithi026.stderr:0' 2024-09-16T05:30:01.148 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 2 0 2024-09-16T05:30:01.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:469: TEST_backfill_remapped: for i in $(get_osds $poolname obj1) 2024-09-16T05:30:01.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:471: TEST_backfill_remapped: '[' 1 = 1 -o 1 = 0 ']' 2024-09-16T05:30:01.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:473: TEST_backfill_remapped: continue 2024-09-16T05:30:01.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:469: TEST_backfill_remapped: for i in $(get_osds $poolname obj1) 2024-09-16T05:30:01.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:471: TEST_backfill_remapped: '[' 2 = 1 -o 2 = 0 ']' 2024-09-16T05:30:01.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:475: TEST_backfill_remapped: ceph osd out osd.2 2024-09-16T05:30:01.654 INFO:tasks.workunit.client.0.smithi026.stderr:osd.2 is already out. 2024-09-16T05:30:01.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:476: TEST_backfill_remapped: break 2024-09-16T05:30:01.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:478: TEST_backfill_remapped: ceph osd out osd.1 2024-09-16T05:30:02.593 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. 2024-09-16T05:30:02.605 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:479: TEST_backfill_remapped: ceph osd pool set test size 2 2024-09-16T05:30:03.862 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 2 2024-09-16T05:30:03.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:480: TEST_backfill_remapped: sleep 2 2024-09-16T05:30:05.876 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:484: TEST_backfill_remapped: get_primary test obj1 2024-09-16T05:30:05.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:30:05.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:30:05.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:30:05.877 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:30:06.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:484: TEST_backfill_remapped: primary=0 2024-09-16T05:30:06.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:486: TEST_backfill_remapped: ceph osd unset nobackfill 2024-09-16T05:30:06.982 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is unset 2024-09-16T05:30:06.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:487: TEST_backfill_remapped: ceph tell osd.0 get_latest_osdmap 2024-09-16T05:30:07.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:488: TEST_backfill_remapped: ceph tell osd.0 debug kick_recovery_wq 0 2024-09-16T05:30:07.335 INFO:tasks.workunit.client.0.smithi026.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-09-16T05:30:07.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:490: TEST_backfill_remapped: sleep 2 2024-09-16T05:30:09.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:492: TEST_backfill_remapped: wait_for_clean 2024-09-16T05:30:09.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:30:09.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:30:09.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:30:09.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:30:09.347 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:30:09.347 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:30:09.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:30:09.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:30:09.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:30:09.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:30:09.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:30:09.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:30:09.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:30:09.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:30:09.451 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:30:09.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:30:09.858 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:30:09.858 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:30:09.858 INFO:tasks.workunit.client.0.smithi026.stderr:3' 2024-09-16T05:30:09.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:30:09.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:30:09.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:30:09.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836519 2024-09-16T05:30:09.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836519 2024-09-16T05:30:09.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836519' 2024-09-16T05:30:09.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:30:09.976 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:30:10.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=38654705695 2024-09-16T05:30:10.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 38654705695 2024-09-16T05:30:10.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836519 1-38654705695' 2024-09-16T05:30:10.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:30:10.096 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:30:10.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=60129542170 2024-09-16T05:30:10.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 60129542170 2024-09-16T05:30:10.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836519 1-38654705695 2-60129542170' 2024-09-16T05:30:10.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:30:10.298 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:30:10.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=81604378643 2024-09-16T05:30:10.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 81604378643 2024-09-16T05:30:10.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836519 1-38654705695 2-60129542170 3-81604378643' 2024-09-16T05:30:10.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:30:10.419 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836519 2024-09-16T05:30:10.419 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:30:10.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:30:10.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836519 2024-09-16T05:30:10.420 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:30:10.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836519 2024-09-16T05:30:10.422 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836519 2024-09-16T05:30:10.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836519' 2024-09-16T05:30:10.422 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:30:10.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836519 -lt 21474836519 2024-09-16T05:30:10.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:30:10.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-38654705695 2024-09-16T05:30:10.867 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:30:10.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:30:10.868 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-38654705695 2024-09-16T05:30:10.868 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:30:10.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=38654705695 2024-09-16T05:30:10.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 38654705695' 2024-09-16T05:30:10.870 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 38654705695 2024-09-16T05:30:10.870 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:30:11.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 38654705695 -lt 38654705695 2024-09-16T05:30:11.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:30:11.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-60129542170 2024-09-16T05:30:11.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:30:11.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:30:11.335 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-60129542170 2024-09-16T05:30:11.335 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:30:11.336 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=60129542170 2024-09-16T05:30:11.337 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 60129542170 2024-09-16T05:30:11.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 60129542170' 2024-09-16T05:30:11.337 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:30:11.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 60129542170 -lt 60129542170 2024-09-16T05:30:11.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:30:11.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-81604378643 2024-09-16T05:30:11.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:30:11.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:30:11.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-81604378643 2024-09-16T05:30:11.826 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:30:11.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=81604378643 2024-09-16T05:30:11.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 81604378643' 2024-09-16T05:30:11.828 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 81604378643 2024-09-16T05:30:11.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:30:12.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 81604378643 -lt 81604378643 2024-09-16T05:30:12.304 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:30:12.305 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:30:12.305 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:30:12.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:30:12.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:30:12.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:30:12.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:30:12.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:30:12.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:30:12.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:30:12.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:30:13.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:30:13.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:30:13.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:30:13.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:30:14.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:30:14.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T05:30:14.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T05:30:14.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T05:30:14.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:30:14.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:30:14.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:30:14.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:30:14.116 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:30:14.116 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:30:14.116 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:30:14.116 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:30:14.116 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:30:14.116 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:30:14.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:30:14.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:30:14.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:30:14.545 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:30:15.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:30:15.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:30:15.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:30:15.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:30:15.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:30:15.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:30:15.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:30:15.164 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:30:15.164 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:30:15.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:30:15.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:30:15.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:30:15.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:30:15.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:30:15.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:30:15.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:30:15.955 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:30:15.955 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:30:15.955 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:30:15.955 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:30:15.955 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:30:15.956 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:30:16.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:30:16.403 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:30:16.404 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:30:16.404 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:30:17.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:30:17.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:30:17.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:30:17.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:30:17.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:30:17.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:30:17.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:30:17.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:30:17.043 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:30:17.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:30:17.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:30:17.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:30:17.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:30:17.757 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:30:17.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:30:17.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:30:17.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:30:17.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:30:17.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:30:17.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:30:17.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:30:17.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:30:18.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:30:18.287 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:30:18.287 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:30:18.288 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:30:18.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:30:18.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:30:18.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:30:18.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:30:18.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:30:18.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:30:18.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:30:18.841 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:30:18.841 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:30:19.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=10 2024-09-16T05:30:19.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 10 '!=' null 2024-09-16T05:30:19.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:30:19.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:30:19.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:30:19.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:30:19.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:30:19.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:30:19.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:30:19.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:30:19.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:30:19.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:30:19.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:30:19.979 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:30:19.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:30:19.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:30:19.980 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:30:20.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:30:20.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:30:20.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:30:20.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:30:20.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:30:20.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:30:20.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:30:20.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:30:20.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:30:21.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=10 2024-09-16T05:30:21.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 10 '!=' null 2024-09-16T05:30:21.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:30:21.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:30:21.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:30:21.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:30:21.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:30:21.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:30:21.277 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:30:21.278 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:30:21.278 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:30:21.278 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:30:21.278 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:30:21.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:30:21.682 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:30:21.683 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:30:21.683 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:30:22.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:30:22.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:30:22.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:30:22.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:30:22.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:30:22.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:30:22.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:30:22.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:30:22.268 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:30:22.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=12 2024-09-16T05:30:22.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 12 '!=' null 2024-09-16T05:30:22.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:30:22.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:30:22.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:30:23.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:30:23.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:30:23.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:30:23.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:30:23.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:30:23.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:30:23.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:30:23.042 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:30:23.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:30:23.442 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:30:23.443 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:30:23.443 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:30:24.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:30:24.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:30:24.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:30:24.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:30:24.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:30:24.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:30:24.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:30:24.033 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:30:24.033 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:30:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=12 2024-09-16T05:30:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 12 '!=' null 2024-09-16T05:30:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:30:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:30:24.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:30:24.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:30:24.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:30:24.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:30:24.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:30:24.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:30:24.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:30:24.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:30:24.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:30:25.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:30:25.367 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:30:25.368 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:30:25.368 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:30:25.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:30:25.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:30:25.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:30:25.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:30:25.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:30:25.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:30:25.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:30:25.924 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:30:25.924 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:30:26.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=14 2024-09-16T05:30:26.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 14 '!=' null 2024-09-16T05:30:26.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:30:26.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:30:26.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:30:26.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:30:26.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:30:26.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:30:26.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:30:26.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:30:26.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:30:26.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:30:26.587 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:30:26.987 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:30:26.987 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:30:26.988 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:30:26.988 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:30:27.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:30:27.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:30:27.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:30:27.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:30:27.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:30:27.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:30:27.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:30:27.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:30:27.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:30:28.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:30:28.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:30:28.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:30:28.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:30:28.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:30:28.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:30:28.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:30:28.216 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:30:28.216 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:30:28.216 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:30:28.217 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:30:28.217 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:30:28.217 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:30:28.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:30:28.609 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:30:28.610 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:30:28.610 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:30:29.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:30:29.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:30:29.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:30:29.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:30:29.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:30:29.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:30:29.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:30:29.156 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:30:29.156 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:30:29.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=9 2024-09-16T05:30:29.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 9 '!=' null 2024-09-16T05:30:29.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:30:29.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:30:29.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:30:29.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:30:29.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:30:29.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:30:29.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:30:29.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:30:29.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:30:29.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:30:29.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:30:30.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:30:30.243 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:30:30.244 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:30:30.244 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:30:30.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:30:30.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:30:30.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:30:30.815 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:494: TEST_backfill_remapped: expr 200 '*' 2 2024-09-16T05:30:30.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:494: TEST_backfill_remapped: local misplaced=400 2024-09-16T05:30:30.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:496: TEST_backfill_remapped: check td/osd-backfill-stats 1.0 0 replicated 0 0 400 200 '' '' false 2024-09-16T05:30:30.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-09-16T05:30:30.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-09-16T05:30:30.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=0 2024-09-16T05:30:30.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-09-16T05:30:30.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=0 2024-09-16T05:30:30.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-09-16T05:30:30.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=400 2024-09-16T05:30:30.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=200 2024-09-16T05:30:30.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-09-16T05:30:30.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-09-16T05:30:30.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=false 2024-09-16T05:30:30.817 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log 2024-09-16T05:30:30.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.0.log 2024-09-16T05:30:30.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' false = true ']' 2024-09-16T05:30:30.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-09-16T05:30:30.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-09-16T05:30:30.819 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-09-16T05:30:30.820 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.0.log 2024-09-16T05:30:30.820 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-09-16T05:30:30.820 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-09-16T05:30:30.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[3]/[0,1]' 2024-09-16T05:30:30.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[3]/[0,1]' ']' 2024-09-16T05:30:30.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-09-16T05:30:30.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:30:30.832 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.0.log 2024-09-16T05:30:30.832 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [3]/[0,1] ' 2024-09-16T05:30:30.833 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-09-16T05:30:30.833 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-09-16T05:30:30.833 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:30:30.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=0 2024-09-16T05:30:30.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 0 ']' 2024-09-16T05:30:30.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 0 0 2024-09-16T05:30:30.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-09-16T05:30:30.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:30:30.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-09-16T05:30:30.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:30:30.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:30:30.837 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.0.log 2024-09-16T05:30:30.837 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-09-16T05:30:30.837 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:30:30.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=0 2024-09-16T05:30:30.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 0 ']' 2024-09-16T05:30:30.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 0 0 2024-09-16T05:30:30.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-09-16T05:30:30.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:30:30.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:30:30.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:30:30.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-09-16T05:30:30.844 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:30:30.844 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.0.log 2024-09-16T05:30:30.844 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [3]/[0,1] ' 2024-09-16T05:30:30.844 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-09-16T05:30:30.844 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-09-16T05:30:30.844 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:30:30.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=400 2024-09-16T05:30:30.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 400 ']' 2024-09-16T05:30:30.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 400 400 2024-09-16T05:30:30.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-09-16T05:30:30.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:30:30.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-09-16T05:30:30.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:30:30.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:30:30.848 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.0.log 2024-09-16T05:30:30.848 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-09-16T05:30:30.848 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:30:30.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=201 2024-09-16T05:30:30.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 201 ']' 2024-09-16T05:30:30.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 201 200 2024-09-16T05:30:30.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=201 2024-09-16T05:30:30.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:30:30.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=200 2024-09-16T05:30:30.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:30:30.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-09-16T05:30:30.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:498: TEST_backfill_remapped: delete_pool test 2024-09-16T05:30:30.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T05:30:30.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T05:30:31.369 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T05:30:31.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:499: TEST_backfill_remapped: kill_daemons td/osd-backfill-stats 2024-09-16T05:30:31.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:30:31.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:30:31.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:30:31.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:30:31.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:30:36.696 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:30:36.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-09-16T05:30:36.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:30:36.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:30:36.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:30:36.697 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:30:36.697 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:30:36.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:30:36.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:30:36.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:30:36.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:30:36.705 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:30:36.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:30:36.706 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:30:36.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:30:36.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:30:36.708 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:30:36.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:30:36.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:30:36.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:30:36.710 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:30:36.710 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:30:36.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:30:36.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:30:36.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:30:36.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:30:36.743 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:30:36.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:30:36.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:30:36.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:30:36.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-09-16T05:30:36.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-09-16T05:30:36.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-stats 2024-09-16T05:30:36.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-stats 2024-09-16T05:30:36.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:30:36.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:30:36.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:30:36.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:30:36.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:30:36.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:30:36.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:30:36.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:30:36.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:30:36.749 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:30:36.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:30:36.750 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:30:36.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:30:36.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:30:36.751 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:30:36.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:30:36.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:30:36.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:30:36.752 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:30:36.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:30:36.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:30:36.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:30:36.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:30:36.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:30:36.755 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:30:36.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:30:36.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:30:36.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:30:36.756 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-stats 2024-09-16T05:30:36.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T05:30:36.757 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:30:36.758 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:30:36.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.478321 2024-09-16T05:30:36.759 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T05:30:36.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T05:30:36.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T05:30:36.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-09-16T05:30:36.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_sizeup td/osd-backfill-stats 2024-09-16T05:30:36.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:133: TEST_backfill_sizeup: local dir=td/osd-backfill-stats 2024-09-16T05:30:36.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:135: TEST_backfill_sizeup: run_mon td/osd-backfill-stats a 2024-09-16T05:30:36.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-stats 2024-09-16T05:30:36.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T05:30:36.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T05:30:36.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T05:30:36.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-stats/a 2024-09-16T05:30:36.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-09-16T05:30:37.234 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T05:30:37.234 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:30:37.234 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:30:37.235 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:30:37.235 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:30:37.235 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:30:37.235 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:30:37.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T05:30:37.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T05:30:37.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T05:30:37.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:30:37.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:30:37.437 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T05:30:37.438 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T05:30:37.438 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:30:37.439 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:30:37.439 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:30:37.439 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:30:37.439 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:30:37.439 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:30:37.439 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:30:37.439 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:30:37.440 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get fsid 2024-09-16T05:30:37.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T05:30:37.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:30:37.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:30:37.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T05:30:37.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T05:30:37.531 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:30:37.531 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:30:37.531 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:30:37.532 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:30:37.532 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:30:37.532 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:30:37.532 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:30:37.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:30:37.532 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get mon_host 2024-09-16T05:30:37.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:136: TEST_backfill_sizeup: run_mgr td/osd-backfill-stats x 2024-09-16T05:30:37.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-stats 2024-09-16T05:30:37.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T05:30:37.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T05:30:37.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T05:30:37.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-stats/x 2024-09-16T05:30:37.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T05:30:38.468 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T05:30:38.468 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:30:38.469 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:30:38.469 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:30:38.469 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:30:38.469 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:30:38.469 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:30:38.469 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:30:38.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:30:38.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:137: TEST_backfill_sizeup: export CEPH_ARGS 2024-09-16T05:30:38.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:138: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 0 2024-09-16T05:30:38.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:30:38.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:30:38.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T05:30:38.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:30:38.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/0 2024-09-16T05:30:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:30:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:30:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:30:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:30:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-09-16T05:30:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-09-16T05:30:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:30:38.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:30:38.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:30:38.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:30:38.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:30:38.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:30:38.506 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:30:38.506 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:30:38.506 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:30:38.506 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:30:38.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:30:38.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:30:38.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:30:38.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:30:38.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:30:38.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:30:38.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:30:38.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:30:38.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:30:38.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:30:38.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:30:38.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:30:38.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/0 2024-09-16T05:30:38.507 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:30:38.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1665ad47-688f-4e52-9593-72dec06d7a6f 2024-09-16T05:30:38.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1665ad47-688f-4e52-9593-72dec06d7a6f' 2024-09-16T05:30:38.508 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 1665ad47-688f-4e52-9593-72dec06d7a6f 2024-09-16T05:30:38.509 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:30:38.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB+wudmBd09HxAAGpPhPd3M8q/BrgrmeSNHWw== 2024-09-16T05:30:38.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB+wudmBd09HxAAGpPhPd3M8q/BrgrmeSNHWw=="}' 2024-09-16T05:30:38.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1665ad47-688f-4e52-9593-72dec06d7a6f -i td/osd-backfill-stats/0/new.json 2024-09-16T05:30:38.776 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:30:38.786 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/0/new.json 2024-09-16T05:30:38.787 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB+wudmBd09HxAAGpPhPd3M8q/BrgrmeSNHWw== --osd-uuid 1665ad47-688f-4e52-9593-72dec06d7a6f 2024-09-16T05:30:38.819 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:30:38.817+0000 7f0ea35bd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:30:38.846 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:30:38.844+0000 7f0ea35bd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:30:38.846 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:30:38.845+0000 7f0ea35bd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:30:38.847 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:30:38.845+0000 7f0ea35bd640 -1 bdev(0x55deb45d9c00 td/osd-backfill-stats/0/block) open stat got: (1) Operation not permitted 2024-09-16T05:30:38.847 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:30:38.845+0000 7f0ea35bd640 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-09-16T05:30:44.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-09-16T05:30:44.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:30:44.532 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T05:30:44.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T05:30:44.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:30:45.116 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T05:30:45.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T05:30:45.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:30:45.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:30:45.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:30:45.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:30:45.145 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:30:45.144+0000 7f156f60f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:30:45.147 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:30:45.146+0000 7f156f60f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:30:45.148 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:30:45.147+0000 7f156f60f640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:30:45.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T05:30:45.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:30:45.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T05:30:45.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:30:45.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:30:45.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:30:45.556 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:30:45.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:30:45.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:30:45.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:30:46.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:30:46.741 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:30:46.739+0000 7f156f60f640 -1 Falling back to public interface 2024-09-16T05:30:47.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:30:47.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:30:47.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:30:47.020 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:30:47.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:30:47.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:30:47.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:30:48.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:30:48.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:30:48.441 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:30:48.442 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:30:48.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:30:48.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:30:48.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:30:49.586 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:30:49.585+0000 7f156f60f640 -1 osd.0 0 log_to_monitors true 2024-09-16T05:30:49.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:30:49.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:30:49.885 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:30:49.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:30:49.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:30:49.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:30:50.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:30:51.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:30:51.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:30:51.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:30:51.330 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:30:51.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:30:51.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:30:51.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:30:52.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:30:52.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:30:52.753 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:30:52.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:30:52.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:30:52.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:30:53.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:30:54.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:30:54.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:30:54.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:30:54.169 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:30:54.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:30:54.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:30:54.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:30:55.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:30:55.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:30:55.615 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:30:55.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:30:55.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:30:55.616 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:30:56.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:30:57.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:30:57.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:30:57.040 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:30:57.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:30:57.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:30:57.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:30:57.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:30:58.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:30:58.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:30:58.461 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:30:58.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:30:58.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:30:58.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:30:58.887 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:30:59.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:30:59.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:30:59.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:30:59.889 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:30:59.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:30:59.889 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:31:00.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:01.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:01.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:01.451 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:31:01.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:31:01.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:01.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:31:02.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:03.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:03.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:03.177 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:31:03.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:31:03.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:03.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:31:03.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:04.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:04.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:04.988 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:31:04.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:31:04.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:04.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:31:06.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:07.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:07.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:07.068 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:31:07.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:31:07.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:07.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:31:07.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:08.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:08.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:08.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:31:08.755 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:31:08.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:08.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:31:09.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:10.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:10.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:10.797 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:31:10.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:31:10.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:10.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:31:11.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:12.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:12.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:12.343 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:31:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:31:12.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:12.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:31:12.777 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4127372271,v1:127.0.0.1:6803/4127372271] [v2:127.0.0.1:6804/4127372271,v1:127.0.0.1:6805/4127372271] exists,up 1665ad47-688f-4e52-9593-72dec06d7a6f 2024-09-16T05:31:12.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:31:12.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:31:12.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:31:12.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:139: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 1 2024-09-16T05:31:12.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:31:12.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:31:12.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T05:31:12.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:31:12.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/1 2024-09-16T05:31:12.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:31:12.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:31:12.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:31:12.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:31:12.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-09-16T05:31:12.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-09-16T05:31:12.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:31:12.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:31:12.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:31:12.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:31:12.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:31:12.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:31:12.783 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:31:12.783 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:31:12.783 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:31:12.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:31:12.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:31:12.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:31:12.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:31:12.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:31:12.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:31:12.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:31:12.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:31:12.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:31:12.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:31:12.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:31:12.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:31:12.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:31:12.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/1 2024-09-16T05:31:12.785 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:31:12.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=131b167a-eb55-4852-9c57-e75169cbb020 2024-09-16T05:31:12.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 131b167a-eb55-4852-9c57-e75169cbb020' 2024-09-16T05:31:12.785 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 131b167a-eb55-4852-9c57-e75169cbb020 2024-09-16T05:31:12.786 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:31:12.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCgwudmZ0yvLxAAZIl4f91PttLOAKuPVMx2BQ== 2024-09-16T05:31:12.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCgwudmZ0yvLxAAZIl4f91PttLOAKuPVMx2BQ=="}' 2024-09-16T05:31:12.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 131b167a-eb55-4852-9c57-e75169cbb020 -i td/osd-backfill-stats/1/new.json 2024-09-16T05:31:13.264 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:31:13.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/1/new.json 2024-09-16T05:31:13.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCgwudmZ0yvLxAAZIl4f91PttLOAKuPVMx2BQ== --osd-uuid 131b167a-eb55-4852-9c57-e75169cbb020 2024-09-16T05:31:13.307 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:13.307+0000 7f80cd830640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:31:13.310 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:13.310+0000 7f80cd830640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:31:13.311 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:13.311+0000 7f80cd830640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:31:13.312 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:13.311+0000 7f80cd830640 -1 bdev(0x560913479c00 td/osd-backfill-stats/1/block) open stat got: (1) Operation not permitted 2024-09-16T05:31:13.312 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:13.311+0000 7f80cd830640 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-09-16T05:31:19.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-09-16T05:31:19.284 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:31:19.285 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T05:31:19.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T05:31:19.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:31:19.854 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T05:31:19.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T05:31:19.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:31:19.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:31:19.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:31:19.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:31:19.884 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:19.883+0000 7f7b43d02640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:31:19.890 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:19.889+0000 7f7b43d02640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:31:19.891 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:19.890+0000 7f7b43d02640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:31:20.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T05:31:20.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:31:20.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T05:31:20.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:31:20.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:31:20.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:20.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:31:20.322 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:31:20.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:20.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:20.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:21.503 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:21.502+0000 7f7b43d02640 -1 Falling back to public interface 2024-09-16T05:31:21.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:21.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:21.780 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:31:21.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:31:21.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:21.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:22.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:23.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:23.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:23.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:31:23.233 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:31:23.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:23.234 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:23.734 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:24.044 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:24.044+0000 7f7b43d02640 -1 osd.1 0 log_to_monitors true 2024-09-16T05:31:24.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:24.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:24.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:31:24.737 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:31:24.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:24.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:25.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:26.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:26.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:26.191 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:31:26.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:31:26.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:26.192 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:26.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:27.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:27.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:27.612 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:31:27.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:31:27.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:27.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:28.052 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:29.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:29.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:29.054 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:31:29.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:31:29.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:29.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:29.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:30.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:30.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:30.484 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:31:30.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:31:30.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:30.485 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:31.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:32.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:32.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:32.033 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:31:32.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:31:32.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:32.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:32.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:33.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:33.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:33.456 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:31:33.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:31:33.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:33.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:34.035 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:35.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:35.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:35.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:31:35.037 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:31:35.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:35.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:35.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:36.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:36.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:36.466 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:31:36.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:31:36.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:36.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:37.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:38.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:38.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:38.683 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:31:38.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:31:38.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:38.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:39.221 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:40.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:40.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:40.222 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:31:40.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:31:40.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:40.223 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:41.005 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:42.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:42.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:42.007 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:31:42.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:31:42.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:42.008 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:42.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:43.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:43.749 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:43.749 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:31:43.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:31:43.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:43.750 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:44.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:45.685 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:45.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:45.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:31:45.686 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:31:45.686 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:45.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:46.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:47.278 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:47.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:47.279 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:31:47.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:31:47.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:47.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:31:47.720 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2520588224,v1:127.0.0.1:6811/2520588224] [v2:127.0.0.1:6812/2520588224,v1:127.0.0.1:6813/2520588224] exists,up 131b167a-eb55-4852-9c57-e75169cbb020 2024-09-16T05:31:47.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:31:47.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:31:47.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:31:47.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:140: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 2 2024-09-16T05:31:47.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:31:47.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:31:47.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T05:31:47.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:31:47.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/2 2024-09-16T05:31:47.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:31:47.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:31:47.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:31:47.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:31:47.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-09-16T05:31:47.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-09-16T05:31:47.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:31:47.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:31:47.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:31:47.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:31:47.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:31:47.726 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:31:47.727 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:31:47.727 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:31:47.727 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:31:47.727 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:31:47.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:31:47.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:31:47.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:31:47.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:31:47.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:31:47.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:31:47.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:31:47.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:31:47.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:31:47.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:31:47.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:31:47.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:31:47.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/2 2024-09-16T05:31:47.728 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:31:47.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5b2242ec-fde2-4f83-be2e-339e829e4af9 2024-09-16T05:31:47.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 5b2242ec-fde2-4f83-be2e-339e829e4af9' 2024-09-16T05:31:47.729 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 5b2242ec-fde2-4f83-be2e-339e829e4af9 2024-09-16T05:31:47.729 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:31:47.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDDwudmK81ULBAA1miAiQ1qQRJ7/HpdDa/ftg== 2024-09-16T05:31:47.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDDwudmK81ULBAA1miAiQ1qQRJ7/HpdDa/ftg=="}' 2024-09-16T05:31:47.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5b2242ec-fde2-4f83-be2e-339e829e4af9 -i td/osd-backfill-stats/2/new.json 2024-09-16T05:31:48.240 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:31:48.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/2/new.json 2024-09-16T05:31:48.252 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDDwudmK81ULBAA1miAiQ1qQRJ7/HpdDa/ftg== --osd-uuid 5b2242ec-fde2-4f83-be2e-339e829e4af9 2024-09-16T05:31:48.283 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:48.281+0000 7fb739ab6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:31:48.301 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:48.299+0000 7fb739ab6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:31:48.301 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:48.300+0000 7fb739ab6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:31:48.302 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:48.300+0000 7fb739ab6640 -1 bdev(0x55eb81fddc00 td/osd-backfill-stats/2/block) open stat got: (1) Operation not permitted 2024-09-16T05:31:48.302 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:48.300+0000 7fb739ab6640 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-09-16T05:31:53.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-09-16T05:31:53.989 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:31:53.990 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T05:31:53.990 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T05:31:53.991 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:31:54.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T05:31:54.560 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T05:31:54.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:31:54.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:31:54.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:31:54.560 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:31:54.587 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:54.586+0000 7fb536617640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:31:54.589 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:54.589+0000 7fb536617640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:31:54.590 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:54.590+0000 7fb536617640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:31:54.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T05:31:54.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:31:54.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T05:31:54.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:31:54.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:31:54.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:54.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:31:54.982 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:31:54.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:54.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:31:55.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:55.455 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:55.454+0000 7fb536617640 -1 Falling back to public interface 2024-09-16T05:31:56.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:56.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:56.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:31:56.423 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:31:56.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:56.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:31:56.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:57.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:57.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:57.852 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:31:57.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:31:57.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:57.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:31:58.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:31:58.804 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:31:58.803+0000 7fb536617640 -1 osd.2 0 log_to_monitors true 2024-09-16T05:31:59.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:31:59.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:31:59.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:31:59.264 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:31:59.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:31:59.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:31:59.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:00.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:00.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:00.679 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:32:00.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:32:00.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:00.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:01.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:02.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:02.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:02.113 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:32:02.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:32:02.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:02.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:02.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:03.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:03.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:03.659 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:32:03.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:32:03.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:03.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:04.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:05.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:05.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:05.127 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:32:05.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:32:05.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:05.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:05.643 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:06.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:06.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:06.645 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:32:06.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:32:06.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:06.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:07.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:08.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:08.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:08.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:32:08.109 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:32:08.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:08.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:08.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:09.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:09.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:09.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:32:09.662 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:32:09.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:09.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:10.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:11.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:11.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:11.128 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:32:11.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:32:11.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:11.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:11.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:12.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:12.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:12.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:32:12.798 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:32:12.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:12.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:13.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:14.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:14.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:14.304 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:32:14.304 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:32:14.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:14.305 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:15.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:16.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:16.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:16.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:32:16.071 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:32:16.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:16.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:16.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:17.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:17.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:17.761 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:32:17.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:32:17.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:17.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:18.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:19.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:19.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:19.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:32:19.754 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:32:19.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:19.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:20.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:21.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:21.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:21.479 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:32:21.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:32:21.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:21.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:32:21.903 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2431294633,v1:127.0.0.1:6819/2431294633] [v2:127.0.0.1:6820/2431294633,v1:127.0.0.1:6821/2431294633] exists,up 5b2242ec-fde2-4f83-be2e-339e829e4af9 2024-09-16T05:32:21.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:32:21.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:32:21.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:32:21.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:141: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 3 2024-09-16T05:32:21.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:32:21.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:32:21.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T05:32:21.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/3 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:32:21.909 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:32:21.910 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:32:21.910 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:32:21.910 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:32:21.910 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:32:21.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:32:21.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:32:21.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:32:21.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:32:21.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:32:21.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:32:21.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:32:21.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:32:21.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:32:21.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:32:21.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:32:21.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:32:21.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/3 2024-09-16T05:32:21.911 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:32:21.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7f898cc8-8390-4057-995e-02540baa911f 2024-09-16T05:32:21.911 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 7f898cc8-8390-4057-995e-02540baa911f' 2024-09-16T05:32:21.912 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 7f898cc8-8390-4057-995e-02540baa911f 2024-09-16T05:32:21.912 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:32:21.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDlwudmdWhANxAAwyT6zoR+JH8ey/39NU0Dnw== 2024-09-16T05:32:21.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDlwudmdWhANxAAwyT6zoR+JH8ey/39NU0Dnw=="}' 2024-09-16T05:32:21.928 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7f898cc8-8390-4057-995e-02540baa911f -i td/osd-backfill-stats/3/new.json 2024-09-16T05:32:22.458 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:32:22.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/3/new.json 2024-09-16T05:32:22.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDlwudmdWhANxAAwyT6zoR+JH8ey/39NU0Dnw== --osd-uuid 7f898cc8-8390-4057-995e-02540baa911f 2024-09-16T05:32:22.502 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:22.501+0000 7f135514b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:32:22.504 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:22.503+0000 7f135514b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:32:22.505 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:22.504+0000 7f135514b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:32:22.505 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:22.504+0000 7f135514b640 -1 bdev(0x557e40f4bc00 td/osd-backfill-stats/3/block) open stat got: (1) Operation not permitted 2024-09-16T05:32:22.505 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:22.504+0000 7f135514b640 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-09-16T05:32:28.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-09-16T05:32:28.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:32:28.736 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T05:32:28.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T05:32:28.737 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:32:29.298 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T05:32:29.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T05:32:29.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:32:29.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:32:29.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:32:29.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:32:29.328 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:29.328+0000 7fdaa13a8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:32:29.331 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:29.330+0000 7fdaa13a8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:32:29.332 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:29.331+0000 7fdaa13a8640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:32:29.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T05:32:29.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:32:29.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T05:32:29.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:32:29.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:32:29.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:29.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:32:29.728 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:32:29.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:29.728 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:30.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:30.420 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:30.420+0000 7fdaa13a8640 -1 Falling back to public interface 2024-09-16T05:32:31.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:31.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:31.190 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:32:31.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:32:31.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:31.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:31.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:32.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:32.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:32.633 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:32:32.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:32:32.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:32.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:32.801 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:32.800+0000 7fdaa13a8640 -1 osd.3 0 log_to_monitors true 2024-09-16T05:32:33.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:34.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:34.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:34.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:32:34.106 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:32:34.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:34.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:34.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:35.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:35.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:35.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:32:35.530 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:32:35.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:35.530 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:36.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:37.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:37.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:37.125 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:32:37.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:32:37.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:37.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:37.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:38.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:38.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:38.538 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:32:38.539 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:32:38.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:38.539 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:39.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:40.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:40.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:40.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:32:40.077 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:32:40.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:40.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:40.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:41.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:41.512 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:41.512 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:32:41.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:32:41.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:41.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:42.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:43.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:43.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:43.084 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:32:43.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:32:43.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:43.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:43.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:44.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:44.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:44.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:32:44.514 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:32:44.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:44.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:45.113 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:46.114 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:46.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:46.115 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:32:46.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:32:46.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:46.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:46.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:47.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:47.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:47.672 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:32:47.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:32:47.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:47.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:48.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:49.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:49.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:49.279 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:32:49.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:32:49.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:49.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:50.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:51.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:51.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:51.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:32:51.046 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:32:51.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:51.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:51.802 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:52.803 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:52.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:52.804 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:32:52.804 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:32:52.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:52.805 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:53.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:54.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:54.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:54.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:32:54.856 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:32:54.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:54.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:55.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:32:56.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:32:56.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:32:56.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:32:56.506 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:32:56.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:32:56.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:32:56.933 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/644819687,v1:127.0.0.1:6827/644819687] [v2:127.0.0.1:6828/644819687,v1:127.0.0.1:6829/644819687] exists,up 7f898cc8-8390-4057-995e-02540baa911f 2024-09-16T05:32:56.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:32:56.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:32:56.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:32:56.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:142: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 4 2024-09-16T05:32:56.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:32:56.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:32:56.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T05:32:56.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:32:56.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/4 2024-09-16T05:32:56.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:32:56.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:32:56.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:32:56.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:32:56.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-09-16T05:32:56.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-09-16T05:32:56.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:32:56.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:32:56.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:32:56.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:32:56.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:32:56.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:32:56.939 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:32:56.939 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:32:56.939 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:32:56.939 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:32:56.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:32:56.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:32:56.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:32:56.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:32:56.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:32:56.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:32:56.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:32:56.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:32:56.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:32:56.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:32:56.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:32:56.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:32:56.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/4 2024-09-16T05:32:56.940 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:32:56.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=39280d48-ba18-43b7-ac8e-2772783503de 2024-09-16T05:32:56.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 39280d48-ba18-43b7-ac8e-2772783503de' 2024-09-16T05:32:56.941 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 39280d48-ba18-43b7-ac8e-2772783503de 2024-09-16T05:32:56.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:32:56.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAIw+dmQNYBORAAl8jOX1CuCwdTWSPtj51vZA== 2024-09-16T05:32:56.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAIw+dmQNYBORAAl8jOX1CuCwdTWSPtj51vZA=="}' 2024-09-16T05:32:56.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 39280d48-ba18-43b7-ac8e-2772783503de -i td/osd-backfill-stats/4/new.json 2024-09-16T05:32:57.454 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:32:57.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/4/new.json 2024-09-16T05:32:57.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAIw+dmQNYBORAAl8jOX1CuCwdTWSPtj51vZA== --osd-uuid 39280d48-ba18-43b7-ac8e-2772783503de 2024-09-16T05:32:57.498 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:57.496+0000 7f9f2d3dd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:32:57.500 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:57.498+0000 7f9f2d3dd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:32:57.501 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:57.499+0000 7f9f2d3dd640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:32:57.501 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:57.500+0000 7f9f2d3dd640 -1 bdev(0x561e809cbc00 td/osd-backfill-stats/4/block) open stat got: (1) Operation not permitted 2024-09-16T05:32:57.501 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:32:57.500+0000 7f9f2d3dd640 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-09-16T05:33:03.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-09-16T05:33:03.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:33:03.657 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T05:33:03.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T05:33:03.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:33:04.221 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T05:33:04.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T05:33:04.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:33:04.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:33:04.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:33:04.222 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:33:04.250 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:04.249+0000 7fe8083cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:33:04.260 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:04.259+0000 7fe8083cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:33:04.261 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:04.261+0000 7fe8083cc640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:33:04.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T05:33:04.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:33:04.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T05:33:04.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:33:04.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:33:04.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:04.676 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:33:04.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:33:04.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:04.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:05.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:05.865 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:05.864+0000 7fe8083cc640 -1 Falling back to public interface 2024-09-16T05:33:06.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:06.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:06.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:33:06.120 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:33:06.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:06.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:06.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:07.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:07.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:07.570 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:33:07.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:33:07.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:07.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:08.030 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:09.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:09.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:09.032 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:33:09.032 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:33:09.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:09.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:09.108 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:09.107+0000 7fe8083cc640 -1 osd.4 0 log_to_monitors true 2024-09-16T05:33:09.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:10.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:10.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:10.455 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:33:10.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:33:10.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:10.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:10.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:11.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:11.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:11.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:33:11.884 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:33:11.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:11.884 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:12.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:13.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:13.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:13.323 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:33:13.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:33:13.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:13.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:13.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:14.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:14.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:14.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:33:14.909 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:33:14.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:14.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:15.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:16.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:16.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:16.435 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:33:16.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:33:16.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:16.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:16.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:17.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:17.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:17.936 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:33:17.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:33:17.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:17.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:18.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:19.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:19.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:19.490 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:33:19.491 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:33:19.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:19.491 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:19.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:20.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:20.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:20.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:33:20.985 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:33:20.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:20.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:21.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:22.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:22.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:22.524 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:33:22.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:33:22.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:22.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:23.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:24.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:24.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:24.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:33:24.139 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:33:24.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:24.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:24.903 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:25.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:25.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:25.905 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:33:25.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:33:25.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:25.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:26.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:27.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:27.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:27.599 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:33:27.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:33:27.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:27.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:28.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:29.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:29.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:29.386 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:33:29.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:33:29.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:29.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:30.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:31.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:31.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:31.440 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:33:31.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:33:31.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:31.440 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:32.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:33.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:33.010 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:33.011 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-09-16T05:33:33.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 18 2024-09-16T05:33:33.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:33.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:33:33.452 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/43095924,v1:127.0.0.1:6835/43095924] [v2:127.0.0.1:6836/43095924,v1:127.0.0.1:6837/43095924] exists,up 39280d48-ba18-43b7-ac8e-2772783503de 2024-09-16T05:33:33.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:33:33.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:33:33.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:33:33.456 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:143: TEST_backfill_sizeup: run_osd td/osd-backfill-stats 5 2024-09-16T05:33:33.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:33:33.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:33:33.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T05:33:33.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:33:33.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/5 2024-09-16T05:33:33.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:33:33.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:33:33.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:33:33.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:33:33.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-09-16T05:33:33.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-09-16T05:33:33.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:33:33.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:33:33.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:33:33.458 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:33:33.459 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:33:33.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:33:33.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:33:33.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:33:33.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:33:33.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/5 2024-09-16T05:33:33.460 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:33:33.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=43f744fe-2bca-4f10-94c1-322fb702fa01 2024-09-16T05:33:33.460 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 43f744fe-2bca-4f10-94c1-322fb702fa01' 2024-09-16T05:33:33.460 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 43f744fe-2bca-4f10-94c1-322fb702fa01 2024-09-16T05:33:33.461 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:33:33.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAtw+dmllhZHBAAcUdWe+npemcUyPbwhtRIOQ== 2024-09-16T05:33:33.476 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAtw+dmllhZHBAAcUdWe+npemcUyPbwhtRIOQ=="}' 2024-09-16T05:33:33.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 43f744fe-2bca-4f10-94c1-322fb702fa01 -i td/osd-backfill-stats/5/new.json 2024-09-16T05:33:33.973 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:33:33.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/5/new.json 2024-09-16T05:33:33.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAtw+dmllhZHBAAcUdWe+npemcUyPbwhtRIOQ== --osd-uuid 43f744fe-2bca-4f10-94c1-322fb702fa01 2024-09-16T05:33:34.017 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:34.016+0000 7f60c4d4b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:33:34.022 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:34.021+0000 7f60c4d4b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:33:34.023 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:34.023+0000 7f60c4d4b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:33:34.024 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:34.023+0000 7f60c4d4b640 -1 bdev(0x55fddc977c00 td/osd-backfill-stats/5/block) open stat got: (1) Operation not permitted 2024-09-16T05:33:34.024 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:34.023+0000 7f60c4d4b640 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-09-16T05:33:39.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-09-16T05:33:39.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:33:39.702 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T05:33:39.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T05:33:39.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:33:40.275 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T05:33:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T05:33:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:33:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:33:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:33:40.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:33:40.305 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:40.304+0000 7f6d60f43640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:33:40.312 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:40.312+0000 7f6d60f43640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:33:40.313 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:40.313+0000 7f6d60f43640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:33:40.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T05:33:40.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:33:40.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T05:33:40.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:33:40.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:33:40.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:40.743 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:33:40.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:33:40.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:40.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:41.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:41.656 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:41.656+0000 7f6d60f43640 -1 Falling back to public interface 2024-09-16T05:33:42.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:42.230 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:33:42.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:42.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:33:42.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:42.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:42.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:43.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:43.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:43.673 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:33:43.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:33:43.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:43.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:44.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:44.669 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:33:44.668+0000 7f6d60f43640 -1 osd.5 0 log_to_monitors true 2024-09-16T05:33:45.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:45.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:45.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:33:45.176 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:33:45.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:45.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:45.640 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:46.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:46.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:46.642 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:33:46.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:33:46.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:46.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:47.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:48.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:48.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:48.109 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:33:48.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:33:48.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:48.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:48.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:49.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:49.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:49.673 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:33:49.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:33:49.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:49.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:50.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:51.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:51.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:51.218 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:33:51.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:33:51.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:51.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:51.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:52.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:52.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:52.670 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:33:52.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:33:52.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:52.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:53.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:54.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:54.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:54.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:33:54.119 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:33:54.119 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:54.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:54.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:55.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:55.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:55.598 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:33:55.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:33:55.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:55.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:56.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:57.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:57.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:57.137 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:33:57.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:33:57.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:57.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:57.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:33:58.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:33:58.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:33:58.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:33:58.585 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:33:58.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:33:58.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:33:59.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:34:00.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:34:00.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:34:00.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:34:00.571 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:34:00.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:34:00.572 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:34:01.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:34:02.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:34:02.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:34:02.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:34:02.925 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:34:02.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:34:02.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:34:03.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:34:04.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:34:04.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:34:04.724 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:34:04.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:34:04.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:34:04.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:34:05.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:34:06.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:34:06.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:34:06.666 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:34:06.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:34:06.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:34:06.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:34:07.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:34:08.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:34:08.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:34:08.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:34:08.542 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:34:08.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:34:08.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:34:08.976 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/1967294358,v1:127.0.0.1:6843/1967294358] [v2:127.0.0.1:6844/1967294358,v1:127.0.0.1:6845/1967294358] exists,up 43f744fe-2bca-4f10-94c1-322fb702fa01 2024-09-16T05:34:08.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:34:08.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:34:08.977 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:34:08.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:145: TEST_backfill_sizeup: create_pool test 1 1 2024-09-16T05:34:08.978 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2024-09-16T05:34:09.482 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T05:34:09.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T05:34:10.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:146: TEST_backfill_sizeup: ceph osd pool set test size 1 --yes-i-really-mean-it 2024-09-16T05:34:11.413 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 1 2024-09-16T05:34:11.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:148: TEST_backfill_sizeup: wait_for_clean 2024-09-16T05:34:11.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:34:11.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:34:11.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:34:11.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:34:11.426 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:34:11.426 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:34:11.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:34:11.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:34:11.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:34:11.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:34:11.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:34:11.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:34:11.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:34:11.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:34:11.519 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:34:12.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:34:12.017 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:34:12.017 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:34:12.017 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:34:12.017 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T05:34:12.018 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T05:34:12.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:34:12.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:34:12.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:34:12.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836526 2024-09-16T05:34:12.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836526 2024-09-16T05:34:12.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526' 2024-09-16T05:34:12.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:34:12.161 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:34:12.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672994 2024-09-16T05:34:12.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672994 2024-09-16T05:34:12.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672994' 2024-09-16T05:34:12.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:34:12.253 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:34:12.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509466 2024-09-16T05:34:12.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509466 2024-09-16T05:34:12.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672994 2-64424509466' 2024-09-16T05:34:12.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:34:12.372 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:34:12.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345940 2024-09-16T05:34:12.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345940 2024-09-16T05:34:12.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672994 2-64424509466 3-85899345940' 2024-09-16T05:34:12.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:34:12.492 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:34:12.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182413 2024-09-16T05:34:12.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182413 2024-09-16T05:34:12.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672994 2-64424509466 3-85899345940 4-107374182413' 2024-09-16T05:34:12.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:34:12.610 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T05:34:12.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018885 2024-09-16T05:34:12.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018885 2024-09-16T05:34:12.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672994 2-64424509466 3-85899345940 4-107374182413 5-128849018885' 2024-09-16T05:34:12.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:34:12.730 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836526 2024-09-16T05:34:12.730 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:34:12.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:34:12.731 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836526 2024-09-16T05:34:12.731 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:34:12.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836526 2024-09-16T05:34:12.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836526' 2024-09-16T05:34:12.732 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836526 2024-09-16T05:34:12.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:34:13.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836526 -lt 21474836526 2024-09-16T05:34:13.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:34:13.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672994 2024-09-16T05:34:13.185 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:34:13.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:34:13.186 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672994 2024-09-16T05:34:13.186 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:34:13.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672994 2024-09-16T05:34:13.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672994' 2024-09-16T05:34:13.188 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672994 2024-09-16T05:34:13.188 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:34:13.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672995 -lt 42949672994 2024-09-16T05:34:13.661 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:34:13.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509466 2024-09-16T05:34:13.661 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:34:13.662 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:34:13.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509466 2024-09-16T05:34:13.663 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:34:13.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509466 2024-09-16T05:34:13.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509466' 2024-09-16T05:34:13.664 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509466 2024-09-16T05:34:13.664 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:34:14.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509466 -lt 64424509466 2024-09-16T05:34:14.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:34:14.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345940 2024-09-16T05:34:14.069 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:34:14.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:34:14.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345940 2024-09-16T05:34:14.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:34:14.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345940 2024-09-16T05:34:14.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345940' 2024-09-16T05:34:14.072 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345940 2024-09-16T05:34:14.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:34:14.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345940 -lt 85899345940 2024-09-16T05:34:14.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:34:14.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182413 2024-09-16T05:34:14.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:34:14.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:34:14.507 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182413 2024-09-16T05:34:14.507 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:34:14.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182413 2024-09-16T05:34:14.508 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182413 2024-09-16T05:34:14.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182413' 2024-09-16T05:34:14.508 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:34:14.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182414 -lt 107374182413 2024-09-16T05:34:14.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:34:14.947 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018885 2024-09-16T05:34:14.948 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:34:14.948 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T05:34:14.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018885 2024-09-16T05:34:14.949 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:34:14.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018885 2024-09-16T05:34:14.950 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018885' 2024-09-16T05:34:14.950 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018885 2024-09-16T05:34:14.951 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T05:34:15.424 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018886 -lt 128849018885 2024-09-16T05:34:15.424 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:34:15.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:15.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:15.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:34:15.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:34:15.984 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:34:15.984 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:34:15.984 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:34:15.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:34:15.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:34:15.985 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:34:16.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:34:16.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:34:16.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:16.390 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:16.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:34:16.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:34:16.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:34:16.967 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: seq 1 200 2024-09-16T05:34:16.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:16.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj1 /dev/null 2024-09-16T05:34:17.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj2 /dev/null 2024-09-16T05:34:17.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj3 /dev/null 2024-09-16T05:34:17.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj4 /dev/null 2024-09-16T05:34:17.268 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.269 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj5 /dev/null 2024-09-16T05:34:17.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj6 /dev/null 2024-09-16T05:34:17.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj7 /dev/null 2024-09-16T05:34:17.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj8 /dev/null 2024-09-16T05:34:17.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj9 /dev/null 2024-09-16T05:34:17.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.595 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj10 /dev/null 2024-09-16T05:34:17.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj11 /dev/null 2024-09-16T05:34:17.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj12 /dev/null 2024-09-16T05:34:17.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj13 /dev/null 2024-09-16T05:34:17.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj14 /dev/null 2024-09-16T05:34:17.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:17.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj15 /dev/null 2024-09-16T05:34:18.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj16 /dev/null 2024-09-16T05:34:18.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj17 /dev/null 2024-09-16T05:34:18.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj18 /dev/null 2024-09-16T05:34:18.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj19 /dev/null 2024-09-16T05:34:18.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj20 /dev/null 2024-09-16T05:34:18.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj21 /dev/null 2024-09-16T05:34:18.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj22 /dev/null 2024-09-16T05:34:18.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj23 /dev/null 2024-09-16T05:34:18.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj24 /dev/null 2024-09-16T05:34:18.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj25 /dev/null 2024-09-16T05:34:18.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj26 /dev/null 2024-09-16T05:34:18.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj27 /dev/null 2024-09-16T05:34:18.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj28 /dev/null 2024-09-16T05:34:18.925 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj29 /dev/null 2024-09-16T05:34:18.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:18.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj30 /dev/null 2024-09-16T05:34:19.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj31 /dev/null 2024-09-16T05:34:19.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj32 /dev/null 2024-09-16T05:34:19.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj33 /dev/null 2024-09-16T05:34:19.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj34 /dev/null 2024-09-16T05:34:19.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj35 /dev/null 2024-09-16T05:34:19.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj36 /dev/null 2024-09-16T05:34:19.443 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj37 /dev/null 2024-09-16T05:34:19.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj38 /dev/null 2024-09-16T05:34:19.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj39 /dev/null 2024-09-16T05:34:19.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj40 /dev/null 2024-09-16T05:34:19.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj41 /dev/null 2024-09-16T05:34:19.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj42 /dev/null 2024-09-16T05:34:19.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.904 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj43 /dev/null 2024-09-16T05:34:19.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:19.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj44 /dev/null 2024-09-16T05:34:20.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.055 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj45 /dev/null 2024-09-16T05:34:20.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.121 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj46 /dev/null 2024-09-16T05:34:20.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.188 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj47 /dev/null 2024-09-16T05:34:20.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.255 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj48 /dev/null 2024-09-16T05:34:20.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj49 /dev/null 2024-09-16T05:34:20.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj50 /dev/null 2024-09-16T05:34:20.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.473 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj51 /dev/null 2024-09-16T05:34:20.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj52 /dev/null 2024-09-16T05:34:20.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj53 /dev/null 2024-09-16T05:34:20.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj54 /dev/null 2024-09-16T05:34:20.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.768 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj55 /dev/null 2024-09-16T05:34:20.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj56 /dev/null 2024-09-16T05:34:20.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj57 /dev/null 2024-09-16T05:34:20.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:20.943 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj58 /dev/null 2024-09-16T05:34:21.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj59 /dev/null 2024-09-16T05:34:21.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj60 /dev/null 2024-09-16T05:34:21.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.152 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj61 /dev/null 2024-09-16T05:34:21.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj62 /dev/null 2024-09-16T05:34:21.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj63 /dev/null 2024-09-16T05:34:21.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj64 /dev/null 2024-09-16T05:34:21.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.437 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj65 /dev/null 2024-09-16T05:34:21.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj66 /dev/null 2024-09-16T05:34:21.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj67 /dev/null 2024-09-16T05:34:21.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj68 /dev/null 2024-09-16T05:34:21.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj69 /dev/null 2024-09-16T05:34:21.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj70 /dev/null 2024-09-16T05:34:21.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.914 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj71 /dev/null 2024-09-16T05:34:21.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:21.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj72 /dev/null 2024-09-16T05:34:22.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj73 /dev/null 2024-09-16T05:34:22.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj74 /dev/null 2024-09-16T05:34:22.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj75 /dev/null 2024-09-16T05:34:22.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj76 /dev/null 2024-09-16T05:34:22.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj77 /dev/null 2024-09-16T05:34:22.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj78 /dev/null 2024-09-16T05:34:22.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj79 /dev/null 2024-09-16T05:34:22.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj80 /dev/null 2024-09-16T05:34:22.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj81 /dev/null 2024-09-16T05:34:22.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj82 /dev/null 2024-09-16T05:34:22.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj83 /dev/null 2024-09-16T05:34:22.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj84 /dev/null 2024-09-16T05:34:22.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj85 /dev/null 2024-09-16T05:34:22.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj86 /dev/null 2024-09-16T05:34:22.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:22.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj87 /dev/null 2024-09-16T05:34:23.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj88 /dev/null 2024-09-16T05:34:23.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.118 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj89 /dev/null 2024-09-16T05:34:23.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj90 /dev/null 2024-09-16T05:34:23.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj91 /dev/null 2024-09-16T05:34:23.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj92 /dev/null 2024-09-16T05:34:23.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj93 /dev/null 2024-09-16T05:34:23.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj94 /dev/null 2024-09-16T05:34:23.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj95 /dev/null 2024-09-16T05:34:23.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj96 /dev/null 2024-09-16T05:34:23.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.729 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj97 /dev/null 2024-09-16T05:34:23.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj98 /dev/null 2024-09-16T05:34:23.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj99 /dev/null 2024-09-16T05:34:23.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj100 /dev/null 2024-09-16T05:34:23.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:23.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj101 /dev/null 2024-09-16T05:34:24.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj102 /dev/null 2024-09-16T05:34:24.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj103 /dev/null 2024-09-16T05:34:24.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.214 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj104 /dev/null 2024-09-16T05:34:24.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.281 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj105 /dev/null 2024-09-16T05:34:24.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj106 /dev/null 2024-09-16T05:34:24.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj107 /dev/null 2024-09-16T05:34:24.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj108 /dev/null 2024-09-16T05:34:24.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj109 /dev/null 2024-09-16T05:34:24.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj110 /dev/null 2024-09-16T05:34:24.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj111 /dev/null 2024-09-16T05:34:24.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj112 /dev/null 2024-09-16T05:34:24.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj113 /dev/null 2024-09-16T05:34:24.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:24.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj114 /dev/null 2024-09-16T05:34:25.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj115 /dev/null 2024-09-16T05:34:25.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj116 /dev/null 2024-09-16T05:34:25.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj117 /dev/null 2024-09-16T05:34:25.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj118 /dev/null 2024-09-16T05:34:25.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.235 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj119 /dev/null 2024-09-16T05:34:25.326 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj120 /dev/null 2024-09-16T05:34:25.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj121 /dev/null 2024-09-16T05:34:25.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj122 /dev/null 2024-09-16T05:34:25.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.519 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj123 /dev/null 2024-09-16T05:34:25.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj124 /dev/null 2024-09-16T05:34:25.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.712 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj125 /dev/null 2024-09-16T05:34:25.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj126 /dev/null 2024-09-16T05:34:25.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj127 /dev/null 2024-09-16T05:34:25.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj128 /dev/null 2024-09-16T05:34:25.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:25.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj129 /dev/null 2024-09-16T05:34:26.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:26.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj130 /dev/null 2024-09-16T05:34:26.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:26.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj131 /dev/null 2024-09-16T05:34:26.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:26.197 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj132 /dev/null 2024-09-16T05:34:26.263 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:26.264 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj133 /dev/null 2024-09-16T05:34:26.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:26.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj134 /dev/null 2024-09-16T05:34:26.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:26.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj135 /dev/null 2024-09-16T05:34:26.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:26.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj136 /dev/null 2024-09-16T05:34:26.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:26.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj137 /dev/null 2024-09-16T05:34:26.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:26.614 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj138 /dev/null 2024-09-16T05:34:27.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj139 /dev/null 2024-09-16T05:34:27.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.083 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj140 /dev/null 2024-09-16T05:34:27.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj141 /dev/null 2024-09-16T05:34:27.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj142 /dev/null 2024-09-16T05:34:27.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj143 /dev/null 2024-09-16T05:34:27.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj144 /dev/null 2024-09-16T05:34:27.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj145 /dev/null 2024-09-16T05:34:27.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj146 /dev/null 2024-09-16T05:34:27.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj147 /dev/null 2024-09-16T05:34:27.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj148 /dev/null 2024-09-16T05:34:27.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj149 /dev/null 2024-09-16T05:34:27.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj150 /dev/null 2024-09-16T05:34:27.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj151 /dev/null 2024-09-16T05:34:27.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:27.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj152 /dev/null 2024-09-16T05:34:28.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj153 /dev/null 2024-09-16T05:34:28.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj154 /dev/null 2024-09-16T05:34:28.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj155 /dev/null 2024-09-16T05:34:28.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj156 /dev/null 2024-09-16T05:34:28.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj157 /dev/null 2024-09-16T05:34:28.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj158 /dev/null 2024-09-16T05:34:28.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj159 /dev/null 2024-09-16T05:34:28.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj160 /dev/null 2024-09-16T05:34:28.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj161 /dev/null 2024-09-16T05:34:28.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj162 /dev/null 2024-09-16T05:34:28.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj163 /dev/null 2024-09-16T05:34:28.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj164 /dev/null 2024-09-16T05:34:28.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj165 /dev/null 2024-09-16T05:34:28.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:28.973 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj166 /dev/null 2024-09-16T05:34:29.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj167 /dev/null 2024-09-16T05:34:29.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj168 /dev/null 2024-09-16T05:34:29.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj169 /dev/null 2024-09-16T05:34:29.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj170 /dev/null 2024-09-16T05:34:29.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj171 /dev/null 2024-09-16T05:34:29.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj172 /dev/null 2024-09-16T05:34:29.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj173 /dev/null 2024-09-16T05:34:29.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.525 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj174 /dev/null 2024-09-16T05:34:29.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj175 /dev/null 2024-09-16T05:34:29.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj176 /dev/null 2024-09-16T05:34:29.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj177 /dev/null 2024-09-16T05:34:29.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj178 /dev/null 2024-09-16T05:34:29.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj179 /dev/null 2024-09-16T05:34:29.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:29.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj180 /dev/null 2024-09-16T05:34:30.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj181 /dev/null 2024-09-16T05:34:30.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.102 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj182 /dev/null 2024-09-16T05:34:30.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj183 /dev/null 2024-09-16T05:34:30.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj184 /dev/null 2024-09-16T05:34:30.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj185 /dev/null 2024-09-16T05:34:30.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj186 /dev/null 2024-09-16T05:34:30.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj187 /dev/null 2024-09-16T05:34:30.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj188 /dev/null 2024-09-16T05:34:30.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj189 /dev/null 2024-09-16T05:34:30.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj190 /dev/null 2024-09-16T05:34:30.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj191 /dev/null 2024-09-16T05:34:30.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj192 /dev/null 2024-09-16T05:34:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj193 /dev/null 2024-09-16T05:34:30.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:30.972 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj194 /dev/null 2024-09-16T05:34:31.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:31.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj195 /dev/null 2024-09-16T05:34:31.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:31.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj196 /dev/null 2024-09-16T05:34:31.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:31.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj197 /dev/null 2024-09-16T05:34:31.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:31.265 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj198 /dev/null 2024-09-16T05:34:31.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:31.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj199 /dev/null 2024-09-16T05:34:31.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:150: TEST_backfill_sizeup: for i in $(seq 1 $objects) 2024-09-16T05:34:31.415 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:152: TEST_backfill_sizeup: rados -p test put obj200 /dev/null 2024-09-16T05:34:31.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:155: TEST_backfill_sizeup: ceph osd set nobackfill 2024-09-16T05:34:32.124 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is set 2024-09-16T05:34:32.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:156: TEST_backfill_sizeup: ceph osd pool set test size 3 2024-09-16T05:34:33.004 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 3 2024-09-16T05:34:33.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:157: TEST_backfill_sizeup: sleep 2 2024-09-16T05:34:35.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:158: TEST_backfill_sizeup: ceph osd unset nobackfill 2024-09-16T05:34:35.734 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is unset 2024-09-16T05:34:35.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:160: TEST_backfill_sizeup: wait_for_clean 2024-09-16T05:34:35.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:34:35.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:34:35.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:34:35.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:34:35.748 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:34:35.748 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:34:35.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:34:35.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:34:35.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:34:35.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:34:35.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:34:35.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:34:35.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:34:35.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:34:35.842 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:34:36.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:34:36.309 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:34:36.309 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:34:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:34:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T05:34:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T05:34:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:34:36.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:34:36.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:34:36.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836532 2024-09-16T05:34:36.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836532 2024-09-16T05:34:36.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532' 2024-09-16T05:34:36.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:34:36.428 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:34:36.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673001 2024-09-16T05:34:36.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673001 2024-09-16T05:34:36.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673001' 2024-09-16T05:34:36.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:34:36.546 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:34:36.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509472 2024-09-16T05:34:36.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509472 2024-09-16T05:34:36.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673001 2-64424509472' 2024-09-16T05:34:36.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:34:36.664 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:34:36.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345947 2024-09-16T05:34:36.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345947 2024-09-16T05:34:36.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673001 2-64424509472 3-85899345947' 2024-09-16T05:34:36.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:34:36.782 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:34:36.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182420 2024-09-16T05:34:36.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182420 2024-09-16T05:34:36.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673001 2-64424509472 3-85899345947 4-107374182420' 2024-09-16T05:34:36.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:34:36.919 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T05:34:37.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018892 2024-09-16T05:34:37.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018892 2024-09-16T05:34:37.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836532 1-42949673001 2-64424509472 3-85899345947 4-107374182420 5-128849018892' 2024-09-16T05:34:37.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:34:37.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836532 2024-09-16T05:34:37.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:34:37.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:34:37.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836532 2024-09-16T05:34:37.038 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:34:37.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836532 2024-09-16T05:34:37.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836532' 2024-09-16T05:34:37.039 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836532 2024-09-16T05:34:37.040 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:34:37.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836532 -lt 21474836532 2024-09-16T05:34:37.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:34:37.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673001 2024-09-16T05:34:37.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:34:37.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:34:37.448 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673001 2024-09-16T05:34:37.448 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:34:37.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673001 2024-09-16T05:34:37.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673001' 2024-09-16T05:34:37.449 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673001 2024-09-16T05:34:37.450 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:34:37.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673001 -lt 42949673001 2024-09-16T05:34:37.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:34:37.951 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509472 2024-09-16T05:34:37.951 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:34:37.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:34:37.953 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509472 2024-09-16T05:34:37.953 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:34:37.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509472 2024-09-16T05:34:37.954 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509472 2024-09-16T05:34:37.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509472' 2024-09-16T05:34:37.954 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:34:38.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509472 -lt 64424509472 2024-09-16T05:34:38.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:34:38.514 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345947 2024-09-16T05:34:38.515 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:34:38.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:34:38.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345947 2024-09-16T05:34:38.516 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:34:38.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345947 2024-09-16T05:34:38.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345947' 2024-09-16T05:34:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345947 2024-09-16T05:34:38.517 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:34:38.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345947 -lt 85899345947 2024-09-16T05:34:38.993 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:34:38.993 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182420 2024-09-16T05:34:38.993 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:34:38.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:34:38.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182420 2024-09-16T05:34:38.994 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:34:38.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182420 2024-09-16T05:34:38.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182420' 2024-09-16T05:34:38.996 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182420 2024-09-16T05:34:38.996 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:34:39.520 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182421 -lt 107374182420 2024-09-16T05:34:39.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:34:39.521 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018892 2024-09-16T05:34:39.521 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:34:39.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T05:34:39.522 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018892 2024-09-16T05:34:39.523 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:34:39.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018892 2024-09-16T05:34:39.524 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018892' 2024-09-16T05:34:39.524 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018892 2024-09-16T05:34:39.524 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T05:34:40.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018893 -lt 128849018892 2024-09-16T05:34:40.061 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:34:40.062 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:40.062 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:40.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:34:40.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:34:40.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:34:40.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:34:40.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:34:40.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:34:40.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:34:40.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:34:41.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:34:41.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:34:41.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:41.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:41.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:34:41.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T05:34:41.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T05:34:41.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T05:34:41.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:34:41.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:34:41.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:34:41.960 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:34:41.960 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:34:41.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:34:41.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:34:41.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:34:41.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:34:41.961 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:34:42.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:34:42.360 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:34:42.361 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:42.361 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:43.140 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:34:43.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:34:43.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:34:43.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:34:43.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:34:43.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:34:43.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:34:43.141 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:34:43.141 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:34:43.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4 2024-09-16T05:34:43.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4 '!=' null 2024-09-16T05:34:43.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:34:43.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:34:43.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:34:43.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:34:43.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:34:43.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:34:43.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:34:43.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:34:43.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:34:43.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:34:43.871 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:34:44.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:34:44.266 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:34:44.267 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:44.267 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:44.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:34:44.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:34:44.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:34:44.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:34:44.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:34:44.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:34:44.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:34:44.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:34:44.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:34:45.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=3 2024-09-16T05:34:45.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 3 '!=' null 2024-09-16T05:34:45.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:34:45.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:34:45.474 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:34:45.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:34:45.575 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:34:45.575 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:34:45.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:34:45.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:34:45.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:34:45.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:34:45.576 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:34:46.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:34:46.057 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:34:46.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:46.058 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:46.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:34:46.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:34:46.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:34:46.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:34:46.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:34:46.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:34:46.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:34:46.681 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:34:46.681 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:34:47.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=3 2024-09-16T05:34:47.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 3 '!=' null 2024-09-16T05:34:47.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:34:47.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:34:47.233 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:34:47.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:34:47.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:34:47.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:34:47.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:34:47.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:34:47.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:34:47.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:34:47.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:34:47.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:34:47.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:34:47.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:47.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:48.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:34:48.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:34:48.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:34:48.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:34:48.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:34:48.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:34:48.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:34:48.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:34:48.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:34:48.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=3 2024-09-16T05:34:48.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 3 '!=' null 2024-09-16T05:34:48.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:34:48.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:34:48.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:34:49.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:34:49.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:34:49.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:34:49.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:34:49.086 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:34:49.087 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:34:49.087 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:34:49.087 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:34:49.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:34:49.548 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:34:49.549 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:49.549 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:50.225 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:34:50.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:34:50.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:34:50.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:34:50.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:34:50.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:34:50.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:34:50.226 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:34:50.226 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:34:50.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:34:50.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:34:50.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:34:50.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:34:50.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:34:51.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:34:51.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:34:51.019 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:34:51.019 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:34:51.019 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:34:51.019 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:34:51.019 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:34:51.019 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:34:51.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:34:51.462 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:34:51.462 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:51.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:52.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:34:52.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:34:52.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:34:52.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:34:52.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:34:52.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:34:52.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:34:52.107 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:34:52.107 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:34:52.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:34:52.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:34:52.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:34:52.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:34:52.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:34:52.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:34:52.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:34:52.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:34:52.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:34:52.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:34:52.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:34:52.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:34:52.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:34:53.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:34:53.294 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:34:53.295 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:53.295 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:53.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:34:53.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:34:53.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:34:53.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:34:53.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:34:53.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:34:53.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:34:53.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:34:53.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:34:54.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=9 2024-09-16T05:34:54.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 9 '!=' null 2024-09-16T05:34:54.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:34:54.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:34:54.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:34:54.624 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:34:54.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:34:54.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:34:54.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:34:54.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:34:54.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:34:54.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:34:54.625 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:34:55.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:34:55.050 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:34:55.050 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:55.050 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:55.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:34:55.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:34:55.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:34:55.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:34:55.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:34:55.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:34:55.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:34:55.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:34:55.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:34:56.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:34:56.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:34:56.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:34:56.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:34:56.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:34:56.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:34:56.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:34:56.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:34:56.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:34:56.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:34:56.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:34:56.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:34:56.392 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:34:56.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:34:56.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:34:56.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:56.896 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:57.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:34:57.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:34:57.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:34:57.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:34:57.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:34:57.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:34:57.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:34:57.499 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:34:57.499 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:34:58.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:34:58.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:34:58.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:34:58.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:34:58.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:34:58.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:34:58.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:34:58.341 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:34:58.341 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:34:58.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:34:58.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:34:58.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:34:58.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:34:58.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:34:58.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:34:58.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:34:58.852 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:34:59.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:34:59.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:34:59.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:34:59.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:34:59.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:34:59.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:34:59.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:34:59.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:34:59.536 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:35:00.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=9 2024-09-16T05:35:00.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 9 '!=' null 2024-09-16T05:35:00.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:35:00.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:35:00.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:35:00.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:35:00.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:35:00.274 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:35:00.274 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:35:00.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:35:00.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:35:00.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:35:00.275 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:35:00.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:35:00.719 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:35:00.719 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:35:00.719 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:35:01.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:35:01.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:35:01.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:35:01.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:35:01.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:35:01.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:35:01.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:35:01.340 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:35:01.340 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:35:01.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:35:01.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:35:01.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:35:01.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:35:01.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:35:02.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:35:02.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:35:02.012 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:35:02.012 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:35:02.012 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:35:02.013 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:35:02.013 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:35:02.013 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:35:02.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:35:02.446 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:35:02.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:35:02.447 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:35:03.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:35:03.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:35:03.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:35:03.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:35:03.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:35:03.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:35:03.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:35:03.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:35:03.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:35:03.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=9 2024-09-16T05:35:03.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 9 '!=' null 2024-09-16T05:35:03.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:35:03.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:35:03.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:35:03.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:35:03.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:35:03.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:35:03.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:35:03.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:35:03.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:35:03.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:35:03.847 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:35:04.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:35:04.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:35:04.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:35:04.310 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:35:04.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:35:04.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:35:04.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:35:04.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:35:04.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:35:04.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:35:04.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:35:04.863 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:35:04.863 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:35:05.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:35:05.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:35:05.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:35:05.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:35:05.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:35:05.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:35:05.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:35:05.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:35:05.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:35:05.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:35:05.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:35:05.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:35:05.684 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:35:06.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:35:06.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:35:06.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:35:06.099 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:35:06.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:35:06.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:35:06.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:35:06.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:35:06.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:35:06.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:35:06.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:35:06.689 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:35:06.689 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:35:07.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4 2024-09-16T05:35:07.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4 '!=' null 2024-09-16T05:35:07.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:35:07.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:35:07.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:35:07.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:35:07.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:35:07.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:35:07.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:35:07.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:35:07.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:35:07.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:35:07.347 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:35:07.745 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:35:07.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:35:07.745 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:35:07.746 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:35:08.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:35:08.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:35:08.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:35:08.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:35:08.294 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:35:08.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:35:08.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:35:08.295 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:35:08.295 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:35:08.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:35:08.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:35:08.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:35:08.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:35:08.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:35:09.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:35:09.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:35:09.025 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:35:09.025 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:35:09.025 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:35:09.025 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:35:09.025 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:35:09.025 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:35:09.423 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:35:09.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:35:09.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:35:09.423 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:35:09.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:35:09.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:35:09.988 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:35:09.988 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:162: TEST_backfill_sizeup: get_primary test obj1 2024-09-16T05:35:09.988 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:35:09.988 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:35:09.989 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:35:09.989 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:35:10.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:162: TEST_backfill_sizeup: local primary=1 2024-09-16T05:35:10.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:163: TEST_backfill_sizeup: get_pg test obj1 2024-09-16T05:35:10.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T05:35:10.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T05:35:10.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T05:35:10.449 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T05:35:10.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:163: TEST_backfill_sizeup: local PG=1.0 2024-09-16T05:35:10.891 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:165: TEST_backfill_sizeup: expr 200 '*' 2 2024-09-16T05:35:10.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:165: TEST_backfill_sizeup: local degraded=400 2024-09-16T05:35:10.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:166: TEST_backfill_sizeup: check td/osd-backfill-stats 1.0 1 replicated 400 0 0 0 2024-09-16T05:35:10.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-09-16T05:35:10.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-09-16T05:35:10.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-09-16T05:35:10.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-09-16T05:35:10.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=400 2024-09-16T05:35:10.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-09-16T05:35:10.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=0 2024-09-16T05:35:10.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-09-16T05:35:10.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-09-16T05:35:10.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-09-16T05:35:10.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-09-16T05:35:10.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-09-16T05:35:10.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-09-16T05:35:10.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-09-16T05:35:10.897 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-09-16T05:35:10.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-09-16T05:35:10.908 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-09-16T05:35:10.908 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-09-16T05:35:10.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-09-16T05:35:10.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-09-16T05:35:10.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-09-16T05:35:10.910 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-09-16T05:35:10.910 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:35:10.910 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-09-16T05:35:10.910 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-09-16T05:35:10.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[1,0,2]/[1]' 2024-09-16T05:35:10.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[1,0,2]/[1]' ']' 2024-09-16T05:35:10.926 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-09-16T05:35:10.926 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:35:10.927 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:35:10.927 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [1,0,2]/[1] ' 2024-09-16T05:35:10.927 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-09-16T05:35:10.927 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-09-16T05:35:10.927 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:35:10.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=400 2024-09-16T05:35:10.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 400 ']' 2024-09-16T05:35:10.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 400 400 2024-09-16T05:35:10.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-09-16T05:35:10.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:35:10.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-09-16T05:35:10.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:35:10.933 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:35:10.933 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:35:10.933 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-09-16T05:35:10.933 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:35:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=2 2024-09-16T05:35:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 2 ']' 2024-09-16T05:35:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 2 0 2024-09-16T05:35:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=2 2024-09-16T05:35:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:35:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:35:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:35:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-09-16T05:35:10.942 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:35:10.942 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:35:10.943 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [1,0,2]/[1] ' 2024-09-16T05:35:10.943 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-09-16T05:35:10.943 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-09-16T05:35:10.943 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:35:10.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=0 2024-09-16T05:35:10.946 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 0 ']' 2024-09-16T05:35:10.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 0 0 2024-09-16T05:35:10.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=0 2024-09-16T05:35:10.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:35:10.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=0 2024-09-16T05:35:10.947 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:35:10.947 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:35:10.947 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:35:10.947 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-09-16T05:35:10.947 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:35:10.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=0 2024-09-16T05:35:10.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 0 ']' 2024-09-16T05:35:10.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 0 0 2024-09-16T05:35:10.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=0 2024-09-16T05:35:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:35:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:35:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:35:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-09-16T05:35:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:168: TEST_backfill_sizeup: delete_pool test 2024-09-16T05:35:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T05:35:10.957 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T05:35:11.450 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T05:35:11.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:169: TEST_backfill_sizeup: kill_daemons td/osd-backfill-stats 2024-09-16T05:35:11.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:35:11.463 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:35:11.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:35:11.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:35:11.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:35:16.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:35:16.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-09-16T05:35:16.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:35:16.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:35:16.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:35:16.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:35:16.780 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:35:16.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:35:16.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:35:16.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:35:16.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:35:16.789 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:35:16.790 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:35:16.790 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:35:16.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:35:16.791 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:35:16.792 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:35:16.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:35:16.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:35:16.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:35:16.794 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:35:16.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:35:16.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:35:16.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:35:16.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:35:16.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:35:16.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:35:16.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:35:16.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-stats 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-stats 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:35:16.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:35:16.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:35:16.841 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:35:16.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:35:16.842 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:35:16.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:35:16.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:35:16.843 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:35:16.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:35:16.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:35:16.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:35:16.845 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:35:16.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:35:16.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:35:16.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:35:16.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:35:16.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:35:16.848 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:35:16.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:35:16.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:35:16.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:35:16.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-stats 2024-09-16T05:35:16.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T05:35:16.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:35:16.851 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:35:16.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.478321 2024-09-16T05:35:16.853 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T05:35:16.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T05:35:16.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T05:35:16.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-09-16T05:35:16.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_sizeup4_allout td/osd-backfill-stats 2024-09-16T05:35:16.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:389: TEST_backfill_sizeup4_allout: local dir=td/osd-backfill-stats 2024-09-16T05:35:16.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:391: TEST_backfill_sizeup4_allout: run_mon td/osd-backfill-stats a 2024-09-16T05:35:16.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-stats 2024-09-16T05:35:16.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T05:35:16.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T05:35:16.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T05:35:16.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-stats/a 2024-09-16T05:35:16.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-09-16T05:35:17.306 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T05:35:17.306 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:35:17.306 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:35:17.306 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:35:17.306 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:35:17.306 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:35:17.306 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:35:17.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T05:35:17.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T05:35:17.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T05:35:17.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:35:17.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:35:17.500 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T05:35:17.501 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T05:35:17.501 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:35:17.501 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:35:17.501 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:35:17.501 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:35:17.502 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:35:17.502 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:35:17.502 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:35:17.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:35:17.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get fsid 2024-09-16T05:35:17.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T05:35:17.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:35:17.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:35:17.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T05:35:17.591 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T05:35:17.591 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:35:17.591 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:35:17.591 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:35:17.592 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:35:17.592 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:35:17.592 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:35:17.592 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:35:17.592 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:35:17.592 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get mon_host 2024-09-16T05:35:17.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:392: TEST_backfill_sizeup4_allout: run_mgr td/osd-backfill-stats x 2024-09-16T05:35:17.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-stats 2024-09-16T05:35:17.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T05:35:17.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T05:35:17.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T05:35:17.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-stats/x 2024-09-16T05:35:17.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T05:35:18.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T05:35:18.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:35:18.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:35:18.530 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:35:18.530 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:35:18.530 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:35:18.530 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:35:18.531 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:35:18.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:35:18.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:393: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 0 2024-09-16T05:35:18.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:35:18.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:35:18.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T05:35:18.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:35:18.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/0 2024-09-16T05:35:18.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:35:18.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:35:18.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:35:18.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:35:18.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-09-16T05:35:18.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-09-16T05:35:18.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:35:18.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:35:18.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:35:18.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:35:18.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:35:18.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:35:18.565 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:35:18.565 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:35:18.565 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:35:18.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:35:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/0 2024-09-16T05:35:18.567 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:35:18.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=38f01d28-26e2-4d36-b934-1e418ec15719 2024-09-16T05:35:18.567 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 38f01d28-26e2-4d36-b934-1e418ec15719 2024-09-16T05:35:18.568 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 38f01d28-26e2-4d36-b934-1e418ec15719' 2024-09-16T05:35:18.568 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:35:18.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCWw+dmMoTXIhAAwoFQ1XblV608PUhOEQLTjw== 2024-09-16T05:35:18.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCWw+dmMoTXIhAAwoFQ1XblV608PUhOEQLTjw=="}' 2024-09-16T05:35:18.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 38f01d28-26e2-4d36-b934-1e418ec15719 -i td/osd-backfill-stats/0/new.json 2024-09-16T05:35:18.848 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:35:18.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/0/new.json 2024-09-16T05:35:18.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCWw+dmMoTXIhAAwoFQ1XblV608PUhOEQLTjw== --osd-uuid 38f01d28-26e2-4d36-b934-1e418ec15719 2024-09-16T05:35:18.890 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:18.889+0000 7f7ab6dc3640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:35:18.916 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:18.915+0000 7f7ab6dc3640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:35:18.917 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:18.916+0000 7f7ab6dc3640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:35:18.918 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:18.917+0000 7f7ab6dc3640 -1 bdev(0x55bf594c3c00 td/osd-backfill-stats/0/block) open stat got: (1) Operation not permitted 2024-09-16T05:35:18.918 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:18.917+0000 7f7ab6dc3640 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-09-16T05:35:24.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-09-16T05:35:24.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:35:24.399 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T05:35:24.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T05:35:24.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:35:24.973 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T05:35:24.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T05:35:24.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:35:24.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:35:24.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:35:24.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:35:25.003 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:25.002+0000 7f97df211640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:35:25.005 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:25.004+0000 7f97df211640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:35:25.006 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:25.005+0000 7f97df211640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:35:25.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T05:35:25.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:35:25.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T05:35:25.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:35:25.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:35:25.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:25.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:35:25.410 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:35:25.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:25.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:25.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:26.092 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:26.091+0000 7f97df211640 -1 Falling back to public interface 2024-09-16T05:35:26.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:26.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:26.869 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:35:26.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:35:26.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:26.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:27.318 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:28.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:28.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:28.320 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:35:28.320 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:35:28.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:28.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:28.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:29.181 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:29.180+0000 7f97df211640 -1 osd.0 0 log_to_monitors true 2024-09-16T05:35:29.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:29.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:29.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:35:29.733 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:35:29.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:29.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:30.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:31.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:31.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:31.219 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:35:31.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:35:31.219 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:31.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:31.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:32.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:32.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:32.650 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:35:32.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:35:32.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:32.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:33.104 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:34.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:34.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:34.106 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:35:34.106 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:35:34.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:34.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:34.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:35.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:35.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:35.536 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:35:35.536 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:35:35.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:35.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:36.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:37.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:37.059 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:37.059 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:35:37.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:35:37.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:37.060 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:37.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:38.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:38.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:38.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:35:38.483 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:35:38.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:38.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:38.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:39.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:39.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:39.966 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:35:39.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:35:39.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:39.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:40.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:41.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:41.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:41.384 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:35:41.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:35:41.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:41.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:41.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:42.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:42.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:42.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:35:42.896 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:35:42.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:42.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:43.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:44.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:44.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:44.918 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:35:44.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:35:44.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:44.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:45.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:46.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:46.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:46.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:35:46.830 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:35:46.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:46.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:48.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:49.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:49.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:49.066 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:35:49.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:35:49.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:49.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:49.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:50.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:50.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:50.870 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:35:50.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:35:50.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:50.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:51.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:35:52.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:35:52.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:35:52.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:35:52.679 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:35:52.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:35:52.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:35:53.124 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3178532829,v1:127.0.0.1:6803/3178532829] [v2:127.0.0.1:6804/3178532829,v1:127.0.0.1:6805/3178532829] exists,up 38f01d28-26e2-4d36-b934-1e418ec15719 2024-09-16T05:35:53.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:35:53.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:35:53.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:35:53.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:394: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 1 2024-09-16T05:35:53.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:35:53.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:35:53.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T05:35:53.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:35:53.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/1 2024-09-16T05:35:53.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:35:53.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:35:53.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:35:53.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:35:53.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-09-16T05:35:53.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-09-16T05:35:53.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:35:53.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:35:53.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:35:53.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:35:53.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:35:53.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:35:53.131 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:35:53.131 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:35:53.131 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:35:53.131 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:35:53.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:35:53.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:35:53.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:35:53.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:35:53.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:35:53.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:35:53.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:35:53.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:35:53.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:35:53.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:35:53.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:35:53.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:35:53.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/1 2024-09-16T05:35:53.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:35:53.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=90be4da0-d2fe-44a7-95f9-08710c43c7aa 2024-09-16T05:35:53.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 90be4da0-d2fe-44a7-95f9-08710c43c7aa' 2024-09-16T05:35:53.133 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 90be4da0-d2fe-44a7-95f9-08710c43c7aa 2024-09-16T05:35:53.134 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:35:53.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC5w+dm1S3cCBAAOVNs+KNbATw9Upb3ZHFa1A== 2024-09-16T05:35:53.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC5w+dm1S3cCBAAOVNs+KNbATw9Upb3ZHFa1A=="}' 2024-09-16T05:35:53.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 90be4da0-d2fe-44a7-95f9-08710c43c7aa -i td/osd-backfill-stats/1/new.json 2024-09-16T05:35:53.682 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:35:53.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/1/new.json 2024-09-16T05:35:53.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC5w+dm1S3cCBAAOVNs+KNbATw9Upb3ZHFa1A== --osd-uuid 90be4da0-d2fe-44a7-95f9-08710c43c7aa 2024-09-16T05:35:53.725 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:53.725+0000 7f514f5bf640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:35:53.727 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:53.727+0000 7f514f5bf640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:35:53.728 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:53.728+0000 7f514f5bf640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:35:53.729 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:53.728+0000 7f514f5bf640 -1 bdev(0x55664b913c00 td/osd-backfill-stats/1/block) open stat got: (1) Operation not permitted 2024-09-16T05:35:53.729 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:35:53.728+0000 7f514f5bf640 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-09-16T05:36:00.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-09-16T05:36:00.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:36:00.161 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T05:36:00.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T05:36:00.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:36:00.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T05:36:00.723 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T05:36:00.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:36:00.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:36:00.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:36:00.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:36:00.753 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:00.752+0000 7fe2406ed640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:36:00.755 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:00.754+0000 7fe2406ed640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:36:00.756 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:00.755+0000 7fe2406ed640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:36:01.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T05:36:01.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:36:01.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T05:36:01.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:36:01.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:36:01.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:01.200 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:36:01.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:36:01.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:01.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:01.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:02.105 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:02.105+0000 7fe2406ed640 -1 Falling back to public interface 2024-09-16T05:36:02.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:02.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:02.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:36:02.635 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:36:02.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:02.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:03.051 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:04.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:04.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:04.053 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:36:04.053 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:36:04.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:04.054 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:04.486 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:05.299 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:05.299+0000 7fe2406ed640 -1 osd.1 0 log_to_monitors true 2024-09-16T05:36:05.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:05.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:05.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:36:05.488 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:36:05.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:05.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:05.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:06.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:06.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:06.970 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:36:06.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:36:06.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:06.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:07.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:08.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:08.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:08.396 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:36:08.397 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:36:08.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:08.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:08.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:09.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:09.815 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:09.815 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:36:09.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:36:09.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:09.816 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:10.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:11.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:11.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:11.370 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:36:11.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:36:11.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:11.370 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:11.868 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:12.869 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:12.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:12.870 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:36:12.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:36:12.870 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:12.871 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:13.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:14.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:14.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:14.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:36:14.433 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:36:14.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:14.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:14.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:15.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:15.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:15.855 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:36:15.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:36:15.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:15.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:16.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:17.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:17.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:17.362 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:36:17.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:36:17.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:17.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:17.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:18.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:18.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:18.845 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:36:18.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:36:18.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:18.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:19.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:20.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:20.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:20.340 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:36:20.340 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:36:20.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:20.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:21.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:22.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:22.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:22.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:36:22.077 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:36:22.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:22.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:22.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:23.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:23.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:23.967 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:36:23.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:36:23.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:23.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:24.721 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:25.722 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:25.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:25.723 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:36:25.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:36:25.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:25.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:26.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:27.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:27.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:27.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:36:27.471 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:36:27.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:27.472 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:36:27.959 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1500262309,v1:127.0.0.1:6811/1500262309] [v2:127.0.0.1:6812/1500262309,v1:127.0.0.1:6813/1500262309] exists,up 90be4da0-d2fe-44a7-95f9-08710c43c7aa 2024-09-16T05:36:27.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:36:27.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:36:27.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:36:27.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:395: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 2 2024-09-16T05:36:27.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:36:27.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:36:27.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T05:36:27.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:36:27.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/2 2024-09-16T05:36:27.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:36:27.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:36:27.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:36:27.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:36:27.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-09-16T05:36:27.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-09-16T05:36:27.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:36:27.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:36:27.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:36:27.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:36:27.964 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:36:27.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:36:27.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:36:27.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:36:27.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:36:27.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:36:27.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/2 2024-09-16T05:36:27.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:36:27.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8cda95cc-48b9-492d-9dbd-7cf3a05e83bc 2024-09-16T05:36:27.966 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 8cda95cc-48b9-492d-9dbd-7cf3a05e83bc 2024-09-16T05:36:27.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 8cda95cc-48b9-492d-9dbd-7cf3a05e83bc' 2024-09-16T05:36:27.967 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:36:27.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDbw+dmY3uKOhAAFek1G1XszGeoZyIAoXF1gA== 2024-09-16T05:36:27.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDbw+dmY3uKOhAAFek1G1XszGeoZyIAoXF1gA=="}' 2024-09-16T05:36:27.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8cda95cc-48b9-492d-9dbd-7cf3a05e83bc -i td/osd-backfill-stats/2/new.json 2024-09-16T05:36:28.585 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:36:28.596 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/2/new.json 2024-09-16T05:36:28.597 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDbw+dmY3uKOhAAFek1G1XszGeoZyIAoXF1gA== --osd-uuid 8cda95cc-48b9-492d-9dbd-7cf3a05e83bc 2024-09-16T05:36:28.629 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:28.628+0000 7f74b652e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:36:28.630 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:28.630+0000 7f74b652e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:36:28.631 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:28.631+0000 7f74b652e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:36:28.632 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:28.631+0000 7f74b652e640 -1 bdev(0x5597b26ebc00 td/osd-backfill-stats/2/block) open stat got: (1) Operation not permitted 2024-09-16T05:36:28.633 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:28.631+0000 7f74b652e640 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-09-16T05:36:34.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-09-16T05:36:34.372 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:36:34.373 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T05:36:34.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T05:36:34.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:36:34.952 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T05:36:34.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T05:36:34.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:36:34.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:36:34.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:36:34.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:36:34.981 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:34.980+0000 7f7403eae640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:36:34.983 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:34.983+0000 7f7403eae640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:36:34.984 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:34.984+0000 7f7403eae640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:36:35.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T05:36:35.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:36:35.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T05:36:35.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:36:35.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:36:35.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:35.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:36:35.379 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:36:35.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:35.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:35.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:36.321 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:36.320+0000 7f7403eae640 -1 Falling back to public interface 2024-09-16T05:36:36.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:36.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:36.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:36:36.839 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:36:36.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:36.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:37.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:38.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:38.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:38.291 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:36:38.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:36:38.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:38.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:38.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:39.161 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:36:39.161+0000 7f7403eae640 -1 osd.2 0 log_to_monitors true 2024-09-16T05:36:39.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:39.705 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:36:39.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:39.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:36:39.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:39.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:40.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:41.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:41.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:41.275 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:36:41.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:36:41.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:41.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:41.713 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:42.714 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:42.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:42.715 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:36:42.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:36:42.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:42.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:43.373 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:44.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:44.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:44.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:36:44.375 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:36:44.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:44.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:44.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:45.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:45.794 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:45.794 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:36:45.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:36:45.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:45.795 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:46.236 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:47.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:47.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:47.238 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:36:47.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:36:47.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:47.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:47.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:48.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:48.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:48.654 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:36:48.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:36:48.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:48.655 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:49.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:50.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:50.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:50.122 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:36:50.122 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:36:50.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:50.123 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:50.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:51.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:51.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:51.542 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:36:51.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:36:51.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:51.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:52.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:53.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:53.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:53.408 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:36:53.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:36:53.409 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:53.410 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:54.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:55.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:55.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:55.350 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:36:55.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:36:55.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:55.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:56.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:57.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:57.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:57.150 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:36:57.150 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:36:57.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:57.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:36:58.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:36:59.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:36:59.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:36:59.171 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:36:59.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:36:59.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:36:59.172 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:37:00.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:01.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:01.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:01.043 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:37:01.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:37:01.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:01.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:37:01.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:02.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:02.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:02.882 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:37:02.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:37:02.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:02.882 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:37:03.352 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/159443562,v1:127.0.0.1:6819/159443562] [v2:127.0.0.1:6820/159443562,v1:127.0.0.1:6821/159443562] exists,up 8cda95cc-48b9-492d-9dbd-7cf3a05e83bc 2024-09-16T05:37:03.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:37:03.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:37:03.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:37:03.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:396: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 3 2024-09-16T05:37:03.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:37:03.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:37:03.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T05:37:03.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:37:03.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/3 2024-09-16T05:37:03.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:37:03.356 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:37:03.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:37:03.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:37:03.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-09-16T05:37:03.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-09-16T05:37:03.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:37:03.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:37:03.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:37:03.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:37:03.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:37:03.357 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:37:03.357 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:37:03.357 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:37:03.358 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:37:03.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:37:03.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:37:03.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:37:03.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:37:03.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:37:03.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:37:03.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:37:03.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:37:03.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:37:03.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:37:03.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:37:03.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:37:03.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:37:03.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/3 2024-09-16T05:37:03.359 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:37:03.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c8c611d4-5287-44b4-8669-3bcbd7fa7179 2024-09-16T05:37:03.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 c8c611d4-5287-44b4-8669-3bcbd7fa7179' 2024-09-16T05:37:03.359 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 c8c611d4-5287-44b4-8669-3bcbd7fa7179 2024-09-16T05:37:03.360 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:37:03.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD/w+dmtvZfFhAA7aXK/HT+idNqdkM0+193lA== 2024-09-16T05:37:03.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD/w+dmtvZfFhAA7aXK/HT+idNqdkM0+193lA=="}' 2024-09-16T05:37:03.376 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c8c611d4-5287-44b4-8669-3bcbd7fa7179 -i td/osd-backfill-stats/3/new.json 2024-09-16T05:37:03.840 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:37:03.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/3/new.json 2024-09-16T05:37:03.852 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD/w+dmtvZfFhAA7aXK/HT+idNqdkM0+193lA== --osd-uuid c8c611d4-5287-44b4-8669-3bcbd7fa7179 2024-09-16T05:37:03.883 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:03.883+0000 7fd9c3462640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:37:03.920 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:03.919+0000 7fd9c3462640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:37:03.921 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:03.920+0000 7fd9c3462640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:37:03.921 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:03.921+0000 7fd9c3462640 -1 bdev(0x559f94437c00 td/osd-backfill-stats/3/block) open stat got: (1) Operation not permitted 2024-09-16T05:37:03.922 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:03.921+0000 7fd9c3462640 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-09-16T05:37:09.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-09-16T05:37:09.682 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:37:09.683 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T05:37:09.683 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T05:37:09.684 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:37:10.253 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T05:37:10.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T05:37:10.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:37:10.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:37:10.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:37:10.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:37:10.282 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:10.282+0000 7f5de6687640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:37:10.285 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:10.284+0000 7f5de6687640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:37:10.286 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:10.286+0000 7f5de6687640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:37:10.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T05:37:10.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:37:10.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T05:37:10.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:37:10.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:37:10.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:10.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:37:10.707 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:37:10.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:10.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:11.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:11.651 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:11.650+0000 7f5de6687640 -1 Falling back to public interface 2024-09-16T05:37:12.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:12.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:12.142 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:37:12.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:37:12.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:12.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:12.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:13.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:13.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:13.586 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:37:13.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:37:13.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:13.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:14.041 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:14.464 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:14.463+0000 7f5de6687640 -1 osd.3 0 log_to_monitors true 2024-09-16T05:37:15.042 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:15.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:15.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:37:15.043 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:37:15.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:15.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:15.462 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:16.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:16.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:16.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:37:16.464 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:37:16.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:16.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:16.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:17.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:17.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:17.908 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:37:17.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:37:17.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:17.908 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:18.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:19.405 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:19.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:19.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:37:19.406 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:37:19.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:19.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:19.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:20.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:20.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:20.919 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:37:20.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:37:20.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:20.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:21.416 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:22.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:22.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:22.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:37:22.418 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:37:22.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:22.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:22.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:23.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:23.839 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:23.839 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:37:23.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:37:23.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:23.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:24.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:25.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:25.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:25.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:37:25.260 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:37:25.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:25.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:25.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:26.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:26.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:26.705 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:37:26.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:37:26.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:26.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:27.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:28.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:28.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:28.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:37:28.707 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:37:28.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:28.708 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:29.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:30.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:30.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:30.610 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:37:30.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:37:30.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:30.611 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:31.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:32.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:32.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:32.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:37:32.402 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:37:32.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:32.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:33.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:34.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:34.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:34.195 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:37:34.195 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:37:34.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:34.196 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:34.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:35.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:35.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:35.998 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:37:35.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:37:35.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:35.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:36.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:37.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:37.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:37.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:37:37.939 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:37:37.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:37.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:37:38.475 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1721133074,v1:127.0.0.1:6827/1721133074] [v2:127.0.0.1:6828/1721133074,v1:127.0.0.1:6829/1721133074] exists,up c8c611d4-5287-44b4-8669-3bcbd7fa7179 2024-09-16T05:37:38.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:37:38.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:37:38.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:37:38.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:397: TEST_backfill_sizeup4_allout: run_osd td/osd-backfill-stats 4 2024-09-16T05:37:38.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/4 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:37:38.480 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:37:38.481 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:37:38.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:37:38.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:37:38.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:37:38.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:37:38.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:37:38.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:37:38.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/4 2024-09-16T05:37:38.482 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:37:38.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9a0ad02a-b54d-4474-9286-aea5fcc0b570 2024-09-16T05:37:38.482 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 9a0ad02a-b54d-4474-9286-aea5fcc0b570' 2024-09-16T05:37:38.482 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 9a0ad02a-b54d-4474-9286-aea5fcc0b570 2024-09-16T05:37:38.483 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:37:38.499 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAixOdmw1u+HRAAeIUerA9gmWFznNZVHFVcUA== 2024-09-16T05:37:38.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAixOdmw1u+HRAAeIUerA9gmWFznNZVHFVcUA=="}' 2024-09-16T05:37:38.500 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9a0ad02a-b54d-4474-9286-aea5fcc0b570 -i td/osd-backfill-stats/4/new.json 2024-09-16T05:37:39.137 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:37:39.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/4/new.json 2024-09-16T05:37:39.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAixOdmw1u+HRAAeIUerA9gmWFznNZVHFVcUA== --osd-uuid 9a0ad02a-b54d-4474-9286-aea5fcc0b570 2024-09-16T05:37:39.180 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:39.180+0000 7fd5c90d6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:37:39.201 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:39.200+0000 7fd5c90d6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:37:39.202 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:39.202+0000 7fd5c90d6640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:37:39.203 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:39.202+0000 7fd5c90d6640 -1 bdev(0x560cf2b3dc00 td/osd-backfill-stats/4/block) open stat got: (1) Operation not permitted 2024-09-16T05:37:39.203 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:39.202+0000 7fd5c90d6640 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-09-16T05:37:45.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-09-16T05:37:45.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:37:45.057 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T05:37:45.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T05:37:45.057 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:37:45.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T05:37:45.633 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T05:37:45.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:37:45.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:37:45.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:37:45.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:37:45.662 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:45.662+0000 7f8e6361c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:37:45.665 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:45.664+0000 7f8e6361c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:37:45.666 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:45.665+0000 7f8e6361c640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:37:46.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T05:37:46.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:37:46.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T05:37:46.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:37:46.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:37:46.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:46.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:37:46.087 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:37:46.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:46.087 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:37:46.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:46.752 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:46.752+0000 7f8e6361c640 -1 Falling back to public interface 2024-09-16T05:37:47.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:47.522 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:47.522 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:37:47.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:37:47.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:47.523 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:37:47.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:48.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:48.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:48.966 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:37:48.966 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:37:48.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:48.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:37:49.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:49.852 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:37:49.852+0000 7f8e6361c640 -1 osd.4 0 log_to_monitors true 2024-09-16T05:37:50.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:50.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:50.380 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:37:50.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:37:50.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:50.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:37:50.968 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:51.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:51.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:51.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:37:51.971 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:37:51.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:51.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:37:52.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:53.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:53.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:53.387 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:37:53.388 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:37:53.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:53.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:37:53.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:54.921 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:54.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:54.922 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:37:54.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:37:54.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:54.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:37:55.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:56.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:56.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:56.361 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:37:56.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:37:56.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:56.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:37:56.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:57.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:57.859 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:57.860 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:37:57.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:37:57.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:57.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:37:58.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:37:59.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:37:59.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:37:59.279 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:37:59.279 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:37:59.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:37:59.280 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:37:59.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:38:00.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:38:00.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:38:00.738 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:38:00.738 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:38:00.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:38:00.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:38:01.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:38:02.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:38:02.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:38:02.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:38:02.230 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:38:02.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:38:02.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:38:02.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:38:03.940 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:38:03.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:38:03.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:38:03.941 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:38:03.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:38:03.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:38:04.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:38:05.917 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:38:05.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:38:05.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:38:05.918 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:38:05.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:38:05.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:38:06.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:38:07.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:38:07.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:38:07.654 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:38:07.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:38:07.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:38:07.654 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:38:08.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:38:09.763 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:38:09.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:38:09.764 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:38:09.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:38:09.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:38:09.765 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:38:10.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:38:11.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:38:11.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:38:11.429 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:38:11.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:38:11.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:38:11.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:38:12.127 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:38:13.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:38:13.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:38:13.129 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:38:13.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:38:13.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:38:13.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:38:13.634 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2548842315,v1:127.0.0.1:6835/2548842315] [v2:127.0.0.1:6836/2548842315,v1:127.0.0.1:6837/2548842315] exists,up 9a0ad02a-b54d-4474-9286-aea5fcc0b570 2024-09-16T05:38:13.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:38:13.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:38:13.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:38:13.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:399: TEST_backfill_sizeup4_allout: create_pool test 1 1 2024-09-16T05:38:13.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2024-09-16T05:38:14.368 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T05:38:14.379 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T05:38:15.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:400: TEST_backfill_sizeup4_allout: ceph osd pool set test size 2 2024-09-16T05:38:16.244 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 2 2024-09-16T05:38:16.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:402: TEST_backfill_sizeup4_allout: wait_for_clean 2024-09-16T05:38:16.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:38:16.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:38:16.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:38:16.258 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:38:16.259 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:38:16.259 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:38:16.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:38:16.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:38:16.259 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:38:16.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:38:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:38:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:38:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:38:16.351 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:38:16.351 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:38:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:38:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:38:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:38:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:38:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T05:38:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:38:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:38:16.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:38:17.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836517 2024-09-16T05:38:17.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836517 2024-09-16T05:38:17.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836517' 2024-09-16T05:38:17.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:38:17.020 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:38:17.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672987 2024-09-16T05:38:17.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672987 2024-09-16T05:38:17.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836517 1-42949672987' 2024-09-16T05:38:17.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:38:17.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:38:17.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509462 2024-09-16T05:38:17.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509462 2024-09-16T05:38:17.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836517 1-42949672987 2-64424509462' 2024-09-16T05:38:17.258 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:38:17.258 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:38:17.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345935 2024-09-16T05:38:17.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345935 2024-09-16T05:38:17.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836517 1-42949672987 2-64424509462 3-85899345935' 2024-09-16T05:38:17.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:38:17.375 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:38:17.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182406 2024-09-16T05:38:17.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182406 2024-09-16T05:38:17.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836517 1-42949672987 2-64424509462 3-85899345935 4-107374182406' 2024-09-16T05:38:17.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:38:17.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836517 2024-09-16T05:38:17.493 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:38:17.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:38:17.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836517 2024-09-16T05:38:17.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:38:17.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836517 2024-09-16T05:38:17.496 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836517 2024-09-16T05:38:17.496 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836517' 2024-09-16T05:38:17.497 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:38:17.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836515 -lt 21474836517 2024-09-16T05:38:17.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T05:38:18.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T05:38:18.954 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:38:19.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836518 -lt 21474836517 2024-09-16T05:38:19.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:38:19.401 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672987 2024-09-16T05:38:19.401 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:38:19.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:38:19.403 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672987 2024-09-16T05:38:19.403 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:38:19.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672987 2024-09-16T05:38:19.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672987' 2024-09-16T05:38:19.404 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672987 2024-09-16T05:38:19.405 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:38:19.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672987 -lt 42949672987 2024-09-16T05:38:19.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:38:19.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509462 2024-09-16T05:38:19.854 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:38:19.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:38:19.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509462 2024-09-16T05:38:19.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:38:19.856 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509462 2024-09-16T05:38:19.856 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509462 2024-09-16T05:38:19.857 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509462' 2024-09-16T05:38:19.857 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:38:20.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509463 -lt 64424509462 2024-09-16T05:38:20.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:38:20.288 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345935 2024-09-16T05:38:20.288 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:38:20.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:38:20.289 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345935 2024-09-16T05:38:20.289 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:38:20.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345935 2024-09-16T05:38:20.290 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345935 2024-09-16T05:38:20.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345935' 2024-09-16T05:38:20.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:38:20.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345935 -lt 85899345935 2024-09-16T05:38:20.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:38:20.694 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182406 2024-09-16T05:38:20.694 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:38:20.695 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:38:20.696 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182406 2024-09-16T05:38:20.696 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:38:20.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182406 2024-09-16T05:38:20.697 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182406 2024-09-16T05:38:20.697 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182406' 2024-09-16T05:38:20.697 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:38:21.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182407 -lt 107374182406 2024-09-16T05:38:21.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:38:21.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:38:21.104 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:38:21.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:38:21.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:38:21.660 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:38:21.660 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:38:21.660 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:38:21.660 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:38:21.660 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:38:21.660 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:38:22.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:38:22.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:38:22.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:38:22.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:38:22.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:38:22.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:38:22.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:38:22.622 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: seq 1 200 2024-09-16T05:38:22.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:22.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj1 /dev/null 2024-09-16T05:38:22.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:22.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj2 /dev/null 2024-09-16T05:38:22.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:22.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj3 /dev/null 2024-09-16T05:38:22.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:22.959 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj4 /dev/null 2024-09-16T05:38:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj5 /dev/null 2024-09-16T05:38:23.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:23.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj6 /dev/null 2024-09-16T05:38:23.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:23.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj7 /dev/null 2024-09-16T05:38:23.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:23.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj8 /dev/null 2024-09-16T05:38:23.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:23.461 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj9 /dev/null 2024-09-16T05:38:23.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:23.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj10 /dev/null 2024-09-16T05:38:23.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:23.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj11 /dev/null 2024-09-16T05:38:23.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:23.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj12 /dev/null 2024-09-16T05:38:23.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:23.847 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj13 /dev/null 2024-09-16T05:38:23.980 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:23.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj14 /dev/null 2024-09-16T05:38:24.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:24.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj15 /dev/null 2024-09-16T05:38:24.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:24.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj16 /dev/null 2024-09-16T05:38:24.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:24.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj17 /dev/null 2024-09-16T05:38:24.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:24.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj18 /dev/null 2024-09-16T05:38:24.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:24.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj19 /dev/null 2024-09-16T05:38:24.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:24.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj20 /dev/null 2024-09-16T05:38:24.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:24.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj21 /dev/null 2024-09-16T05:38:24.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:24.867 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj22 /dev/null 2024-09-16T05:38:25.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:25.018 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj23 /dev/null 2024-09-16T05:38:25.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:25.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj24 /dev/null 2024-09-16T05:38:25.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:25.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj25 /dev/null 2024-09-16T05:38:25.285 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:25.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj26 /dev/null 2024-09-16T05:38:25.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:25.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj27 /dev/null 2024-09-16T05:38:25.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:25.487 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj28 /dev/null 2024-09-16T05:38:25.578 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:25.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj29 /dev/null 2024-09-16T05:38:25.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:25.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj30 /dev/null 2024-09-16T05:38:25.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:25.814 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj31 /dev/null 2024-09-16T05:38:25.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:25.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj32 /dev/null 2024-09-16T05:38:26.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:26.047 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj33 /dev/null 2024-09-16T05:38:26.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:26.139 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj34 /dev/null 2024-09-16T05:38:26.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:26.232 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj35 /dev/null 2024-09-16T05:38:26.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:26.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj36 /dev/null 2024-09-16T05:38:26.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:26.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj37 /dev/null 2024-09-16T05:38:26.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:26.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj38 /dev/null 2024-09-16T05:38:26.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:26.642 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj39 /dev/null 2024-09-16T05:38:26.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:26.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj40 /dev/null 2024-09-16T05:38:26.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:26.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj41 /dev/null 2024-09-16T05:38:27.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:27.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj42 /dev/null 2024-09-16T05:38:27.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:27.093 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj43 /dev/null 2024-09-16T05:38:27.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:27.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj44 /dev/null 2024-09-16T05:38:27.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:27.286 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj45 /dev/null 2024-09-16T05:38:27.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:27.378 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj46 /dev/null 2024-09-16T05:38:27.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:27.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj47 /dev/null 2024-09-16T05:38:27.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:27.587 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj48 /dev/null 2024-09-16T05:38:27.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:27.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj49 /dev/null 2024-09-16T05:38:27.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:27.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj50 /dev/null 2024-09-16T05:38:27.938 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:27.939 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj51 /dev/null 2024-09-16T05:38:28.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:28.056 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj52 /dev/null 2024-09-16T05:38:28.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:28.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj53 /dev/null 2024-09-16T05:38:28.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:28.240 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj54 /dev/null 2024-09-16T05:38:28.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:28.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj55 /dev/null 2024-09-16T05:38:28.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:28.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj56 /dev/null 2024-09-16T05:38:28.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:28.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj57 /dev/null 2024-09-16T05:38:28.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:28.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj58 /dev/null 2024-09-16T05:38:28.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:28.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj59 /dev/null 2024-09-16T05:38:28.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:28.843 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj60 /dev/null 2024-09-16T05:38:28.951 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:28.952 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj61 /dev/null 2024-09-16T05:38:29.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:29.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj62 /dev/null 2024-09-16T05:38:29.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:29.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj63 /dev/null 2024-09-16T05:38:29.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:29.220 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj64 /dev/null 2024-09-16T05:38:29.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:29.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj65 /dev/null 2024-09-16T05:38:29.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:29.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj66 /dev/null 2024-09-16T05:38:29.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:29.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj67 /dev/null 2024-09-16T05:38:29.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:29.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj68 /dev/null 2024-09-16T05:38:29.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:29.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj69 /dev/null 2024-09-16T05:38:29.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:29.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj70 /dev/null 2024-09-16T05:38:30.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:30.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj71 /dev/null 2024-09-16T05:38:30.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:30.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj72 /dev/null 2024-09-16T05:38:30.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:30.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj73 /dev/null 2024-09-16T05:38:30.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:30.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj74 /dev/null 2024-09-16T05:38:30.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:30.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj75 /dev/null 2024-09-16T05:38:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:30.533 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj76 /dev/null 2024-09-16T05:38:30.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:30.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj77 /dev/null 2024-09-16T05:38:30.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:30.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj78 /dev/null 2024-09-16T05:38:30.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:30.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj79 /dev/null 2024-09-16T05:38:30.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:30.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj80 /dev/null 2024-09-16T05:38:31.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:31.061 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj81 /dev/null 2024-09-16T05:38:31.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:31.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj82 /dev/null 2024-09-16T05:38:31.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:31.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj83 /dev/null 2024-09-16T05:38:31.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:31.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj84 /dev/null 2024-09-16T05:38:31.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:31.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj85 /dev/null 2024-09-16T05:38:31.621 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:31.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj86 /dev/null 2024-09-16T05:38:31.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:31.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj87 /dev/null 2024-09-16T05:38:31.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:31.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj88 /dev/null 2024-09-16T05:38:31.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:31.982 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj89 /dev/null 2024-09-16T05:38:32.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:32.082 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj90 /dev/null 2024-09-16T05:38:32.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:32.182 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj91 /dev/null 2024-09-16T05:38:32.282 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:32.283 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj92 /dev/null 2024-09-16T05:38:32.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:32.400 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj93 /dev/null 2024-09-16T05:38:32.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:32.509 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj94 /dev/null 2024-09-16T05:38:32.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:32.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj95 /dev/null 2024-09-16T05:38:32.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:32.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj96 /dev/null 2024-09-16T05:38:32.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:32.793 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj97 /dev/null 2024-09-16T05:38:32.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:32.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj98 /dev/null 2024-09-16T05:38:33.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:33.044 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj99 /dev/null 2024-09-16T05:38:33.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:33.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj100 /dev/null 2024-09-16T05:38:33.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:33.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj101 /dev/null 2024-09-16T05:38:33.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:33.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj102 /dev/null 2024-09-16T05:38:33.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:33.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj103 /dev/null 2024-09-16T05:38:33.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:33.579 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj104 /dev/null 2024-09-16T05:38:33.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:33.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj105 /dev/null 2024-09-16T05:38:33.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:33.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj106 /dev/null 2024-09-16T05:38:33.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:33.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj107 /dev/null 2024-09-16T05:38:34.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:34.065 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj108 /dev/null 2024-09-16T05:38:34.165 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:34.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj109 /dev/null 2024-09-16T05:38:34.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:34.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj110 /dev/null 2024-09-16T05:38:34.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:34.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj111 /dev/null 2024-09-16T05:38:34.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:34.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj112 /dev/null 2024-09-16T05:38:34.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:34.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj113 /dev/null 2024-09-16T05:38:34.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:34.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj114 /dev/null 2024-09-16T05:38:34.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:34.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj115 /dev/null 2024-09-16T05:38:35.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:35.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj116 /dev/null 2024-09-16T05:38:35.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:35.153 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj117 /dev/null 2024-09-16T05:38:35.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:35.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj118 /dev/null 2024-09-16T05:38:35.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:35.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj119 /dev/null 2024-09-16T05:38:35.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:35.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj120 /dev/null 2024-09-16T05:38:35.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:35.580 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj121 /dev/null 2024-09-16T05:38:35.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:35.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj122 /dev/null 2024-09-16T05:38:35.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:35.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj123 /dev/null 2024-09-16T05:38:35.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:35.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj124 /dev/null 2024-09-16T05:38:36.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:36.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj125 /dev/null 2024-09-16T05:38:36.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:36.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj126 /dev/null 2024-09-16T05:38:36.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:36.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj127 /dev/null 2024-09-16T05:38:36.374 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:36.375 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj128 /dev/null 2024-09-16T05:38:36.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:36.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj129 /dev/null 2024-09-16T05:38:36.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:36.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj130 /dev/null 2024-09-16T05:38:36.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:36.701 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj131 /dev/null 2024-09-16T05:38:36.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:36.818 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj132 /dev/null 2024-09-16T05:38:36.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:36.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj133 /dev/null 2024-09-16T05:38:37.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:37.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj134 /dev/null 2024-09-16T05:38:37.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:37.161 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj135 /dev/null 2024-09-16T05:38:37.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:37.253 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj136 /dev/null 2024-09-16T05:38:37.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:37.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj137 /dev/null 2024-09-16T05:38:37.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:37.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj138 /dev/null 2024-09-16T05:38:37.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:37.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj139 /dev/null 2024-09-16T05:38:37.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:37.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj140 /dev/null 2024-09-16T05:38:37.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:37.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj141 /dev/null 2024-09-16T05:38:37.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:37.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj142 /dev/null 2024-09-16T05:38:38.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:38.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj143 /dev/null 2024-09-16T05:38:38.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:38.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj144 /dev/null 2024-09-16T05:38:38.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:38.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj145 /dev/null 2024-09-16T05:38:38.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:38.366 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj146 /dev/null 2024-09-16T05:38:38.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:38.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj147 /dev/null 2024-09-16T05:38:38.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:38.567 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj148 /dev/null 2024-09-16T05:38:38.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:38.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj149 /dev/null 2024-09-16T05:38:38.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:38.801 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj150 /dev/null 2024-09-16T05:38:38.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:38.927 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj151 /dev/null 2024-09-16T05:38:39.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:39.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj152 /dev/null 2024-09-16T05:38:39.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:39.128 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj153 /dev/null 2024-09-16T05:38:39.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:39.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj154 /dev/null 2024-09-16T05:38:39.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:39.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj155 /dev/null 2024-09-16T05:38:39.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:39.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj156 /dev/null 2024-09-16T05:38:39.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:39.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj157 /dev/null 2024-09-16T05:38:39.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:39.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj158 /dev/null 2024-09-16T05:38:39.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:39.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj159 /dev/null 2024-09-16T05:38:39.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:39.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj160 /dev/null 2024-09-16T05:38:40.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:40.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj161 /dev/null 2024-09-16T05:38:40.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:40.107 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj162 /dev/null 2024-09-16T05:38:40.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:40.241 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj163 /dev/null 2024-09-16T05:38:40.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:40.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj164 /dev/null 2024-09-16T05:38:40.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:40.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj165 /dev/null 2024-09-16T05:38:40.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:40.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj166 /dev/null 2024-09-16T05:38:40.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:40.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj167 /dev/null 2024-09-16T05:38:40.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:40.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj168 /dev/null 2024-09-16T05:38:40.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:40.919 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj169 /dev/null 2024-09-16T05:38:41.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:41.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj170 /dev/null 2024-09-16T05:38:41.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:41.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj171 /dev/null 2024-09-16T05:38:41.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:41.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj172 /dev/null 2024-09-16T05:38:41.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:41.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj173 /dev/null 2024-09-16T05:38:41.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:41.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj174 /dev/null 2024-09-16T05:38:41.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:41.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj175 /dev/null 2024-09-16T05:38:41.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:41.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj176 /dev/null 2024-09-16T05:38:41.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:41.789 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj177 /dev/null 2024-09-16T05:38:41.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:41.907 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj178 /dev/null 2024-09-16T05:38:42.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:42.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj179 /dev/null 2024-09-16T05:38:42.115 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:42.116 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj180 /dev/null 2024-09-16T05:38:42.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:42.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj181 /dev/null 2024-09-16T05:38:42.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:42.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj182 /dev/null 2024-09-16T05:38:42.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:42.442 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj183 /dev/null 2024-09-16T05:38:42.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:42.542 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj184 /dev/null 2024-09-16T05:38:42.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:42.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj185 /dev/null 2024-09-16T05:38:42.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:42.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj186 /dev/null 2024-09-16T05:38:42.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:42.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj187 /dev/null 2024-09-16T05:38:42.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:42.994 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj188 /dev/null 2024-09-16T05:38:43.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:43.095 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj189 /dev/null 2024-09-16T05:38:43.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:43.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj190 /dev/null 2024-09-16T05:38:43.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:43.295 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj191 /dev/null 2024-09-16T05:38:43.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:43.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj192 /dev/null 2024-09-16T05:38:43.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:43.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj193 /dev/null 2024-09-16T05:38:43.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:43.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj194 /dev/null 2024-09-16T05:38:43.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:43.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj195 /dev/null 2024-09-16T05:38:43.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:43.898 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj196 /dev/null 2024-09-16T05:38:43.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:43.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj197 /dev/null 2024-09-16T05:38:44.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:44.099 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj198 /dev/null 2024-09-16T05:38:44.199 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:44.200 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj199 /dev/null 2024-09-16T05:38:44.299 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:404: TEST_backfill_sizeup4_allout: for i in $(seq 1 $objects) 2024-09-16T05:38:44.300 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:406: TEST_backfill_sizeup4_allout: rados -p test put obj200 /dev/null 2024-09-16T05:38:44.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:409: TEST_backfill_sizeup4_allout: get_pg test obj1 2024-09-16T05:38:44.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T05:38:44.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T05:38:44.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T05:38:44.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T05:38:44.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:409: TEST_backfill_sizeup4_allout: local PG=1.0 2024-09-16T05:38:44.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:411: TEST_backfill_sizeup4_allout: get_primary test obj1 2024-09-16T05:38:44.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:38:44.895 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:38:44.896 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:38:44.896 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:38:45.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:411: TEST_backfill_sizeup4_allout: local primary=1 2024-09-16T05:38:45.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:412: TEST_backfill_sizeup4_allout: get_not_primary test obj1 2024-09-16T05:38:45.381 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2024-09-16T05:38:45.382 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2024-09-16T05:38:45.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2024-09-16T05:38:45.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:38:45.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:38:45.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:38:45.382 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:38:45.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2024-09-16T05:38:45.812 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2024-09-16T05:38:45.812 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2024-09-16T05:38:46.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:412: TEST_backfill_sizeup4_allout: local otherosd=0 2024-09-16T05:38:46.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:414: TEST_backfill_sizeup4_allout: ceph osd set nobackfill 2024-09-16T05:38:46.956 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is set 2024-09-16T05:38:46.967 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:415: TEST_backfill_sizeup4_allout: ceph osd out osd.0 2024-09-16T05:38:47.619 INFO:tasks.workunit.client.0.smithi026.stderr:osd.0 is already out. 2024-09-16T05:38:47.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:416: TEST_backfill_sizeup4_allout: ceph osd out osd.1 2024-09-16T05:38:48.349 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. 2024-09-16T05:38:48.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:417: TEST_backfill_sizeup4_allout: ceph osd pool set test size 4 2024-09-16T05:38:49.329 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 4 2024-09-16T05:38:49.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:419: TEST_backfill_sizeup4_allout: sleep 2 2024-09-16T05:38:51.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:420: TEST_backfill_sizeup4_allout: get_primary test obj1 2024-09-16T05:38:51.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:38:51.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:38:51.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:38:51.344 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:38:51.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:420: TEST_backfill_sizeup4_allout: primary=0 2024-09-16T05:38:51.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:421: TEST_backfill_sizeup4_allout: ceph osd unset nobackfill 2024-09-16T05:38:52.391 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is unset 2024-09-16T05:38:52.403 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:422: TEST_backfill_sizeup4_allout: ceph tell osd.0 get_latest_osdmap 2024-09-16T05:38:52.521 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:423: TEST_backfill_sizeup4_allout: ceph tell osd.0 debug kick_recovery_wq 0 2024-09-16T05:38:52.722 INFO:tasks.workunit.client.0.smithi026.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2024-09-16T05:38:52.730 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:424: TEST_backfill_sizeup4_allout: sleep 2 2024-09-16T05:38:54.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:426: TEST_backfill_sizeup4_allout: wait_for_clean 2024-09-16T05:38:54.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:38:54.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:38:54.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:38:54.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:38:54.733 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:38:54.734 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:38:54.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:38:54.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:38:54.734 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:38:54.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:38:54.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:38:54.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:38:54.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:38:54.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:38:54.836 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:38:55.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:38:55.338 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:38:55.338 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:38:55.339 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:38:55.339 INFO:tasks.workunit.client.0.smithi026.stderr:4' 2024-09-16T05:38:55.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:38:55.339 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:38:55.339 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:38:55.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836527 2024-09-16T05:38:55.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836527 2024-09-16T05:38:55.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527' 2024-09-16T05:38:55.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:38:55.559 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:38:55.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672997 2024-09-16T05:38:55.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672997 2024-09-16T05:38:55.678 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949672997' 2024-09-16T05:38:55.679 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:38:55.679 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:38:55.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509472 2024-09-16T05:38:55.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509472 2024-09-16T05:38:55.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949672997 2-64424509472' 2024-09-16T05:38:55.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:38:55.881 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:38:56.001 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345945 2024-09-16T05:38:56.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345945 2024-09-16T05:38:56.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949672997 2-64424509472 3-85899345945' 2024-09-16T05:38:56.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:38:56.002 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:38:56.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182416 2024-09-16T05:38:56.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182416 2024-09-16T05:38:56.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836527 1-42949672997 2-64424509472 3-85899345945 4-107374182416' 2024-09-16T05:38:56.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:38:56.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836527 2024-09-16T05:38:56.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:38:56.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:38:56.159 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836527 2024-09-16T05:38:56.160 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:38:56.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836527 2024-09-16T05:38:56.164 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836527 2024-09-16T05:38:56.164 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836527' 2024-09-16T05:38:56.164 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:38:56.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836525 -lt 21474836527 2024-09-16T05:38:56.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T05:38:57.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T05:38:57.565 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:38:58.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836527 -lt 21474836527 2024-09-16T05:38:58.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:38:58.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672997 2024-09-16T05:38:58.010 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:38:58.011 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:38:58.011 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672997 2024-09-16T05:38:58.011 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:38:58.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672997 2024-09-16T05:38:58.012 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672997' 2024-09-16T05:38:58.013 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672997 2024-09-16T05:38:58.013 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:38:58.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672997 -lt 42949672997 2024-09-16T05:38:58.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:38:58.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509472 2024-09-16T05:38:58.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:38:58.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:38:58.557 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509472 2024-09-16T05:38:58.557 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:38:58.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509472 2024-09-16T05:38:58.558 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509472 2024-09-16T05:38:58.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509472' 2024-09-16T05:38:58.559 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:38:59.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509473 -lt 64424509472 2024-09-16T05:38:59.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:38:59.248 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345945 2024-09-16T05:38:59.248 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:38:59.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:38:59.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345945 2024-09-16T05:38:59.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:38:59.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345945 2024-09-16T05:38:59.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345945' 2024-09-16T05:38:59.251 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345945 2024-09-16T05:38:59.251 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:38:59.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345945 -lt 85899345945 2024-09-16T05:38:59.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:38:59.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182416 2024-09-16T05:38:59.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:38:59.823 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:38:59.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182416 2024-09-16T05:38:59.824 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:38:59.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182416 2024-09-16T05:38:59.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182416' 2024-09-16T05:38:59.825 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182416 2024-09-16T05:38:59.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:39:00.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182417 -lt 107374182416 2024-09-16T05:39:00.425 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:39:00.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:00.426 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:01.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:39:01.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:01.306 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:01.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:01.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:01.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:01.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:01.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:01.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:01.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:01.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:01.720 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:02.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:02.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T05:39:02.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T05:39:02.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T05:39:02.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:02.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:02.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:02.571 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:02.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:02.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:02.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:02.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:02.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:02.572 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:03.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:03.033 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:03.034 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:03.034 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:03.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:03.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:03.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:03.732 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:03.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:03.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:03.733 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:03.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:03.733 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:04.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:39:04.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:39:04.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:04.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:04.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:04.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:04.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:04.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:04.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:04.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:04.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:04.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:04.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:04.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:04.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:04.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:04.903 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:05.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:05.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:05.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:05.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:05.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:05.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:05.535 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:05.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:05.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:06.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4 2024-09-16T05:39:06.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4 '!=' null 2024-09-16T05:39:06.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:06.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:06.117 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:06.217 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:06.218 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:06.218 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:06.218 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:06.219 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:06.219 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:06.219 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:06.219 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:06.690 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:06.690 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:06.690 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:06.691 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:07.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:07.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:07.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:07.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:07.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:07.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:07.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:07.429 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:07.429 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:08.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4 2024-09-16T05:39:08.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4 '!=' null 2024-09-16T05:39:08.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:08.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:08.036 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:08.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:08.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:08.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:08.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:08.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:08.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:08.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:08.138 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:08.645 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:08.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:08.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:08.645 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:09.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:09.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:09.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:09.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:09.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:09.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:09.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:09.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:09.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:09.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:39:09.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:39:09.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:09.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:09.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:10.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:10.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:10.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:10.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:10.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:10.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:10.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:10.037 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:10.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:10.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:10.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:10.503 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:11.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:11.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:11.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:11.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:11.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:11.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:11.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:11.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:11.158 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:11.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4 2024-09-16T05:39:11.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4 '!=' null 2024-09-16T05:39:11.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:11.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:11.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:11.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:11.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:11.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:11.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:11.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:11.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:11.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:11.966 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:12.431 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:12.431 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:12.431 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:12.432 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:13.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:13.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:13.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:13.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:13.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:13.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:13.105 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:13.105 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:13.105 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:13.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:39:13.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:39:13.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:13.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:13.709 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:13.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:13.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:13.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:13.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:13.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:13.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:13.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:13.811 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:14.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:14.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:14.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:14.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:14.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:14.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:14.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:14.985 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:14.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:14.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:14.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:14.986 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:14.986 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:15.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:39:15.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:39:15.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:15.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:15.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:15.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:15.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:15.769 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:15.770 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:15.770 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:15.770 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:15.770 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:15.770 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:16.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:16.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:16.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:16.246 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:16.902 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:16.902 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:16.902 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:17.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:39:17.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:39:17.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:17.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:17.498 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:17.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:17.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:17.599 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:17.599 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:17.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:17.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:17.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:17.600 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:17.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:17.997 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:17.998 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:17.998 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:18.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:18.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:18.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:18.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:18.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:18.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:18.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:18.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:18.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:19.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:39:19.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:39:19.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:19.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:19.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:19.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:19.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:19.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:19.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:19.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:19.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:19.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:19.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:19.746 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:19.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:19.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:19.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:20.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:20.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:20.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:20.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:20.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:20.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:20.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:20.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:20.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:20.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:39:20.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:39:20.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:20.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:20.945 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:21.045 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:21.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:21.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:21.046 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:21.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:21.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:21.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:21.047 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:21.444 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:21.444 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:21.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:21.445 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:22.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:22.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:22.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:22.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:22.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:22.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:22.181 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:22.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:22.181 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:22.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:39:22.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:39:22.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:22.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:22.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:22.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:22.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:22.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:22.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:22.855 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:22.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:22.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:22.856 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:23.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:23.261 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:23.261 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:23.261 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:23.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:23.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:23.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:23.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:23.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:23.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:23.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:23.873 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:23.873 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:24.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:39:24.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:39:24.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:24.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:24.532 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:24.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:24.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:24.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:24.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:24.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:24.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:24.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:24.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:25.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:25.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:25.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:25.143 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:25.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:25.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:25.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:25.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:25.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:25.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:25.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:25.694 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:25.694 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:26.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4 2024-09-16T05:39:26.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4 '!=' null 2024-09-16T05:39:26.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:26.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:26.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:26.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:26.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:26.606 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:26.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:26.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:26.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:26.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:26.607 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:27.017 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:27.017 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:27.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:27.018 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:27.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:27.600 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:27.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:27.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:27.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:27.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:27.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:27.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:27.601 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:28.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=3 2024-09-16T05:39:28.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 3 '!=' null 2024-09-16T05:39:28.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:28.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:28.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:28.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:28.249 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:28.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:28.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:28.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:28.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:28.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:28.249 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:28.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:39:28.647 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:28.647 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:28.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:39:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:39:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:39:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:39:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:39:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:39:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:39:29.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:39:29.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:39:29.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:39:29.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:39:29.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:39:29.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:39:29.792 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:39:29.893 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:39:29.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:39:29.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:39:29.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:39:29.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:39:29.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:39:29.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:39:29.894 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:39:30.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:39:30.291 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:39:30.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:39:30.292 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:39:30.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:39:30.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:39:30.842 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:39:30.842 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:428: TEST_backfill_sizeup4_allout: expr 200 '*' 2 2024-09-16T05:39:30.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:428: TEST_backfill_sizeup4_allout: local misdeg=400 2024-09-16T05:39:30.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:429: TEST_backfill_sizeup4_allout: check td/osd-backfill-stats 1.0 0 replicated 400 0 400 200 2024-09-16T05:39:30.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-09-16T05:39:30.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-09-16T05:39:30.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=0 2024-09-16T05:39:30.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-09-16T05:39:30.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=400 2024-09-16T05:39:30.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-09-16T05:39:30.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=400 2024-09-16T05:39:30.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=200 2024-09-16T05:39:30.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-09-16T05:39:30.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-09-16T05:39:30.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-09-16T05:39:30.845 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log 2024-09-16T05:39:30.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.0.log 2024-09-16T05:39:30.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-09-16T05:39:30.846 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log 2024-09-16T05:39:30.858 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.0.log 2024-09-16T05:39:30.858 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.0.log 2024-09-16T05:39:30.859 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-09-16T05:39:30.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-09-16T05:39:30.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-09-16T05:39:30.860 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-09-16T05:39:30.860 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-09-16T05:39:30.861 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.0.log 2024-09-16T05:39:30.861 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-09-16T05:39:30.861 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-09-16T05:39:30.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[2,4,3]/[0,1]' 2024-09-16T05:39:30.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[2,4,3]/[0,1]' ']' 2024-09-16T05:39:30.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-09-16T05:39:30.885 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:39:30.886 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.0.log 2024-09-16T05:39:30.886 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [2,4,3]/[0,1] ' 2024-09-16T05:39:30.886 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-09-16T05:39:30.886 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-09-16T05:39:30.886 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:39:30.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=400 2024-09-16T05:39:30.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 400 ']' 2024-09-16T05:39:30.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 400 400 2024-09-16T05:39:30.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-09-16T05:39:30.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:39:30.890 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-09-16T05:39:30.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:39:30.891 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:39:30.891 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.0.log 2024-09-16T05:39:30.891 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-09-16T05:39:30.891 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:39:30.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=2 2024-09-16T05:39:30.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 2 ']' 2024-09-16T05:39:30.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 2 0 2024-09-16T05:39:30.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=2 2024-09-16T05:39:30.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:39:30.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:39:30.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:39:30.900 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-09-16T05:39:30.900 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:39:30.901 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.0.log 2024-09-16T05:39:30.901 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [2,4,3]/[0,1] ' 2024-09-16T05:39:30.901 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-09-16T05:39:30.901 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-09-16T05:39:30.901 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:39:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=400 2024-09-16T05:39:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 400 ']' 2024-09-16T05:39:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 400 400 2024-09-16T05:39:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-09-16T05:39:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:39:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-09-16T05:39:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:39:30.905 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:39:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.0.log 2024-09-16T05:39:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-09-16T05:39:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:39:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=201 2024-09-16T05:39:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 201 ']' 2024-09-16T05:39:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 201 200 2024-09-16T05:39:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=201 2024-09-16T05:39:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:39:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=200 2024-09-16T05:39:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:39:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-09-16T05:39:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:431: TEST_backfill_sizeup4_allout: delete_pool test 2024-09-16T05:39:30.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T05:39:30.916 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T05:39:31.440 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T05:39:31.452 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:432: TEST_backfill_sizeup4_allout: kill_daemons td/osd-backfill-stats 2024-09-16T05:39:31.452 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:39:31.453 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:39:31.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:39:31.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:39:31.453 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:39:36.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:39:36.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-09-16T05:39:36.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:39:36.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:39:36.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:39:36.770 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:39:36.770 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:39:36.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:39:36.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:39:36.770 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:39:36.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:39:36.778 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:39:36.779 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:39:36.779 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:39:36.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:39:36.780 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:39:36.781 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:39:36.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:39:36.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:39:36.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:39:36.783 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:39:36.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:39:36.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:39:36.785 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:39:36.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:39:36.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:39:36.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:39:36.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:39:36.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:39:36.824 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:39:36.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:35: run: for func in $funcs 2024-09-16T05:39:36.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:36: run: setup td/osd-backfill-stats 2024-09-16T05:39:36.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-backfill-stats 2024-09-16T05:39:36.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-backfill-stats 2024-09-16T05:39:36.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:39:36.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:39:36.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:39:36.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:39:36.825 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:39:36.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:39:36.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:39:36.825 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:39:36.826 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:39:36.827 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:39:36.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:39:36.828 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:39:36.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:39:36.829 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:39:36.830 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:39:36.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:39:36.830 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:39:36.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:39:36.831 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:39:36.832 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:39:36.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:39:36.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:39:36.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:39:36.835 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:39:36.835 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:39:36.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:39:36.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:39:36.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:39:36.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-backfill-stats 2024-09-16T05:39:36.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2024-09-16T05:39:36.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:39:36.837 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:39:36.838 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.478321 2024-09-16T05:39:36.840 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2024-09-16T05:39:36.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2024-09-16T05:39:36.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2024-09-16T05:39:36.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-backfill-stats 1' TERM HUP INT 2024-09-16T05:39:36.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:37: run: TEST_backfill_sizeup_out td/osd-backfill-stats 2024-09-16T05:39:36.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:182: TEST_backfill_sizeup_out: local dir=td/osd-backfill-stats 2024-09-16T05:39:36.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:184: TEST_backfill_sizeup_out: run_mon td/osd-backfill-stats a 2024-09-16T05:39:36.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-backfill-stats 2024-09-16T05:39:36.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2024-09-16T05:39:36.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2024-09-16T05:39:36.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2024-09-16T05:39:36.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-backfill-stats/a 2024-09-16T05:39:36.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-backfill-stats/a --run-dir=td/osd-backfill-stats 2024-09-16T05:39:37.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2024-09-16T05:39:37.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:39:37.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:39:37.353 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:39:37.354 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:39:37.354 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:39:37.354 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:39:37.354 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-backfill-stats/a '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --mon-cluster-log-file=td/osd-backfill-stats/log --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2024-09-16T05:39:37.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2024-09-16T05:39:37.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2024-09-16T05:39:37.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:39:37.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:39:37.556 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2024-09-16T05:39:37.557 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2024-09-16T05:39:37.557 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:39:37.557 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:39:37.557 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:39:37.558 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:39:37.558 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:39:37.558 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:39:37.558 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:39:37.558 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:39:37.558 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get fsid 2024-09-16T05:39:37.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2024-09-16T05:39:37.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2024-09-16T05:39:37.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2024-09-16T05:39:37.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2024-09-16T05:39:37.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2024-09-16T05:39:37.652 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2024-09-16T05:39:37.653 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2024-09-16T05:39:37.653 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2024-09-16T05:39:37.653 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2024-09-16T05:39:37.653 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:39:37.653 INFO:tasks.workunit.client.0.smithi026.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:39:37.653 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.478321/ceph-mon.a.asok 2024-09-16T05:39:37.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2024-09-16T05:39:37.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.478321/ceph-mon.a.asok config get mon_host 2024-09-16T05:39:37.735 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:185: TEST_backfill_sizeup_out: run_mgr td/osd-backfill-stats x 2024-09-16T05:39:37.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-backfill-stats 2024-09-16T05:39:37.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2024-09-16T05:39:37.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2024-09-16T05:39:37.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2024-09-16T05:39:37.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-backfill-stats/x 2024-09-16T05:39:37.736 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2024-09-16T05:39:38.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2024-09-16T05:39:38.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:39:38.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:39:38.597 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:39:38.597 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:39:38.597 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:39:38.597 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:39:38.598 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:39:38.598 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-backfill-stats/x '--log-file=td/osd-backfill-stats/$name.log' '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --run-dir=td/osd-backfill-stats '--pid-file=td/osd-backfill-stats/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-09-16T05:39:38.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:186: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 0 2024-09-16T05:39:38.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:39:38.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:39:38.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/0 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/0' 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/0/journal' 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:39:38.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:39:38.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:39:38.632 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:39:38.632 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:39:38.632 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:39:38.632 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:39:38.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:39:38.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:39:38.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:39:38.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:39:38.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:39:38.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:39:38.632 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:39:38.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:39:38.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:39:38.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:39:38.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:39:38.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:39:38.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/0 2024-09-16T05:39:38.633 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:39:38.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1e8498eb-964e-4fbf-b162-9cb652ec0f31 2024-09-16T05:39:38.634 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1e8498eb-964e-4fbf-b162-9cb652ec0f31' 2024-09-16T05:39:38.634 INFO:tasks.workunit.client.0.smithi026.stdout:add osd0 1e8498eb-964e-4fbf-b162-9cb652ec0f31 2024-09-16T05:39:38.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:39:38.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCaxOdmZUHhJhAAFOV5CNtJY6yNGLpLUDqxGg== 2024-09-16T05:39:38.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCaxOdmZUHhJhAAFOV5CNtJY6yNGLpLUDqxGg=="}' 2024-09-16T05:39:38.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1e8498eb-964e-4fbf-b162-9cb652ec0f31 -i td/osd-backfill-stats/0/new.json 2024-09-16T05:39:38.913 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:39:38.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/0/new.json 2024-09-16T05:39:38.924 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCaxOdmZUHhJhAAFOV5CNtJY6yNGLpLUDqxGg== --osd-uuid 1e8498eb-964e-4fbf-b162-9cb652ec0f31 2024-09-16T05:39:38.955 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:39:38.954+0000 7f9c3ef23640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:39:38.981 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:39:38.979+0000 7f9c3ef23640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:39:38.982 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:39:38.980+0000 7f9c3ef23640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:39:38.982 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:39:38.981+0000 7f9c3ef23640 -1 bdev(0x5582aa5a3c00 td/osd-backfill-stats/0/block) open stat got: (1) Operation not permitted 2024-09-16T05:39:38.982 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:39:38.981+0000 7f9c3ef23640 -1 bluestore(td/osd-backfill-stats/0) _read_fsid unparsable uuid 2024-09-16T05:39:44.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/0/keyring 2024-09-16T05:39:44.276 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:39:44.277 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd0 key to auth repository 2024-09-16T05:39:44.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2024-09-16T05:39:44.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:39:44.840 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.0 2024-09-16T05:39:44.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2024-09-16T05:39:44.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/0 --osd-journal=td/osd-backfill-stats/0/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:39:44.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:39:44.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:39:44.841 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:39:44.870 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:39:44.868+0000 7f387441d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:39:44.884 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:39:44.882+0000 7f387441d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:39:44.885 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:39:44.884+0000 7f387441d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:39:45.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2024-09-16T05:39:45.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:39:45.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2024-09-16T05:39:45.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:39:45.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:39:45.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:39:45.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:39:45.315 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:39:45.315 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:39:45.316 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:39:45.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:39:46.223 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:39:46.222+0000 7f387441d640 -1 Falling back to public interface 2024-09-16T05:39:46.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:39:46.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:39:46.742 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:39:46.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:39:46.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:39:46.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:39:47.166 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:39:48.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:39:48.168 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:39:48.168 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:39:48.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:39:48.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:39:48.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:39:48.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:39:48.954 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:39:48.953+0000 7f387441d640 -1 osd.0 0 log_to_monitors true 2024-09-16T05:39:49.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:39:49.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:39:49.584 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:39:49.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:39:49.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:39:49.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:39:50.098 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:39:51.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:39:51.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:39:51.100 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:39:51.101 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:39:51.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:39:51.101 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:39:51.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:39:52.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:39:52.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:39:52.517 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:39:52.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:39:52.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:39:52.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:39:53.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:39:54.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:39:54.004 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:39:54.005 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:39:54.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:39:54.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:39:54.006 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:39:54.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:39:55.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:39:55.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:39:55.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:39:55.429 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:39:55.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:39:55.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:39:55.844 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:39:56.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:39:56.845 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:39:56.846 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:39:56.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:39:56.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:39:56.846 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:39:57.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:39:58.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:39:58.272 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:39:58.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:39:58.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:39:58.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:39:58.273 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:39:58.724 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:39:59.725 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:39:59.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:39:59.726 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:39:59.726 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:39:59.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:39:59.727 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:40:00.267 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:01.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:01.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:01.270 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:40:01.270 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:40:01.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:01.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:40:01.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:02.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:02.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:02.741 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:40:02.741 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:40:02.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:02.742 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:40:03.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:04.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:04.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:04.290 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:40:04.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:40:04.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:04.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:40:04.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:05.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:05.836 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:05.836 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:40:05.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:40:05.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:05.837 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:40:06.455 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:07.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:07.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:07.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:40:07.458 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:40:07.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:07.458 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:40:08.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:09.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:09.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:09.238 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:40:09.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:40:09.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:09.239 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:40:10.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:11.210 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:11.210 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:40:11.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:40:11.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:11.211 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2024-09-16T05:40:11.664 INFO:tasks.workunit.client.0.smithi026.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/611578834,v1:127.0.0.1:6803/611578834] [v2:127.0.0.1:6804/611578834,v1:127.0.0.1:6805/611578834] exists,up 1e8498eb-964e-4fbf-b162-9cb652ec0f31 2024-09-16T05:40:11.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:40:11.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:40:11.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:40:11.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:187: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 1 2024-09-16T05:40:11.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:40:11.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:40:11.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2024-09-16T05:40:11.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:40:11.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/1 2024-09-16T05:40:11.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/1' 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/1/journal' 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:40:11.669 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:40:11.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:40:11.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/1 2024-09-16T05:40:11.671 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:40:11.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d9b9179d-6a49-430e-8f4f-b49b9de5fd17 2024-09-16T05:40:11.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 d9b9179d-6a49-430e-8f4f-b49b9de5fd17' 2024-09-16T05:40:11.671 INFO:tasks.workunit.client.0.smithi026.stdout:add osd1 d9b9179d-6a49-430e-8f4f-b49b9de5fd17 2024-09-16T05:40:11.671 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:40:11.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC7xOdmvBz8KBAA7RJtRRN0EL83Q7yGKT597Q== 2024-09-16T05:40:11.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC7xOdmvBz8KBAA7RJtRRN0EL83Q7yGKT597Q=="}' 2024-09-16T05:40:11.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d9b9179d-6a49-430e-8f4f-b49b9de5fd17 -i td/osd-backfill-stats/1/new.json 2024-09-16T05:40:12.201 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:40:12.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/1/new.json 2024-09-16T05:40:12.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC7xOdmvBz8KBAA7RJtRRN0EL83Q7yGKT597Q== --osd-uuid d9b9179d-6a49-430e-8f4f-b49b9de5fd17 2024-09-16T05:40:12.244 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:12.243+0000 7fdf9f54d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:40:12.246 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:12.246+0000 7fdf9f54d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:40:12.247 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:12.247+0000 7fdf9f54d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:40:12.248 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:12.247+0000 7fdf9f54d640 -1 bdev(0x55a183ea7c00 td/osd-backfill-stats/1/block) open stat got: (1) Operation not permitted 2024-09-16T05:40:12.248 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:12.248+0000 7fdf9f54d640 -1 bluestore(td/osd-backfill-stats/1) _read_fsid unparsable uuid 2024-09-16T05:40:18.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/1/keyring 2024-09-16T05:40:18.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:40:18.144 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd1 key to auth repository 2024-09-16T05:40:18.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2024-09-16T05:40:18.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:40:18.715 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.1 2024-09-16T05:40:18.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2024-09-16T05:40:18.715 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/1 --osd-journal=td/osd-backfill-stats/1/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:40:18.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:40:18.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:40:18.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:40:18.744 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:18.744+0000 7fd6ff615640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:40:18.746 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:18.746+0000 7fd6ff615640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:40:18.747 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:18.747+0000 7fd6ff615640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:40:19.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2024-09-16T05:40:19.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:40:19.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2024-09-16T05:40:19.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:40:19.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:40:19.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:19.125 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:40:19.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:40:19.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:19.126 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:19.549 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:20.337 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:20.336+0000 7fd6ff615640 -1 Falling back to public interface 2024-09-16T05:40:20.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:20.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:20.550 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:40:20.551 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:40:20.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:20.551 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:20.974 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:21.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:21.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:21.975 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:40:21.975 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:40:21.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:21.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:22.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:23.190 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:23.189+0000 7fd6ff615640 -1 osd.1 0 log_to_monitors true 2024-09-16T05:40:23.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:23.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:23.412 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:40:23.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:40:23.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:23.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:23.883 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:24.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:24.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:24.885 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:40:24.885 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:40:24.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:24.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:25.380 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:26.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:26.381 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:26.382 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:40:26.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:40:26.382 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:26.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:26.810 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:27.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:27.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:27.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:40:27.813 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:40:27.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:27.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:28.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:29.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:29.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:29.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:40:29.335 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:40:29.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:29.335 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:29.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:30.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:30.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:30.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:40:30.777 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:40:30.777 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:30.778 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:31.397 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:32.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:32.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:32.398 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:40:32.398 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:40:32.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:32.399 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:32.819 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:33.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:33.820 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:33.821 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:40:33.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:40:33.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:33.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:34.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:35.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:35.385 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:35.385 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:40:35.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:40:35.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:35.386 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:36.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:37.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:37.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:37.290 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:40:37.290 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:40:37.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:37.291 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:38.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:39.038 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:39.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:39.039 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:40:39.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:40:39.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:39.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:40.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:41.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:41.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:41.039 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:40:41.039 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:40:41.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:41.040 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:41.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:42.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:42.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:42.799 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:40:42.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:40:42.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:42.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:43.623 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:44.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:44.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:44.625 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:40:44.625 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:40:44.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:44.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:45.205 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:46.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:46.206 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:46.207 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:40:46.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:40:46.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:46.207 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2024-09-16T05:40:46.643 INFO:tasks.workunit.client.0.smithi026.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3900533664,v1:127.0.0.1:6811/3900533664] [v2:127.0.0.1:6812/3900533664,v1:127.0.0.1:6813/3900533664] exists,up d9b9179d-6a49-430e-8f4f-b49b9de5fd17 2024-09-16T05:40:46.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:40:46.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:40:46.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:40:46.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:188: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 2 2024-09-16T05:40:46.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:40:46.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:40:46.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2024-09-16T05:40:46.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:40:46.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/2 2024-09-16T05:40:46.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:40:46.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:40:46.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:40:46.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:40:46.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/2' 2024-09-16T05:40:46.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/2/journal' 2024-09-16T05:40:46.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:40:46.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:40:46.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:40:46.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:40:46.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:40:46.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:40:46.648 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:40:46.648 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:40:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:40:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:40:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/2 2024-09-16T05:40:46.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:40:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=66967c91-bcd9-49c0-8242-06b7b0c8a682 2024-09-16T05:40:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 66967c91-bcd9-49c0-8242-06b7b0c8a682' 2024-09-16T05:40:46.650 INFO:tasks.workunit.client.0.smithi026.stdout:add osd2 66967c91-bcd9-49c0-8242-06b7b0c8a682 2024-09-16T05:40:46.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:40:46.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDexOdmrES8JxAA8hjbdP+eiZLDXEAsM97diQ== 2024-09-16T05:40:46.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDexOdmrES8JxAA8hjbdP+eiZLDXEAsM97diQ=="}' 2024-09-16T05:40:46.667 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 66967c91-bcd9-49c0-8242-06b7b0c8a682 -i td/osd-backfill-stats/2/new.json 2024-09-16T05:40:47.200 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:40:47.212 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/2/new.json 2024-09-16T05:40:47.213 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDexOdmrES8JxAA8hjbdP+eiZLDXEAsM97diQ== --osd-uuid 66967c91-bcd9-49c0-8242-06b7b0c8a682 2024-09-16T05:40:47.244 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:47.243+0000 7fe2e7410640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:40:47.246 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:47.245+0000 7fe2e7410640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:40:47.247 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:47.246+0000 7fe2e7410640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:40:47.248 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:47.246+0000 7fe2e7410640 -1 bdev(0x558929ed3c00 td/osd-backfill-stats/2/block) open stat got: (1) Operation not permitted 2024-09-16T05:40:47.248 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:47.246+0000 7fe2e7410640 -1 bluestore(td/osd-backfill-stats/2) _read_fsid unparsable uuid 2024-09-16T05:40:53.432 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/2/keyring 2024-09-16T05:40:53.433 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:40:53.433 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd2 key to auth repository 2024-09-16T05:40:53.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2024-09-16T05:40:53.434 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:40:53.998 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.2 2024-09-16T05:40:54.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2024-09-16T05:40:54.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/2 --osd-journal=td/osd-backfill-stats/2/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:40:54.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:40:54.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:40:54.000 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:40:54.028 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:54.026+0000 7fc60420b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:40:54.039 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:54.037+0000 7fc60420b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:40:54.040 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:54.038+0000 7fc60420b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:40:54.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2024-09-16T05:40:54.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:40:54.469 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2024-09-16T05:40:54.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:40:54.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:40:54.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:54.470 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:40:54.470 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:40:54.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:54.471 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:40:54.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:54.886 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:54.885+0000 7fc60420b640 -1 Falling back to public interface 2024-09-16T05:40:55.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:55.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:55.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:40:55.881 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:40:55.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:55.881 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:40:56.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:57.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:57.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:57.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:40:57.324 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:40:57.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:57.324 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:40:57.425 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:40:57.424+0000 7fc60420b640 -1 osd.2 0 log_to_monitors true 2024-09-16T05:40:57.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:40:58.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:40:58.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:40:58.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:40:58.896 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:40:58.896 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:40:58.897 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:40:59.327 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:00.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:00.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:00.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:41:00.329 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:41:00.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:00.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:00.764 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:01.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:01.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:01.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:41:01.766 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:41:01.766 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:01.767 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:02.328 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:03.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:03.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:03.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:41:03.330 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:41:03.330 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:03.331 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:03.752 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:04.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:04.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:04.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:41:04.754 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:41:04.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:04.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:05.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:06.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:06.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:06.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:41:06.247 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:41:06.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:06.247 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:06.692 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:07.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:07.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:07.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:41:07.693 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:41:07.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:07.694 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:08.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:09.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:09.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:09.111 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:41:09.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:41:09.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:09.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:09.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:10.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:10.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:10.932 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:41:10.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:41:10.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:10.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:11.445 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:12.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:12.447 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:12.448 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:41:12.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:41:12.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:12.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:13.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:14.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:14.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:14.179 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:41:14.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:41:14.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:14.180 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:14.930 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:15.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:15.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:15.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:41:15.933 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:41:15.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:15.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:16.607 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:17.608 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:17.609 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:41:17.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:17.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:41:17.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:17.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:18.663 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:19.664 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:19.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:19.665 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:41:19.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:41:19.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:19.666 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2024-09-16T05:41:20.134 INFO:tasks.workunit.client.0.smithi026.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/166284611,v1:127.0.0.1:6819/166284611] [v2:127.0.0.1:6820/166284611,v1:127.0.0.1:6821/166284611] exists,up 66967c91-bcd9-49c0-8242-06b7b0c8a682 2024-09-16T05:41:20.142 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:41:20.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:41:20.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:41:20.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:189: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 3 2024-09-16T05:41:20.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:41:20.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:41:20.143 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2024-09-16T05:41:20.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:41:20.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/3 2024-09-16T05:41:20.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:41:20.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:41:20.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:41:20.144 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:41:20.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/3' 2024-09-16T05:41:20.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/3/journal' 2024-09-16T05:41:20.145 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:41:20.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:41:20.146 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:41:20.146 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:41:20.146 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:41:20.146 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:41:20.146 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:41:20.147 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:41:20.147 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:41:20.147 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:41:20.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:41:20.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:41:20.147 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:41:20.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:41:20.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:41:20.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:41:20.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:41:20.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:41:20.148 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:41:20.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:41:20.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:41:20.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:41:20.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/3 2024-09-16T05:41:20.149 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:41:20.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b06376dd-3a82-4eac-8c9d-8dc797562075 2024-09-16T05:41:20.150 INFO:tasks.workunit.client.0.smithi026.stdout:add osd3 b06376dd-3a82-4eac-8c9d-8dc797562075 2024-09-16T05:41:20.151 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 b06376dd-3a82-4eac-8c9d-8dc797562075' 2024-09-16T05:41:20.151 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:41:20.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAAxedmUCJ4CRAA1yVYYlUEOE+8tlyIi5se0g== 2024-09-16T05:41:20.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAAxedmUCJ4CRAA1yVYYlUEOE+8tlyIi5se0g=="}' 2024-09-16T05:41:20.160 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b06376dd-3a82-4eac-8c9d-8dc797562075 -i td/osd-backfill-stats/3/new.json 2024-09-16T05:41:20.691 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:41:20.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/3/new.json 2024-09-16T05:41:20.704 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAAxedmUCJ4CRAA1yVYYlUEOE+8tlyIi5se0g== --osd-uuid b06376dd-3a82-4eac-8c9d-8dc797562075 2024-09-16T05:41:20.735 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:20.735+0000 7f4500e1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:41:20.737 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:20.737+0000 7f4500e1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:41:20.738 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:20.738+0000 7f4500e1e640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:41:20.738 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:20.738+0000 7f4500e1e640 -1 bdev(0x55bdf3c0dc00 td/osd-backfill-stats/3/block) open stat got: (1) Operation not permitted 2024-09-16T05:41:20.739 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:20.738+0000 7f4500e1e640 -1 bluestore(td/osd-backfill-stats/3) _read_fsid unparsable uuid 2024-09-16T05:41:26.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/3/keyring 2024-09-16T05:41:26.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:41:26.689 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd3 key to auth repository 2024-09-16T05:41:26.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2024-09-16T05:41:26.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:41:27.255 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.3 2024-09-16T05:41:27.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2024-09-16T05:41:27.256 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/3 --osd-journal=td/osd-backfill-stats/3/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:41:27.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:41:27.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:41:27.257 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:41:27.285 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:27.284+0000 7f216122a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:41:27.287 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:27.286+0000 7f216122a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:41:27.288 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:27.288+0000 7f216122a640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:41:27.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2024-09-16T05:41:27.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:41:27.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2024-09-16T05:41:27.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:41:27.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:41:27.719 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:27.719 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:41:27.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:41:27.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:27.720 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:28.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:28.636 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:28.635+0000 7f216122a640 -1 Falling back to public interface 2024-09-16T05:41:29.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:29.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:29.171 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:41:29.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:41:29.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:29.171 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:29.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:30.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:30.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:30.592 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:41:30.592 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:41:30.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:30.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:31.019 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:31.499 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:31.498+0000 7f216122a640 -1 osd.3 0 log_to_monitors true 2024-09-16T05:41:32.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:32.020 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:32.020 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:41:32.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:41:32.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:32.021 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:32.586 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:33.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:33.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:33.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:41:33.589 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:41:33.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:33.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:34.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:35.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:35.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:35.069 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:41:35.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:41:35.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:35.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:35.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:36.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:36.635 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:36.635 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:41:36.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:41:36.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:36.636 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:37.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:38.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:38.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:38.132 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:41:38.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:41:38.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:38.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:38.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:39.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:39.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:39.674 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:41:39.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:41:39.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:39.675 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:40.185 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:41.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:41.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:41.187 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:41:41.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:41:41.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:41.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:41.647 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:42.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:42.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:42.649 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:41:42.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:41:42.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:42.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:43.084 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:44.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:44.085 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:44.086 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:41:44.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:41:44.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:44.086 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:44.769 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:45.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:45.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:45.771 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:41:45.771 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:41:45.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:45.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:46.436 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:47.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:47.438 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:47.438 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:41:47.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:41:47.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:47.439 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:48.420 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:49.421 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:49.421 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:41:49.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:49.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:41:49.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:49.422 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:50.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:51.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:51.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:51.132 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:41:51.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:41:51.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:51.133 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:51.610 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:52.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:52.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:52.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:41:52.612 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:41:52.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:52.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:53.067 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:41:54.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:41:54.068 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:41:54.068 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:41:54.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:41:54.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:41:54.069 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2024-09-16T05:41:54.621 INFO:tasks.workunit.client.0.smithi026.stdout:osd.3 up in weight 1 up_from 20 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/963808699,v1:127.0.0.1:6827/963808699] [v2:127.0.0.1:6828/963808699,v1:127.0.0.1:6829/963808699] exists,up b06376dd-3a82-4eac-8c9d-8dc797562075 2024-09-16T05:41:54.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:41:54.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:41:54.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:41:54.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:190: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 4 2024-09-16T05:41:54.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:41:54.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:41:54.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2024-09-16T05:41:54.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:41:54.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/4 2024-09-16T05:41:54.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:41:54.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:41:54.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:41:54.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:41:54.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/4' 2024-09-16T05:41:54.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/4/journal' 2024-09-16T05:41:54.627 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:41:54.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:41:54.628 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:41:54.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:41:54.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:41:54.628 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:41:54.628 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:41:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:41:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:41:54.629 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:41:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:41:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:41:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:41:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:41:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:41:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:41:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:41:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:41:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:41:54.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:41:54.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:41:54.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:41:54.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/4 2024-09-16T05:41:54.630 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:41:54.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cc71711d-13bb-46fd-9a53-3245ae65a30b 2024-09-16T05:41:54.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 cc71711d-13bb-46fd-9a53-3245ae65a30b' 2024-09-16T05:41:54.630 INFO:tasks.workunit.client.0.smithi026.stdout:add osd4 cc71711d-13bb-46fd-9a53-3245ae65a30b 2024-09-16T05:41:54.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:41:54.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAixedmMGxvJhAAJd1Y7M8w5G7xbZiOTosh/A== 2024-09-16T05:41:54.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAixedmMGxvJhAAJd1Y7M8w5G7xbZiOTosh/A=="}' 2024-09-16T05:41:54.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cc71711d-13bb-46fd-9a53-3245ae65a30b -i td/osd-backfill-stats/4/new.json 2024-09-16T05:41:55.113 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:41:55.124 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/4/new.json 2024-09-16T05:41:55.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAixedmMGxvJhAAJd1Y7M8w5G7xbZiOTosh/A== --osd-uuid cc71711d-13bb-46fd-9a53-3245ae65a30b 2024-09-16T05:41:55.157 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:55.155+0000 7f6b9ba0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:41:55.158 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:55.157+0000 7f6b9ba0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:41:55.159 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:55.158+0000 7f6b9ba0d640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:41:55.160 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:55.158+0000 7f6b9ba0d640 -1 bdev(0x55f6bfd71c00 td/osd-backfill-stats/4/block) open stat got: (1) Operation not permitted 2024-09-16T05:41:55.160 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:41:55.158+0000 7f6b9ba0d640 -1 bluestore(td/osd-backfill-stats/4) _read_fsid unparsable uuid 2024-09-16T05:42:00.861 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/4/keyring 2024-09-16T05:42:00.862 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:42:00.863 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd4 key to auth repository 2024-09-16T05:42:00.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2024-09-16T05:42:00.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:42:01.428 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.4 2024-09-16T05:42:01.428 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2024-09-16T05:42:01.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/4 --osd-journal=td/osd-backfill-stats/4/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:42:01.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:42:01.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:42:01.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:42:01.457 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:01.456+0000 7fb1c6a0b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:42:01.496 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:01.495+0000 7fb1c6a0b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:42:01.497 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:01.496+0000 7fb1c6a0b640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:42:01.853 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2024-09-16T05:42:01.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:42:01.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2024-09-16T05:42:01.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:42:01.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:42:01.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:01.854 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:42:01.854 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:42:01.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:01.855 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:02.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:02.837 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:02.835+0000 7fb1c6a0b640 -1 Falling back to public interface 2024-09-16T05:42:03.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:03.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:03.303 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:42:03.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:42:03.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:03.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:03.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:04.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:04.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:04.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:42:04.754 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:42:04.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:04.755 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:05.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:05.648 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:05.648+0000 7fb1c6a0b640 -1 osd.4 0 log_to_monitors true 2024-09-16T05:42:06.175 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:06.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:06.176 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:42:06.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:42:06.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:06.177 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:06.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:07.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:07.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:07.670 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:42:07.670 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:42:07.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:07.671 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:08.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:09.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:09.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:09.111 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:42:09.111 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:42:09.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:09.112 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:09.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:10.563 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:10.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:10.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:42:10.564 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:42:10.564 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:10.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:11.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:12.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:12.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:12.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:42:12.033 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:42:12.033 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:12.034 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:12.612 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:13.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:13.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:13.614 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:42:13.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:42:13.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:13.615 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:14.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:15.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:15.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:15.137 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:42:15.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:42:15.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:15.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:15.574 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:16.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:16.576 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:16.577 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:42:16.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:42:16.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:16.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:16.995 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:17.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:17.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:17.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:42:17.997 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:42:17.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:17.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:18.656 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:19.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:19.657 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:19.658 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:42:19.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:42:19.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:19.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:20.541 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:21.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:21.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:21.543 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:42:21.544 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:42:21.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:21.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:22.244 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:23.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:23.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:23.246 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:42:23.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:42:23.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:23.246 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:24.025 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:25.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:25.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:25.026 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:42:25.027 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:42:25.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:25.027 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:25.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:26.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:26.849 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:26.850 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:42:26.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:42:26.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:26.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:27.781 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:28.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:28.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:28.782 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:42:28.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:42:28.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:28.783 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2024-09-16T05:42:29.218 INFO:tasks.workunit.client.0.smithi026.stdout:osd.4 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/978531601,v1:127.0.0.1:6835/978531601] [v2:127.0.0.1:6836/978531601,v1:127.0.0.1:6837/978531601] exists,up cc71711d-13bb-46fd-9a53-3245ae65a30b 2024-09-16T05:42:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:42:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:42:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:42:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:191: TEST_backfill_sizeup_out: run_osd td/osd-backfill-stats 5 2024-09-16T05:42:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-backfill-stats 2024-09-16T05:42:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2024-09-16T05:42:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2024-09-16T05:42:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2024-09-16T05:42:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-backfill-stats/5 2024-09-16T05:42:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 ' 2024-09-16T05:42:29.227 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2024-09-16T05:42:29.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2024-09-16T05:42:29.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2024-09-16T05:42:29.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-backfill-stats/5' 2024-09-16T05:42:29.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-backfill-stats/5/journal' 2024-09-16T05:42:29.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2024-09-16T05:42:29.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2024-09-16T05:42:29.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-backfill-stats' 2024-09-16T05:42:29.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2024-09-16T05:42:29.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2024-09-16T05:42:29.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2024-09-16T05:42:29.228 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2024-09-16T05:42:29.228 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-backfill-stats/$name.log' 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-backfill-stats/$name.pid' 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2024-09-16T05:42:29.229 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2024-09-16T05:42:29.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2024-09-16T05:42:29.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-backfill-stats/5 2024-09-16T05:42:29.230 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2024-09-16T05:42:29.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d62d5fc1-ae69-4df9-821d-0008f1fac3d3 2024-09-16T05:42:29.230 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 d62d5fc1-ae69-4df9-821d-0008f1fac3d3' 2024-09-16T05:42:29.231 INFO:tasks.workunit.client.0.smithi026.stdout:add osd5 d62d5fc1-ae69-4df9-821d-0008f1fac3d3 2024-09-16T05:42:29.231 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2024-09-16T05:42:29.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBFxedmNsxtDhAAeLPV/mfrbK4b4RDfuXzj8w== 2024-09-16T05:42:29.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBFxedmNsxtDhAAeLPV/mfrbK4b4RDfuXzj8w=="}' 2024-09-16T05:42:29.243 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d62d5fc1-ae69-4df9-821d-0008f1fac3d3 -i td/osd-backfill-stats/5/new.json 2024-09-16T05:42:29.750 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:42:29.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-backfill-stats/5/new.json 2024-09-16T05:42:29.762 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBFxedmNsxtDhAAeLPV/mfrbK4b4RDfuXzj8w== --osd-uuid d62d5fc1-ae69-4df9-821d-0008f1fac3d3 2024-09-16T05:42:29.793 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:29.793+0000 7fe52ca22640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:42:29.795 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:29.795+0000 7fe52ca22640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:42:29.796 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:29.796+0000 7fe52ca22640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:42:29.797 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:29.796+0000 7fe52ca22640 -1 bdev(0x55eb6cb6bc00 td/osd-backfill-stats/5/block) open stat got: (1) Operation not permitted 2024-09-16T05:42:29.797 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:29.796+0000 7fe52ca22640 -1 bluestore(td/osd-backfill-stats/5) _read_fsid unparsable uuid 2024-09-16T05:42:35.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-backfill-stats/5/keyring 2024-09-16T05:42:35.383 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2024-09-16T05:42:35.384 INFO:tasks.workunit.client.0.smithi026.stdout:adding osd5 key to auth repository 2024-09-16T05:42:35.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2024-09-16T05:42:35.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-backfill-stats/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2024-09-16T05:42:35.970 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2024-09-16T05:42:35.971 INFO:tasks.workunit.client.0.smithi026.stdout:start osd.5 2024-09-16T05:42:35.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=737f84c8-adbf-45d1-b31e-65da058910be --auth-supported=none --mon-host=127.0.0.1:7114 --osd_min_pg_log_entries=5 --osd_max_pg_log_entries=10 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-backfill-stats/5 --osd-journal=td/osd-backfill-stats/5/journal --chdir= --run-dir=td/osd-backfill-stats '--admin-socket=/tmp/ceph-asok.478321/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-backfill-stats/$name.log' '--pid-file=td/osd-backfill-stats/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2024-09-16T05:42:35.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2024-09-16T05:42:35.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2024-09-16T05:42:35.971 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2024-09-16T05:42:36.000 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:35.999+0000 7f30eb3c1640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:42:36.002 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:36.002+0000 7f30eb3c1640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:42:36.003 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:36.003+0000 7f30eb3c1640 -1 WARNING: all dangerous and experimental features are enabled. 2024-09-16T05:42:36.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2024-09-16T05:42:36.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2024-09-16T05:42:36.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2024-09-16T05:42:36.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2024-09-16T05:42:36.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2024-09-16T05:42:36.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:36.406 INFO:tasks.workunit.client.0.smithi026.stdout:0 2024-09-16T05:42:36.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2024-09-16T05:42:36.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:36.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:36.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:37.590 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:37.589+0000 7f30eb3c1640 -1 Falling back to public interface 2024-09-16T05:42:37.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:37.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:37.850 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2024-09-16T05:42:37.850 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-09-16T05:42:37.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:37.851 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:38.301 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:39.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:39.302 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:39.302 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-09-16T05:42:39.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2024-09-16T05:42:39.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:39.303 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:39.751 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:40.513 INFO:tasks.workunit.client.0.smithi026.stderr:2024-09-16T05:42:40.513+0000 7f30eb3c1640 -1 osd.5 0 log_to_monitors true 2024-09-16T05:42:40.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:40.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:40.753 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2024-09-16T05:42:40.753 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-09-16T05:42:40.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:40.754 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:41.167 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:42.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:42.169 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:42.169 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-09-16T05:42:42.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2024-09-16T05:42:42.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:42.170 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:42.593 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:43.601 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:43.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:43.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2024-09-16T05:42:43.602 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-09-16T05:42:43.602 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:43.603 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:44.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:45.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:45.137 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:45.137 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-09-16T05:42:45.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2024-09-16T05:42:45.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:45.138 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:45.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:46.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:46.651 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:46.651 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-09-16T05:42:46.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2024-09-16T05:42:46.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:46.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:47.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:48.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:48.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:48.074 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2024-09-16T05:42:48.074 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-09-16T05:42:48.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:48.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:48.504 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:49.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:49.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:49.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2024-09-16T05:42:49.506 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-09-16T05:42:49.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:49.506 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:50.046 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:51.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:51.048 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:51.048 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-09-16T05:42:51.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 10 2024-09-16T05:42:51.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:51.049 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:51.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:52.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:52.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:52.465 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-09-16T05:42:52.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 11 2024-09-16T05:42:52.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:52.466 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:52.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:53.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:53.936 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:53.937 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-09-16T05:42:53.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 12 2024-09-16T05:42:53.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:53.937 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:54.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:55.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:55.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:55.706 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 13 2024-09-16T05:42:55.706 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-09-16T05:42:55.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:55.707 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:56.544 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:57.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:57.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:57.546 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-09-16T05:42:57.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 14 2024-09-16T05:42:57.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:57.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:42:58.446 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:42:59.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:42:59.448 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:42:59.449 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-09-16T05:42:59.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 15 2024-09-16T05:42:59.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:42:59.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:43:00.158 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:43:01.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:43:01.162 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:43:01.162 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-09-16T05:43:01.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 16 2024-09-16T05:43:01.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:43:01.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:43:02.134 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2024-09-16T05:43:03.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2024-09-16T05:43:03.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2024-09-16T05:43:03.135 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 17 2024-09-16T05:43:03.136 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-09-16T05:43:03.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2024-09-16T05:43:03.136 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2024-09-16T05:43:03.618 INFO:tasks.workunit.client.0.smithi026.stdout:osd.5 up in weight 1 up_from 30 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3207559339,v1:127.0.0.1:6843/3207559339] [v2:127.0.0.1:6844/3207559339,v1:127.0.0.1:6845/3207559339] exists,up d62d5fc1-ae69-4df9-821d-0008f1fac3d3 2024-09-16T05:43:03.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2024-09-16T05:43:03.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2024-09-16T05:43:03.619 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2024-09-16T05:43:03.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:193: TEST_backfill_sizeup_out: create_pool test 1 1 2024-09-16T05:43:03.620 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2024-09-16T05:43:04.516 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' already exists 2024-09-16T05:43:04.528 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2024-09-16T05:43:05.529 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:194: TEST_backfill_sizeup_out: ceph osd pool set test size 1 --yes-i-really-mean-it 2024-09-16T05:43:06.166 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 1 2024-09-16T05:43:06.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:196: TEST_backfill_sizeup_out: wait_for_clean 2024-09-16T05:43:06.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:43:06.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:43:06.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:43:06.179 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:43:06.180 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:43:06.180 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:43:06.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:43:06.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:43:06.180 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:43:06.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:43:06.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:43:06.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:43:06.271 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:43:06.272 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:43:06.272 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:43:06.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:43:06.899 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:43:06.899 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:43:06.899 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:43:06.899 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T05:43:06.899 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T05:43:06.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:43:06.899 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:43:06.900 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:43:07.108 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836526 2024-09-16T05:43:07.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836526 2024-09-16T05:43:07.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526' 2024-09-16T05:43:07.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:43:07.109 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:43:07.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949672994 2024-09-16T05:43:07.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949672994 2024-09-16T05:43:07.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672994' 2024-09-16T05:43:07.228 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:43:07.228 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:43:07.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509464 2024-09-16T05:43:07.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509464 2024-09-16T05:43:07.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672994 2-64424509464' 2024-09-16T05:43:07.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:43:07.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:43:07.463 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345939 2024-09-16T05:43:07.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345939 2024-09-16T05:43:07.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672994 2-64424509464 3-85899345939' 2024-09-16T05:43:07.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:43:07.464 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:43:07.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182414 2024-09-16T05:43:07.581 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182414 2024-09-16T05:43:07.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672994 2-64424509464 3-85899345939 4-107374182414' 2024-09-16T05:43:07.582 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:43:07.582 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T05:43:07.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018888 2024-09-16T05:43:07.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018888 2024-09-16T05:43:07.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836526 1-42949672994 2-64424509464 3-85899345939 4-107374182414 5-128849018888' 2024-09-16T05:43:07.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:43:07.700 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836526 2024-09-16T05:43:07.700 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:43:07.700 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:43:07.701 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836526 2024-09-16T05:43:07.701 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:43:07.702 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836526 2024-09-16T05:43:07.702 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836526 2024-09-16T05:43:07.703 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836526' 2024-09-16T05:43:07.703 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:43:08.155 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836524 -lt 21474836526 2024-09-16T05:43:08.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: flush_pg_stats: sleep 1 2024-09-16T05:43:09.156 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2224: flush_pg_stats: '[' 300 -eq 0 ']' 2024-09-16T05:43:09.157 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:43:09.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836526 -lt 21474836526 2024-09-16T05:43:09.649 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:43:09.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949672994 2024-09-16T05:43:09.650 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:43:09.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:43:09.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949672994 2024-09-16T05:43:09.651 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:43:09.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949672994 2024-09-16T05:43:09.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949672994' 2024-09-16T05:43:09.652 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949672994 2024-09-16T05:43:09.652 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:43:10.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949672994 -lt 42949672994 2024-09-16T05:43:10.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:43:10.063 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509464 2024-09-16T05:43:10.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:43:10.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:43:10.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509464 2024-09-16T05:43:10.065 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:43:10.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509464 2024-09-16T05:43:10.066 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509464 2024-09-16T05:43:10.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509464' 2024-09-16T05:43:10.067 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:43:10.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509464 -lt 64424509464 2024-09-16T05:43:10.502 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:43:10.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345939 2024-09-16T05:43:10.502 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:43:10.503 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:43:10.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345939 2024-09-16T05:43:10.504 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:43:10.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345939 2024-09-16T05:43:10.505 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345939 2024-09-16T05:43:10.505 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345939' 2024-09-16T05:43:10.505 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:43:10.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345940 -lt 85899345939 2024-09-16T05:43:10.912 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:43:10.912 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182414 2024-09-16T05:43:10.912 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:43:10.913 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:43:10.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182414 2024-09-16T05:43:10.914 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:43:10.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182414 2024-09-16T05:43:10.915 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182414' 2024-09-16T05:43:10.915 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182414 2024-09-16T05:43:10.916 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:43:11.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182415 -lt 107374182414 2024-09-16T05:43:11.346 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:43:11.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018888 2024-09-16T05:43:11.346 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:43:11.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T05:43:11.348 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018888 2024-09-16T05:43:11.348 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:43:11.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018888 2024-09-16T05:43:11.349 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018888' 2024-09-16T05:43:11.349 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018888 2024-09-16T05:43:11.349 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T05:43:11.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018889 -lt 128849018888 2024-09-16T05:43:11.798 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:43:11.799 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:11.799 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:12.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:43:12.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:12.345 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:12.345 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:12.345 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:12.345 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:12.345 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:12.345 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:12.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:43:12.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:12.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:12.821 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:13.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:43:13.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:43:13.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:43:13.368 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: seq 1 200 2024-09-16T05:43:13.368 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:13.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj1 /dev/null 2024-09-16T05:43:13.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:13.464 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj2 /dev/null 2024-09-16T05:43:13.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:13.531 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj3 /dev/null 2024-09-16T05:43:13.590 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:13.591 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj4 /dev/null 2024-09-16T05:43:13.673 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:13.674 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj5 /dev/null 2024-09-16T05:43:13.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:13.782 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj6 /dev/null 2024-09-16T05:43:13.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:13.866 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj7 /dev/null 2024-09-16T05:43:13.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:13.933 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj8 /dev/null 2024-09-16T05:43:13.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:13.992 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj9 /dev/null 2024-09-16T05:43:14.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj10 /dev/null 2024-09-16T05:43:14.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.125 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj11 /dev/null 2024-09-16T05:43:14.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.184 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj12 /dev/null 2024-09-16T05:43:14.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.242 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj13 /dev/null 2024-09-16T05:43:14.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.319 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj14 /dev/null 2024-09-16T05:43:14.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj15 /dev/null 2024-09-16T05:43:14.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.451 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj16 /dev/null 2024-09-16T05:43:14.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.518 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj17 /dev/null 2024-09-16T05:43:14.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.585 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj18 /dev/null 2024-09-16T05:43:14.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.677 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj19 /dev/null 2024-09-16T05:43:14.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.744 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj20 /dev/null 2024-09-16T05:43:14.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj21 /dev/null 2024-09-16T05:43:14.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.886 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj22 /dev/null 2024-09-16T05:43:14.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:14.953 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj23 /dev/null 2024-09-16T05:43:15.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.037 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj24 /dev/null 2024-09-16T05:43:15.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.120 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj25 /dev/null 2024-09-16T05:43:15.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj26 /dev/null 2024-09-16T05:43:15.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.237 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj27 /dev/null 2024-09-16T05:43:15.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj28 /dev/null 2024-09-16T05:43:15.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.371 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj29 /dev/null 2024-09-16T05:43:15.429 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.430 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj30 /dev/null 2024-09-16T05:43:15.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj31 /dev/null 2024-09-16T05:43:15.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.547 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj32 /dev/null 2024-09-16T05:43:15.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj33 /dev/null 2024-09-16T05:43:15.680 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.681 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj34 /dev/null 2024-09-16T05:43:15.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj35 /dev/null 2024-09-16T05:43:15.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj36 /dev/null 2024-09-16T05:43:15.931 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:15.932 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj37 /dev/null 2024-09-16T05:43:16.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj38 /dev/null 2024-09-16T05:43:16.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.090 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj39 /dev/null 2024-09-16T05:43:16.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.149 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj40 /dev/null 2024-09-16T05:43:16.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj41 /dev/null 2024-09-16T05:43:16.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj42 /dev/null 2024-09-16T05:43:16.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.350 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj43 /dev/null 2024-09-16T05:43:16.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.408 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj44 /dev/null 2024-09-16T05:43:16.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.475 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj45 /dev/null 2024-09-16T05:43:16.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj46 /dev/null 2024-09-16T05:43:16.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.609 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj47 /dev/null 2024-09-16T05:43:16.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.676 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj48 /dev/null 2024-09-16T05:43:16.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.743 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj49 /dev/null 2024-09-16T05:43:16.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.835 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj50 /dev/null 2024-09-16T05:43:16.918 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:16.920 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj51 /dev/null 2024-09-16T05:43:17.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj52 /dev/null 2024-09-16T05:43:17.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj53 /dev/null 2024-09-16T05:43:17.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj54 /dev/null 2024-09-16T05:43:17.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.261 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj55 /dev/null 2024-09-16T05:43:17.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj56 /dev/null 2024-09-16T05:43:17.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.412 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj57 /dev/null 2024-09-16T05:43:17.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.479 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj58 /dev/null 2024-09-16T05:43:17.545 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.546 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj59 /dev/null 2024-09-16T05:43:17.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.613 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj60 /dev/null 2024-09-16T05:43:17.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj61 /dev/null 2024-09-16T05:43:17.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.796 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj62 /dev/null 2024-09-16T05:43:17.863 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.864 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj63 /dev/null 2024-09-16T05:43:17.922 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.923 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj64 /dev/null 2024-09-16T05:43:17.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:17.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj65 /dev/null 2024-09-16T05:43:18.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.064 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj66 /dev/null 2024-09-16T05:43:18.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj67 /dev/null 2024-09-16T05:43:18.189 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.190 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj68 /dev/null 2024-09-16T05:43:18.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.248 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj69 /dev/null 2024-09-16T05:43:18.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj70 /dev/null 2024-09-16T05:43:18.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj71 /dev/null 2024-09-16T05:43:18.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj72 /dev/null 2024-09-16T05:43:18.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.507 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj73 /dev/null 2024-09-16T05:43:18.565 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj74 /dev/null 2024-09-16T05:43:18.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.641 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj75 /dev/null 2024-09-16T05:43:18.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.699 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj76 /dev/null 2024-09-16T05:43:18.758 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.759 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj77 /dev/null 2024-09-16T05:43:18.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.817 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj78 /dev/null 2024-09-16T05:43:18.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.892 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj79 /dev/null 2024-09-16T05:43:18.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:18.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj80 /dev/null 2024-09-16T05:43:19.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj81 /dev/null 2024-09-16T05:43:19.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.109 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj82 /dev/null 2024-09-16T05:43:19.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.176 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj83 /dev/null 2024-09-16T05:43:19.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.245 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj84 /dev/null 2024-09-16T05:43:19.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.329 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj85 /dev/null 2024-09-16T05:43:19.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj86 /dev/null 2024-09-16T05:43:19.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.454 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj87 /dev/null 2024-09-16T05:43:19.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj88 /dev/null 2024-09-16T05:43:19.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.588 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj89 /dev/null 2024-09-16T05:43:19.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.646 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj90 /dev/null 2024-09-16T05:43:19.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.705 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj91 /dev/null 2024-09-16T05:43:19.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.797 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj92 /dev/null 2024-09-16T05:43:19.872 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.873 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj93 /dev/null 2024-09-16T05:43:19.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:19.956 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj94 /dev/null 2024-09-16T05:43:20.014 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.015 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj95 /dev/null 2024-09-16T05:43:20.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.073 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj96 /dev/null 2024-09-16T05:43:20.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.132 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj97 /dev/null 2024-09-16T05:43:20.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.191 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj98 /dev/null 2024-09-16T05:43:20.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.266 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj99 /dev/null 2024-09-16T05:43:20.332 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj100 /dev/null 2024-09-16T05:43:20.392 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.393 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj101 /dev/null 2024-09-16T05:43:20.449 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.450 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj102 /dev/null 2024-09-16T05:43:20.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.508 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj103 /dev/null 2024-09-16T05:43:20.583 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj104 /dev/null 2024-09-16T05:43:20.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.650 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj105 /dev/null 2024-09-16T05:43:20.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.717 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj106 /dev/null 2024-09-16T05:43:20.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.784 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj107 /dev/null 2024-09-16T05:43:20.909 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.910 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj108 /dev/null 2024-09-16T05:43:20.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:20.976 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj109 /dev/null 2024-09-16T05:43:21.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.043 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj110 /dev/null 2024-09-16T05:43:21.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.110 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj111 /dev/null 2024-09-16T05:43:21.193 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.194 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj112 /dev/null 2024-09-16T05:43:21.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.277 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj113 /dev/null 2024-09-16T05:43:21.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj114 /dev/null 2024-09-16T05:43:21.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.411 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj115 /dev/null 2024-09-16T05:43:21.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.478 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj116 /dev/null 2024-09-16T05:43:21.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.570 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj117 /dev/null 2024-09-16T05:43:21.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.637 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj118 /dev/null 2024-09-16T05:43:21.739 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.740 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj119 /dev/null 2024-09-16T05:43:21.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.813 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj120 /dev/null 2024-09-16T05:43:21.879 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.880 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj121 /dev/null 2024-09-16T05:43:21.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:21.955 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj122 /dev/null 2024-09-16T05:43:22.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.016 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj123 /dev/null 2024-09-16T05:43:22.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.072 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj124 /dev/null 2024-09-16T05:43:22.130 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj125 /dev/null 2024-09-16T05:43:22.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.231 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj126 /dev/null 2024-09-16T05:43:22.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.289 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj127 /dev/null 2024-09-16T05:43:22.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.348 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj128 /dev/null 2024-09-16T05:43:22.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.407 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj129 /dev/null 2024-09-16T05:43:22.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.465 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj130 /dev/null 2024-09-16T05:43:22.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.540 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj131 /dev/null 2024-09-16T05:43:22.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.599 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj132 /dev/null 2024-09-16T05:43:22.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.658 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj133 /dev/null 2024-09-16T05:43:22.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.716 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj134 /dev/null 2024-09-16T05:43:22.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj135 /dev/null 2024-09-16T05:43:22.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.875 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj136 /dev/null 2024-09-16T05:43:22.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:22.942 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj137 /dev/null 2024-09-16T05:43:23.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.009 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj138 /dev/null 2024-09-16T05:43:23.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj139 /dev/null 2024-09-16T05:43:23.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.159 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj140 /dev/null 2024-09-16T05:43:23.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.226 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj141 /dev/null 2024-09-16T05:43:23.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.293 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj142 /dev/null 2024-09-16T05:43:23.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj143 /dev/null 2024-09-16T05:43:23.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.427 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj144 /dev/null 2024-09-16T05:43:23.510 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.511 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj145 /dev/null 2024-09-16T05:43:23.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.577 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj146 /dev/null 2024-09-16T05:43:23.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.644 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj147 /dev/null 2024-09-16T05:43:23.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.711 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj148 /dev/null 2024-09-16T05:43:23.811 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.812 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj149 /dev/null 2024-09-16T05:43:23.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.895 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj150 /dev/null 2024-09-16T05:43:23.962 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:23.963 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj151 /dev/null 2024-09-16T05:43:24.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.029 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj152 /dev/null 2024-09-16T05:43:24.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.096 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj153 /dev/null 2024-09-16T05:43:24.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.163 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj154 /dev/null 2024-09-16T05:43:24.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.238 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj155 /dev/null 2024-09-16T05:43:24.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj156 /dev/null 2024-09-16T05:43:24.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj157 /dev/null 2024-09-16T05:43:24.413 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.414 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj158 /dev/null 2024-09-16T05:43:24.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.489 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj159 /dev/null 2024-09-16T05:43:24.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.548 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj160 /dev/null 2024-09-16T05:43:24.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.606 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj161 /dev/null 2024-09-16T05:43:24.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj162 /dev/null 2024-09-16T05:43:24.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.723 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj163 /dev/null 2024-09-16T05:43:24.798 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.799 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj164 /dev/null 2024-09-16T05:43:24.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.891 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj165 /dev/null 2024-09-16T05:43:24.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:24.949 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj166 /dev/null 2024-09-16T05:43:25.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.007 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj167 /dev/null 2024-09-16T05:43:25.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.066 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj168 /dev/null 2024-09-16T05:43:25.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.141 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj169 /dev/null 2024-09-16T05:43:25.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.208 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj170 /dev/null 2024-09-16T05:43:25.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj171 /dev/null 2024-09-16T05:43:25.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj172 /dev/null 2024-09-16T05:43:25.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.426 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj173 /dev/null 2024-09-16T05:43:25.492 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.493 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj174 /dev/null 2024-09-16T05:43:25.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.559 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj175 /dev/null 2024-09-16T05:43:25.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.626 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj176 /dev/null 2024-09-16T05:43:25.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.693 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj177 /dev/null 2024-09-16T05:43:25.827 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.828 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj178 /dev/null 2024-09-16T05:43:25.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.894 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj179 /dev/null 2024-09-16T05:43:25.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:25.961 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj180 /dev/null 2024-09-16T05:43:26.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.028 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj181 /dev/null 2024-09-16T05:43:26.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.103 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj182 /dev/null 2024-09-16T05:43:26.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.187 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj183 /dev/null 2024-09-16T05:43:26.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.254 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj184 /dev/null 2024-09-16T05:43:26.337 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.338 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj185 /dev/null 2024-09-16T05:43:26.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.404 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj186 /dev/null 2024-09-16T05:43:26.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.488 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj187 /dev/null 2024-09-16T05:43:26.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj188 /dev/null 2024-09-16T05:43:26.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.622 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj189 /dev/null 2024-09-16T05:43:26.688 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.689 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj190 /dev/null 2024-09-16T05:43:26.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.748 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj191 /dev/null 2024-09-16T05:43:26.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj192 /dev/null 2024-09-16T05:43:26.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.906 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj193 /dev/null 2024-09-16T05:43:26.964 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:26.965 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj194 /dev/null 2024-09-16T05:43:27.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:27.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj195 /dev/null 2024-09-16T05:43:27.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:27.081 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj196 /dev/null 2024-09-16T05:43:27.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:27.157 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj197 /dev/null 2024-09-16T05:43:27.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:27.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj198 /dev/null 2024-09-16T05:43:27.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:27.274 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj199 /dev/null 2024-09-16T05:43:27.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:198: TEST_backfill_sizeup_out: for i in $(seq 1 $objects) 2024-09-16T05:43:27.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:200: TEST_backfill_sizeup_out: rados -p test put obj200 /dev/null 2024-09-16T05:43:27.433 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:203: TEST_backfill_sizeup_out: get_pg test obj1 2024-09-16T05:43:27.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2024-09-16T05:43:27.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2024-09-16T05:43:27.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test obj1 2024-09-16T05:43:27.434 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2024-09-16T05:43:27.874 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:203: TEST_backfill_sizeup_out: local PG=1.0 2024-09-16T05:43:27.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:205: TEST_backfill_sizeup_out: get_primary test obj1 2024-09-16T05:43:27.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2024-09-16T05:43:27.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2024-09-16T05:43:27.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2024-09-16T05:43:27.875 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2024-09-16T05:43:28.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:205: TEST_backfill_sizeup_out: local primary=1 2024-09-16T05:43:28.321 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:207: TEST_backfill_sizeup_out: ceph osd set nobackfill 2024-09-16T05:43:28.943 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is set 2024-09-16T05:43:28.954 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:208: TEST_backfill_sizeup_out: ceph osd out osd.1 2024-09-16T05:43:29.547 INFO:tasks.workunit.client.0.smithi026.stderr:osd.1 is already out. 2024-09-16T05:43:29.558 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:209: TEST_backfill_sizeup_out: ceph osd pool set test size 3 2024-09-16T05:43:30.484 INFO:tasks.workunit.client.0.smithi026.stderr:set pool 1 size to 3 2024-09-16T05:43:30.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:210: TEST_backfill_sizeup_out: sleep 2 2024-09-16T05:43:32.497 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:211: TEST_backfill_sizeup_out: ceph osd unset nobackfill 2024-09-16T05:43:33.204 INFO:tasks.workunit.client.0.smithi026.stderr:nobackfill is unset 2024-09-16T05:43:33.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:213: TEST_backfill_sizeup_out: wait_for_clean 2024-09-16T05:43:33.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1633: wait_for_clean: local cmd= 2024-09-16T05:43:33.215 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1634: wait_for_clean: local num_active_clean=-1 2024-09-16T05:43:33.216 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1635: wait_for_clean: local cur_active_clean 2024-09-16T05:43:33.216 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: get_timeout_delays 90 .1 2024-09-16T05:43:33.216 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: shopt -q -o xtrace 2024-09-16T05:43:33.216 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: echo true 2024-09-16T05:43:33.217 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1579: get_timeout_delays: local trace=true 2024-09-16T05:43:33.217 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: true 2024-09-16T05:43:33.217 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: get_timeout_delays: shopt -u -o xtrace 2024-09-16T05:43:33.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2024-09-16T05:43:33.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1636: wait_for_clean: local -a delays 2024-09-16T05:43:33.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1637: wait_for_clean: local -i loop=0 2024-09-16T05:43:33.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1639: wait_for_clean: flush_pg_stats 2024-09-16T05:43:33.308 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2205: flush_pg_stats: local timeout=300 2024-09-16T05:43:33.308 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ceph osd ls 2024-09-16T05:43:33.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2207: flush_pg_stats: ids='0 2024-09-16T05:43:33.821 INFO:tasks.workunit.client.0.smithi026.stderr:1 2024-09-16T05:43:33.821 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-09-16T05:43:33.821 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-09-16T05:43:33.821 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-09-16T05:43:33.821 INFO:tasks.workunit.client.0.smithi026.stderr:5' 2024-09-16T05:43:33.821 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2208: flush_pg_stats: seqs= 2024-09-16T05:43:33.822 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:43:33.822 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2024-09-16T05:43:33.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=21474836533 2024-09-16T05:43:33.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 21474836533 2024-09-16T05:43:33.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836533' 2024-09-16T05:43:33.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:43:33.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2024-09-16T05:43:34.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=42949673001 2024-09-16T05:43:34.079 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 42949673001 2024-09-16T05:43:34.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836533 1-42949673001' 2024-09-16T05:43:34.080 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:43:34.080 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2024-09-16T05:43:34.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=64424509471 2024-09-16T05:43:34.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 64424509471 2024-09-16T05:43:34.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836533 1-42949673001 2-64424509471' 2024-09-16T05:43:34.198 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:43:34.198 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2024-09-16T05:43:34.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=85899345946 2024-09-16T05:43:34.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 85899345946 2024-09-16T05:43:34.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836533 1-42949673001 2-64424509471 3-85899345946' 2024-09-16T05:43:34.317 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:43:34.317 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.4 flush_pg_stats 2024-09-16T05:43:34.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=107374182422 2024-09-16T05:43:34.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 107374182422 2024-09-16T05:43:34.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836533 1-42949673001 2-64424509471 3-85899345946 4-107374182422' 2024-09-16T05:43:34.435 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2209: flush_pg_stats: for osd in $ids 2024-09-16T05:43:34.435 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: ceph tell osd.5 flush_pg_stats 2024-09-16T05:43:34.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2210: flush_pg_stats: seq=128849018896 2024-09-16T05:43:34.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2211: flush_pg_stats: test -z 128849018896 2024-09-16T05:43:34.553 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2215: flush_pg_stats: seqs=' 0-21474836533 1-42949673001 2-64424509471 3-85899345946 4-107374182422 5-128849018896' 2024-09-16T05:43:34.554 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:43:34.554 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 0-21474836533 2024-09-16T05:43:34.554 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:43:34.555 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=0 2024-09-16T05:43:34.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 0-21474836533 2024-09-16T05:43:34.555 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:43:34.556 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=21474836533 2024-09-16T05:43:34.556 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.0 seq 21474836533 2024-09-16T05:43:34.557 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.0 seq 21474836533' 2024-09-16T05:43:34.557 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 0 2024-09-16T05:43:34.996 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 21474836533 -lt 21474836533 2024-09-16T05:43:34.997 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:43:34.997 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 1-42949673001 2024-09-16T05:43:34.997 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:43:34.998 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=1 2024-09-16T05:43:34.998 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 1-42949673001 2024-09-16T05:43:34.998 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:43:34.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=42949673001 2024-09-16T05:43:34.999 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.1 seq 42949673001' 2024-09-16T05:43:35.000 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.1 seq 42949673001 2024-09-16T05:43:35.000 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 1 2024-09-16T05:43:35.513 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 42949673001 -lt 42949673001 2024-09-16T05:43:35.514 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:43:35.514 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 2-64424509471 2024-09-16T05:43:35.514 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:43:35.515 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=2 2024-09-16T05:43:35.515 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 2-64424509471 2024-09-16T05:43:35.515 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:43:35.516 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=64424509471 2024-09-16T05:43:35.517 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.2 seq 64424509471' 2024-09-16T05:43:35.517 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.2 seq 64424509471 2024-09-16T05:43:35.517 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 2 2024-09-16T05:43:36.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 64424509471 -lt 64424509471 2024-09-16T05:43:36.075 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:43:36.075 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 3-85899345946 2024-09-16T05:43:36.075 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:43:36.076 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=3 2024-09-16T05:43:36.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 3-85899345946 2024-09-16T05:43:36.076 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:43:36.077 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=85899345946 2024-09-16T05:43:36.077 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.3 seq 85899345946 2024-09-16T05:43:36.078 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.3 seq 85899345946' 2024-09-16T05:43:36.078 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 3 2024-09-16T05:43:36.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 85899345946 -lt 85899345946 2024-09-16T05:43:36.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:43:36.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 4-107374182422 2024-09-16T05:43:36.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:43:36.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=4 2024-09-16T05:43:36.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 4-107374182422 2024-09-16T05:43:36.631 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:43:36.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=107374182422 2024-09-16T05:43:36.633 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.4 seq 107374182422' 2024-09-16T05:43:36.633 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.4 seq 107374182422 2024-09-16T05:43:36.634 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 4 2024-09-16T05:43:37.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 107374182422 -lt 107374182422 2024-09-16T05:43:37.322 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2218: flush_pg_stats: for s in $seqs 2024-09-16T05:43:37.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: echo 5-128849018896 2024-09-16T05:43:37.322 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: cut -d - -f 1 2024-09-16T05:43:37.323 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: flush_pg_stats: osd=5 2024-09-16T05:43:37.324 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: echo 5-128849018896 2024-09-16T05:43:37.324 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: cut -d - -f 2 2024-09-16T05:43:37.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2220: flush_pg_stats: seq=128849018896 2024-09-16T05:43:37.325 INFO:tasks.workunit.client.0.smithi026.stdout:waiting osd.5 seq 128849018896 2024-09-16T05:43:37.325 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: flush_pg_stats: echo 'waiting osd.5 seq 128849018896' 2024-09-16T05:43:37.325 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: ceph osd last-stat-seq 5 2024-09-16T05:43:37.888 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: flush_pg_stats: test 128849018896 -lt 128849018896 2024-09-16T05:43:37.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: get_num_pgs 2024-09-16T05:43:37.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:37.889 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:38.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1640: wait_for_clean: test 1 == 0 2024-09-16T05:43:38.537 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:38.537 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:38.538 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:38.538 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:38.538 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:38.538 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:38.538 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:38.934 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:43:38.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:38.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:38.934 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:39.561 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:43:39.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' -1 2024-09-16T05:43:39.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: loop=0 2024-09-16T05:43:39.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1652: wait_for_clean: num_active_clean=0 2024-09-16T05:43:39.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:43:39.562 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:43:39.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:43:39.665 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:39.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:39.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:39.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:39.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:39.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:39.665 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:40.129 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:43:40.129 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:40.130 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:40.130 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:40.775 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:43:40.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:43:40.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:43:40.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:43:40.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:43:40.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:43:40.776 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:43:40.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:43:40.776 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:43:41.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:43:41.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:43:41.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:43:41.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:43:41.425 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:43:41.526 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:43:41.527 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:41.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:41.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:41.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:41.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:41.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:41.527 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:42.023 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:43:42.023 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:42.024 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:42.024 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:42.760 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:43:42.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:43:42.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:43:42.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:43:42.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:43:42.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:43:42.761 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:43:42.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:43:42.761 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:43:43.630 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=4 2024-09-16T05:43:43.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 4 '!=' null 2024-09-16T05:43:43.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:43:43.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:43:43.631 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:43:43.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:43:43.731 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:43.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:43.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:43.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:43.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:43.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:43.732 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:44.202 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:43:44.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:44.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:44.203 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:44.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:43:44.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:43:44.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:43:44.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:43:44.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:43:44.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:43:44.848 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:43:44.849 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:43:44.849 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:43:45.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=3 2024-09-16T05:43:45.467 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 3 '!=' null 2024-09-16T05:43:45.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:43:45.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:43:45.468 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:43:45.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:43:45.569 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:45.569 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:45.569 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:45.569 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:45.569 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:45.569 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:45.570 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:46.002 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:43:46.003 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:46.003 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:46.003 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:46.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:43:46.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:43:46.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:43:46.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:43:46.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:43:46.652 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:43:46.653 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:43:46.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:43:46.653 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:43:47.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:43:47.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:43:47.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:43:47.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:43:47.275 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:43:47.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:43:47.377 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:47.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:47.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:47.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:47.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:47.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:47.377 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:47.831 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:43:47.831 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:47.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:47.832 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:48.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:43:48.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:43:48.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:43:48.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:43:48.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:43:48.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:43:48.395 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:43:48.395 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:43:48.396 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:43:49.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:43:49.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:43:49.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:43:49.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:43:49.260 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:43:49.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:43:49.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:49.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:49.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:49.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:49.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:49.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:49.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:49.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:43:49.834 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:49.835 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:49.835 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:50.494 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:43:50.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:43:50.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:43:50.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:43:50.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:43:50.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:43:50.495 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:43:50.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:43:50.495 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:43:51.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=8 2024-09-16T05:43:51.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 8 '!=' null 2024-09-16T05:43:51.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:43:51.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:43:51.186 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:43:51.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:43:51.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:51.287 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:51.287 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:51.288 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:51.288 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:51.288 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:51.288 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:51.687 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:43:51.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:51.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:51.688 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:52.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:43:52.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:43:52.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:43:52.333 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:43:52.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:43:52.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:43:52.334 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:43:52.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:43:52.334 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:43:52.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=8 2024-09-16T05:43:52.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 8 '!=' null 2024-09-16T05:43:52.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:43:52.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:43:52.969 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:43:53.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:43:53.070 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:53.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:53.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:53.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:53.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:53.070 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:53.071 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:53.534 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:43:53.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:53.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:53.535 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:54.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:43:54.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:43:54.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:43:54.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:43:54.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:43:54.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:43:54.174 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:43:54.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:43:54.175 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:43:54.833 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:43:54.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:43:54.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:43:54.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:43:54.834 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:43:54.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:43:54.935 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:54.935 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:54.935 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:54.935 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:54.935 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:54.935 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:54.935 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:55.477 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:43:55.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:55.477 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:55.478 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:56.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:43:56.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:43:56.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:43:56.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:43:56.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:43:56.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:43:56.063 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:43:56.063 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:43:56.064 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:43:56.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:43:56.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:43:56.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:43:56.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:43:56.672 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:43:56.772 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:43:56.773 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:56.773 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:56.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:56.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:56.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:56.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:56.774 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:57.201 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:43:57.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:57.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:57.202 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:57.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:43:57.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:43:57.807 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:43:57.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:43:57.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:43:57.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:43:57.808 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:43:57.808 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:43:57.808 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:43:58.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=8 2024-09-16T05:43:58.483 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 8 '!=' null 2024-09-16T05:43:58.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:43:58.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:43:58.484 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:43:58.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:43:58.584 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:43:58.585 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:43:58.585 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:43:58.585 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:43:58.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:43:58.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:43:58.586 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:43:58.986 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:43:58.986 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:43:58.986 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:43:58.986 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:43:59.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:43:59.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:43:59.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:43:59.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:43:59.659 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:43:59.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:43:59.660 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:43:59.660 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:43:59.660 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:44:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:44:00.287 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:44:00.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:44:00.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:44:00.288 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:44:00.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:44:00.389 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:44:00.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:44:00.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:44:00.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:44:00.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:44:00.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:44:00.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:44:00.800 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:44:00.800 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:44:00.800 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:44:00.801 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:44:01.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:44:01.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:44:01.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:44:01.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:44:01.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:44:01.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:44:01.457 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:44:01.457 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:44:01.457 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:44:02.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=8 2024-09-16T05:44:02.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 8 '!=' null 2024-09-16T05:44:02.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:44:02.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:44:02.031 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:44:02.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:44:02.131 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:44:02.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:44:02.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:44:02.132 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:44:02.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:44:02.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:44:02.133 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:44:02.589 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:44:02.589 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:44:02.589 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:44:02.590 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:44:03.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:44:03.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:44:03.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:44:03.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:44:03.178 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:44:03.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:44:03.179 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:44:03.179 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:44:03.179 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:44:03.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=5 2024-09-16T05:44:03.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 5 '!=' null 2024-09-16T05:44:03.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:44:03.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:44:03.840 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:44:03.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:44:03.941 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:44:03.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:44:03.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:44:03.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:44:03.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:44:03.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:44:03.941 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:44:04.388 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:44:04.388 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:44:04.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:44:04.389 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:44:04.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:44:04.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:44:04.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:44:04.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:44:04.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:44:04.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:44:04.981 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:44:04.981 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:44:04.981 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:44:05.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=6 2024-09-16T05:44:05.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 6 '!=' null 2024-09-16T05:44:05.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:44:05.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:44:05.566 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:44:05.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:44:05.668 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:44:05.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:44:05.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:44:05.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:44:05.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:44:05.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:44:05.668 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:44:06.071 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=0 2024-09-16T05:44:06.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:44:06.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:44:06.072 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:44:06.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 0 = 1 2024-09-16T05:44:06.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: test 0 '!=' 0 2024-09-16T05:44:06.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: get_is_making_recovery_progress 2024-09-16T05:44:06.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2024-09-16T05:44:06.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2024-09-16T05:44:06.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2024-09-16T05:44:06.648 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2024-09-16T05:44:06.648 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2024-09-16T05:44:06.649 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2024-09-16T05:44:07.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=7 2024-09-16T05:44:07.250 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test 7 '!=' null 2024-09-16T05:44:07.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: loop=0 2024-09-16T05:44:07.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: eval 2024-09-16T05:44:07.251 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1661: wait_for_clean: sleep 0.1 2024-09-16T05:44:07.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: loop+=1 2024-09-16T05:44:07.352 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1644: wait_for_clean: true 2024-09-16T05:44:07.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: get_num_active_clean 2024-09-16T05:44:07.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2024-09-16T05:44:07.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2024-09-16T05:44:07.352 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2024-09-16T05:44:07.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2024-09-16T05:44:07.353 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2024-09-16T05:44:07.747 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: cur_active_clean=1 2024-09-16T05:44:07.747 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: get_num_pgs 2024-09-16T05:44:07.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2024-09-16T05:44:07.748 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2024-09-16T05:44:08.341 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: test 1 = 1 2024-09-16T05:44:08.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: break 2024-09-16T05:44:08.342 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: return 0 2024-09-16T05:44:08.342 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:215: TEST_backfill_sizeup_out: expr 200 '*' 2 2024-09-16T05:44:08.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:215: TEST_backfill_sizeup_out: local degraded=400 2024-09-16T05:44:08.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:216: TEST_backfill_sizeup_out: check td/osd-backfill-stats 1.0 1 replicated 400 0 200 0 2024-09-16T05:44:08.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:63: check: local dir=td/osd-backfill-stats 2024-09-16T05:44:08.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:64: check: local PG=1.0 2024-09-16T05:44:08.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:65: check: local primary=1 2024-09-16T05:44:08.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:66: check: local type=replicated 2024-09-16T05:44:08.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:67: check: local degraded_start=400 2024-09-16T05:44:08.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:68: check: local degraded_end=0 2024-09-16T05:44:08.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:69: check: local misplaced_start=200 2024-09-16T05:44:08.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:70: check: local misplaced_end=0 2024-09-16T05:44:08.344 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:71: check: local primary_start= 2024-09-16T05:44:08.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:72: check: local primary_end= 2024-09-16T05:44:08.345 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:73: check: local check_setup=true 2024-09-16T05:44:08.345 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: grep -l +backfilling td/osd-backfill-stats/osd.1.log 2024-09-16T05:44:08.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:75: check: local log=td/osd-backfill-stats/osd.1.log 2024-09-16T05:44:08.347 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:76: check: '[' true = true ']' 2024-09-16T05:44:08.348 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: grep -l +backfilling td/osd-backfill-stats/osd.0.log td/osd-backfill-stats/osd.1.log td/osd-backfill-stats/osd.2.log td/osd-backfill-stats/osd.3.log td/osd-backfill-stats/osd.4.log td/osd-backfill-stats/osd.5.log 2024-09-16T05:44:08.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:78: check: local alllogs=td/osd-backfill-stats/osd.1.log 2024-09-16T05:44:08.360 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: echo td/osd-backfill-stats/osd.1.log 2024-09-16T05:44:08.360 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: wc -w 2024-09-16T05:44:08.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:79: check: '[' 1 '!=' 1 ']' 2024-09-16T05:44:08.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:86: check: local 'addp= ' 2024-09-16T05:44:08.361 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:87: check: '[' replicated = erasure ']' 2024-09-16T05:44:08.361 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '"' '$log' '|' tail -1 '|' sed '"s/.*[)]' '\([[][^' 'p]*\).*$/\1/"' 2024-09-16T05:44:08.362 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:44:08.362 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: tail -1 2024-09-16T05:44:08.362 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: sed 's/.*[)] \([[][^ p]*\).*$/\1/' 2024-09-16T05:44:08.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:92: check: UPACT='[0,2,4]/[1]' 2024-09-16T05:44:08.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:93: check: '[' -n '[0,2,4]/[1]' ']' 2024-09-16T05:44:08.384 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:96: check: local which=degraded 2024-09-16T05:44:08.384 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:44:08.385 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:44:08.385 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -F ' [0,2,4]/[1] ' 2024-09-16T05:44:08.385 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: grep -v est 2024-09-16T05:44:08.385 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: head -1 2024-09-16T05:44:08.385 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:44:08.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:97: check: FIRST=400 2024-09-16T05:44:08.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:98: check: '[' -n 400 ']' 2024-09-16T05:44:08.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:99: check: below_margin 400 400 2024-09-16T05:44:08.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=400 2024-09-16T05:44:08.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:44:08.390 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=400 2024-09-16T05:44:08.391 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:44:08.391 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:44:08.391 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats degraded ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:44:08.391 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: tail -1 2024-09-16T05:44:08.391 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:44:08.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:100: check: LAST=2 2024-09-16T05:44:08.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:101: check: '[' -n 2 ']' 2024-09-16T05:44:08.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:102: check: above_margin 2 0 2024-09-16T05:44:08.401 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=2 2024-09-16T05:44:08.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:44:08.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:44:08.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:44:08.402 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:105: check: which=misplaced 2024-09-16T05:44:08.402 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' grep -F '"' '${UPACT}${addp}"' '|' grep -v est '|' head -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:44:08.402 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:44:08.402 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -F ' [0,2,4]/[1] ' 2024-09-16T05:44:08.402 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: grep -v est 2024-09-16T05:44:08.402 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: head -1 2024-09-16T05:44:08.402 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:44:08.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:106: check: FIRST=200 2024-09-16T05:44:08.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:107: check: '[' -n 200 ']' 2024-09-16T05:44:08.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:108: check: below_margin 200 200 2024-09-16T05:44:08.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:43: below_margin: local -i check=200 2024-09-16T05:44:08.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:44: below_margin: shift 2024-09-16T05:44:08.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:45: below_margin: local -i target=200 2024-09-16T05:44:08.406 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:47: below_margin: return 0 2024-09-16T05:44:08.406 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: eval grep '"pg[[]${PG}.*backfilling.*PeeringState::update_calc_stats' '$which' '"' '$log' '|' tail -1 '|' sed '"s/.*' '\([0-9]*\)$/\1/"' 2024-09-16T05:44:08.407 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: grep 'pg[[]1.0.*backfilling.*PeeringState::update_calc_stats misplaced ' td/osd-backfill-stats/osd.1.log 2024-09-16T05:44:08.407 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: tail -1 2024-09-16T05:44:08.407 INFO:tasks.workunit.client.0.smithi026.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: sed 's/.* \([0-9]*\)$/\1/' 2024-09-16T05:44:08.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:109: check: LAST=1 2024-09-16T05:44:08.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:110: check: '[' -n 1 ']' 2024-09-16T05:44:08.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:111: check: above_margin 1 0 2024-09-16T05:44:08.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:51: above_margin: local -i check=1 2024-09-16T05:44:08.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:52: above_margin: shift 2024-09-16T05:44:08.418 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:53: above_margin: local -i target=0 2024-09-16T05:44:08.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:55: above_margin: return 0 2024-09-16T05:44:08.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:114: check: '[' -n '' ']' 2024-09-16T05:44:08.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:218: TEST_backfill_sizeup_out: delete_pool test 2024-09-16T05:44:08.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2024-09-16T05:44:08.419 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2024-09-16T05:44:08.971 INFO:tasks.workunit.client.0.smithi026.stderr:pool 'test' does not exist 2024-09-16T05:44:08.983 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:219: TEST_backfill_sizeup_out: kill_daemons td/osd-backfill-stats 2024-09-16T05:44:08.984 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:44:08.984 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:44:08.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:44:08.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:44:08.984 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:44:10.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:44:10.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh:38: run: teardown td/osd-backfill-stats 2024-09-16T05:44:10.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:44:10.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2024-09-16T05:44:10.297 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:44:10.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:44:10.297 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:44:10.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:44:10.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:44:10.298 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:44:10.306 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:44:10.307 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:44:10.307 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:44:10.308 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:44:10.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:44:10.309 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:44:10.309 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:44:10.310 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:44:10.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:44:10.311 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:44:10.311 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:44:10.312 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:44:10.313 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2024-09-16T05:44:10.314 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:44:10.355 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:44:10.355 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:44:10.355 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:44:10.355 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:44:10.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:44:10.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:44:10.357 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2322: main: code=0 2024-09-16T05:44:10.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2326: main: teardown td/osd-backfill-stats 0 2024-09-16T05:44:10.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-backfill-stats 2024-09-16T05:44:10.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2024-09-16T05:44:10.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-backfill-stats KILL 2024-09-16T05:44:10.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2024-09-16T05:44:10.358 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2024-09-16T05:44:10.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2024-09-16T05:44:10.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2024-09-16T05:44:10.358 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2024-09-16T05:44:10.359 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2024-09-16T05:44:10.359 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2024-09-16T05:44:10.360 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2024-09-16T05:44:10.360 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2024-09-16T05:44:10.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2024-09-16T05:44:10.362 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2024-09-16T05:44:10.362 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2024-09-16T05:44:10.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:44:10.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2024-09-16T05:44:10.363 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2024-09-16T05:44:10.363 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T05:44:10.364 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:44:10.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2024-09-16T05:44:10.365 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-backfill-stats 2024-09-16T05:44:10.367 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2024-09-16T05:44:10.367 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2024-09-16T05:44:10.367 INFO:tasks.workunit.client.0.smithi026.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.478321 2024-09-16T05:44:10.367 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.478321 2024-09-16T05:44:10.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2024-09-16T05:44:10.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2024-09-16T05:44:10.369 INFO:tasks.workunit.client.0.smithi026.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2327: main: return 0 2024-09-16T05:44:10.370 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T05:44:10.370 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T05:44:10.400 INFO:tasks.workunit:Stopping ['osd-backfill'] on client.0... 2024-09-16T05:44:10.400 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T05:44:10.757 DEBUG:teuthology.parallel:result is None 2024-09-16T05:44:10.758 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T05:44:10.783 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T05:44:10.784 DEBUG:teuthology.orchestra.run.smithi026:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T05:44:10.854 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T05:44:10.854 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T05:44:10.864 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T05:44:10.864 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T05:44:10.943 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T05:44:10.951 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T05:44:10.951 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T05:44:10.975 INFO:teuthology.orchestra.run.smithi026.stderr:bash: line 1: ntpq: command not found 2024-09-16T05:44:10.980 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T05:44:10.980 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2024-09-16T05:44:10.980 INFO:teuthology.orchestra.run.smithi026.stdout:^* hv01.front.sepia.ceph.com 3 7 377 46 +640us[ +619us] +/- 45ms 2024-09-16T05:44:10.980 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 +167us[ +167us] +/- 66ms 2024-09-16T05:44:10.980 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 53 -1379us[-1401us] +/- 75ms 2024-09-16T05:44:10.981 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T05:44:10.981 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T05:44:10.989 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T05:44:10.989 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T05:44:11.026 DEBUG:teuthology.orchestra.run.smithi026:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T05:44:11.095 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-16T05:44:11.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T05:44:11.123 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T05:44:11.133 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T05:44:11.142 INFO:teuthology.task.internal:Duration was 8887.921720 seconds 2024-09-16T05:44:11.142 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T05:44:11.150 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T05:44:11.150 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T05:44:11.203 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T05:44:11.414 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T05:44:11.415 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2024-09-16T05:44:11.415 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T05:44:11.483 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T05:44:11.484 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T05:44:11.552 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T05:44:11.552 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T05:44:11.695 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T05:44:11.704 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T05:44:11.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T05:44:11.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T05:44:11.739 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:44:11.795 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2024-09-16T05:44:11.808 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T05:44:11.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T05:44:11.864 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T05:44:11.874 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T05:44:11.876 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905859/remote/smithi026 2024-09-16T05:44:11.877 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T05:44:11.972 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T05:44:11.973 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T05:44:11.989 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T05:44:12.002 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T05:44:12.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T05:44:12.011 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T05:44:12.012 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T05:44:12.046 INFO:teuthology.orchestra.run.smithi026.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 05:44 /home/ubuntu/cephtest 2024-09-16T05:44:12.047 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T05:44:12.057 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T05:44:12.109 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd-backfill} duration: 8887.921719789505 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-16T05:44:12.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T05:44:12.198 INFO:teuthology.run:pass